Sep 17 21:45:38 devstack cinder-volume[74512]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 17 21:45:38 devstack cinder-volume[74512]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 17 21:45:38 devstack cinder-volume[74512]: we strongly recommend against using it for new projects. Sep 17 21:45:38 devstack cinder-volume[74512]: If you are already using Eventlet, we recommend migrating to a different Sep 17 21:45:38 devstack cinder-volume[74512]: framework. For more detail see Sep 17 21:45:38 devstack cinder-volume[74512]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 17 21:45:38 devstack cinder-volume[74512]: import eventlet # noqa Sep 17 21:45:41 devstack cinder-volume[74512]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=74512) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 17 21:45:41 devstack cinder-volume[74512]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=74512) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 17 21:45:41 devstack cinder-volume[74512]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=74512) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 17 21:45:41 devstack cinder-volume[74512]: INFO dbcounter [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] Registered counter for database cinder Sep 17 21:45:42 devstack cinder-volume[74512]: DEBUG oslo_db.sqlalchemy.engines [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=74512) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 17 21:45:42 devstack cinder-volume[74512]: DEBUG dbcounter [-] [74512] Writer thread running {{(pid=74512) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 17 21:45:42 devstack cinder-volume[74512]: INFO cinder.rpc [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 17 21:45:42 devstack cinder-volume[74512]: INFO cinder.rpc [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 17 21:45:42 devstack cinder-volume[74512]: DEBUG oslo_db.sqlalchemy.engines [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=74512) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 17 21:45:42 devstack cinder-volume[74512]: INFO cinder.volume.manager [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] Determined volume DB was empty at startup. Sep 17 21:45:42 devstack cinder-volume[74512]: DEBUG cinder.volume.manager [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=74512) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 17 21:45:42 devstack cinder-volume[74512]: INFO cinder.volume.manager [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 17 21:45:42 devstack cinder-volume[74512]: WARNING stevedore.named [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 17 21:45:42 devstack cinder-volume[74512]: WARNING castellan.key_manager [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 17 21:45:42 devstack cinder-volume[74512]: WARNING cinder.keymgr.conf_key_mgr [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 17 21:45:42 devstack cinder-volume[74512]: DEBUG cinder.volume.drivers.lvm [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=74512) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 17 21:45:42 devstack cinder-volume[74512]: DEBUG oslo_concurrency.processutils [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=74512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:45:42 devstack cinder-volume[74512]: DEBUG oslo_concurrency.processutils [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] CMD "cinder-rtstool verify" returned: 0 in 0.455s {{(pid=74512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_db.sqlalchemy.engines [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=74512) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 17 21:45:43 devstack cinder-volume[74512]: INFO cinder.rpc [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 17 21:45:43 devstack cinder-volume[74512]: INFO cinder.rpc [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 17 21:45:43 devstack cinder-volume[74512]: WARNING stevedore.named [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 17 21:45:43 devstack cinder-volume[74512]: WARNING castellan.key_manager [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 17 21:45:43 devstack cinder-volume[74512]: INFO cinder.volume.manager [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_db.sqlalchemy.engines [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=74512) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 17 21:45:43 devstack cinder-volume[74512]: INFO oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] Starting 1 workers Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] Started child 74662 {{(pid=74512) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] Full set of CONF: {{(pid=74512) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] ******************************************************************************** {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] Configuration options gathered from: {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] ================================================================================ {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] allow_availability_zone_fallback = False {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] allow_compression_on_image_upload = False {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] allowed_direct_url_schemes = [] {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] api_rate_limit = True {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] auth_strategy = keystone {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] az_cache_duration = 3600 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] backend_availability_zone = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] backend_host = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] backend_name = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] backend_stats_polling_interval = 60 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] backup_api_class = cinder.backup.api.API {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] backup_name_template = backup-%s {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] backup_use_same_host = False {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] backup_use_temp_snapshot = False {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] chap_password = **** {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74662]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] chap_username = {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] cinder_internal_tenant_project_id = 3b24c828c1ac4ba7bd3633490d2b7af4 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] cinder_internal_tenant_user_id = 4a23a6533c444d74b2a03d8f9d26cc50 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] cloned_volume_same_az = True {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] cluster = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] compression_format = gzip {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] compute_api_class = cinder.compute.nova.API {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] config_dir = [] {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] config_source = [] {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] control_exchange = openstack {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] debug = True {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] default_availability_zone = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] default_group_type = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] default_volume_type = lvmdriver-1 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] disk_geometry = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] driver_client_cert = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] driver_client_cert_key = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] driver_data_namespace = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] driver_ssl_cert_path = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] driver_ssl_cert_verify = False {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] driver_use_ssl = False {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] enable_force_upload = False {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] enable_new_services = True {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] enable_unsupported_driver = False {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] enabled_backends = ['lvmdriver-1'] {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] enforce_multipath_for_image_xfer = False {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] filter_function = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] glance_api_insecure = False {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] glance_api_servers = ['http://192.168.122.41/image'] {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] glance_api_ssl_compression = False {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] glance_ca_certificates_file = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] glance_catalog_info = image:glance:publicURL {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] glance_certfile = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] glance_keyfile = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] glance_num_retries = 3 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] glance_request_timeout = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] goodness_function = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] graceful_shutdown_timeout = 5 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] group_api_class = cinder.group.api.API {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] host = devstack {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] image_compress_on_upload = True {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] image_conversion_address_space_limit = 1 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] image_conversion_cpu_limit = 60 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] image_conversion_disable = False {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] image_introspection_address_space_limit = 1 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] image_introspection_cpu_limit = 60 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] image_upload_use_cinder_backend = False {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] image_upload_use_internal_tenant = False {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] image_volume_cache_enabled = False {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] image_volume_cache_max_count = 0 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] image_volume_cache_max_size_gb = 0 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] init_host_max_objects_retrieval = 0 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] instance_format = [instance: %(uuid)s] {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] iscsi_target_flags = {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] iscsi_write_cache = on {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] iser_helper = tgtadm {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] iser_ip_address = 192.168.122.41 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] iser_port = 3260 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] log_color = False {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] log_config_append = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] log_dir = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] log_file = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] log_options = True {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] log_rotate_interval = 1 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] log_rotate_interval_type = days {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] log_rotation_type = none {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] max_age = 0 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] max_logfile_count = 30 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] max_logfile_size_mb = 200 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] max_over_subscription_ratio = 20.0 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] message_reap_interval = 86400 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] message_ttl = 2592000 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] migration_create_volume_timeout_secs = 300 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] monkey_patch = False {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] monkey_patch_modules = [] {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] my_ip = 192.168.122.41 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] no_snapshot_gb_quota = False {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] num_iser_scan_tries = 3 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] num_shell_tries = 3 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] num_volume_device_scan_tries = 3 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] nvmeof_conn_info_version = 1 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] nvmet_ns_id = 10 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] nvmet_port_id = 1 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] osapi_max_limit = 1000 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] osapi_volume_ext_list = [] {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] osapi_volume_listen = 0.0.0.0 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] osapi_volume_listen_port = 8776 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] osapi_volume_use_ssl = False {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] osapi_volume_workers = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] per_volume_size_limit = -1 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] periodic_fuzzy_delay = 60 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] periodic_interval = 60 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] project_id_regex = [0-9a-f\-]+ {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] public_endpoint = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] publish_errors = False {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] quota_backup_gigabytes = 1000 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] quota_backups = 10 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] quota_gigabytes = 1000 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] quota_groups = 10 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] quota_snapshots = 10 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] quota_volumes = 10 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] rate_limit_burst = 0 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] rate_limit_except_level = CRITICAL {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] rate_limit_interval = 0 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] reinit_driver_count = 3 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] replication_device = **** {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] report_discard_supported = False {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] report_interval = 120 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] reservation_clean_interval = 86400 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] reservation_expire = 86400 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] reserved_image_namespaces = [] {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] reserved_percentage = 0 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] rpc_response_timeout = 120 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] run_external_periodic_tasks = True {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] scst_target_driver = iscsi {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] scst_target_iqn_name = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] service_down_time = 720 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] shell_completion = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] snapshot_name_template = snapshot-%s {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] snapshot_same_host = True {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] split_loggers = False {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] state_path = /opt/stack/data/cinder {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] storage_availability_zone = nova {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] storage_protocol = iSCSI {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] syslog_log_facility = LOG_USER {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] target_helper = lioadm {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] target_ip_address = 192.168.122.41 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] target_port = 3260 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74662]: INFO cinder.volume.manager [None req-ed882094-9fb8-4d97-97a4-879af18dfeab None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] target_protocol = iscsi {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] target_secondary_ip_addresses = [] {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] trace_flags = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] transfer_api_class = cinder.transfer.api.API {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] transport_url = **** {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] until_refresh = 0 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] use_chap_auth = False {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] use_default_quota_class = True {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] use_journal = False {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] use_json = False {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] use_multipath_for_image_xfer = False {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] use_stderr = False {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] use_syslog = False {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] verify_glance_signatures = enabled {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] volume_api_class = cinder.volume.api.API {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] volume_backend_name = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] volume_clear = zero {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] volume_clear_ionice = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] volume_clear_size = 0 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] volume_copy_bps_limit = 0 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] volume_dd_blocksize = 1M {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74662]: DEBUG oslo_concurrency.processutils [None req-ed882094-9fb8-4d97-97a4-879af18dfeab None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=74662) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] volume_name_template = volume-%s {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] volume_service_inithost_offload = False {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] volume_usage_audit_period = month {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] zoning_mode = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] oslo_concurrency.disable_process_locking = False {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] keystone_authtoken.auth_section = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] keystone_authtoken.auth_type = password {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] keystone_authtoken.auth_version = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] keystone_authtoken.cache = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] keystone_authtoken.certfile = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] keystone_authtoken.delay_auth_decision = False {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] keystone_authtoken.http_connect_timeout = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] keystone_authtoken.include_service_catalog = True {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] keystone_authtoken.insecure = False {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] keystone_authtoken.interface = public {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] keystone_authtoken.keyfile = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] keystone_authtoken.memcache_password = **** {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] keystone_authtoken.memcache_username = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] keystone_authtoken.region_name = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] keystone_authtoken.service_token_roles_required = True {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] keystone_authtoken.service_type = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] keystone_authtoken.token_cache_time = 300 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.41/identity {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] cache.backend = dogpile.cache.null {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] cache.backend_argument = **** {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] cache.backend_expiration_time = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] cache.config_prefix = cache.oslo {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] cache.debug_cache_backend = False {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] cache.enable_retry_client = False {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] cache.enable_socket_keepalive = False {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] cache.enabled = False {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] cache.expiration_time = 600 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] cache.hashclient_retry_attempts = 2 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] cache.memcache_dead_retry = 300 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] cache.memcache_pool_maxsize = 10 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] cache.memcache_sasl_enabled = False {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] cache.password = **** {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] cache.proxies = [] {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] cache.redis_db = 0 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] cache.redis_sentinel_service_name = mymaster {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] cache.redis_server = localhost:6379 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] cache.retry_attempts = 2 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] cache.retry_delay = 0.0 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] cache.socket_keepalive_count = 1 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] cache.socket_keepalive_idle = 1 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] cache.socket_keepalive_interval = 1 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] cache.socket_timeout = 1.0 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] cache.tls_allowed_ciphers = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] cache.tls_cafile = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] cache.tls_certfile = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] cache.tls_enabled = False {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] cache.tls_keyfile = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] cache.username = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] coordination.backend_url = **** {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] database.asyncio_connection = **** {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] database.asyncio_slave_connection = **** {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] database.backend = sqlalchemy {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] database.connection = **** {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] database.connection_debug = 0 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] database.connection_parameters = {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] database.connection_recycle_time = 3600 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] database.connection_trace = False {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] database.db_inc_retry_interval = True {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] database.db_max_retries = 20 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] database.db_max_retry_interval = 10 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] database.db_retry_interval = 1 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] database.max_overflow = 50 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] database.max_pool_size = 5 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] database.max_retries = 10 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] database.mysql_wsrep_sync_wait = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] database.pool_timeout = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] database.retry_interval = 10 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] database.slave_connection = **** {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] database.sqlite_synchronous = True {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] database.synchronous_reader = True {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] database.use_db_reconnect = False {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] oslo_messaging_tracing.insecure = False {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] profiler.connection_string = messaging:// {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] profiler.enabled = False {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] profiler.es_doc_type = notification {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] profiler.es_scroll_size = 10000 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] profiler.es_scroll_time = 2m {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] profiler.filter_error_trace = False {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] profiler.hmac_keys = **** {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] profiler.sentinel_service_name = mymaster {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] profiler.socket_timeout = 0.1 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] profiler.trace_requests = False {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] profiler.trace_sqlalchemy = False {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] profiler_jaeger.process_tags = {} {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] profiler_jaeger.service_name_prefix = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] profiler_otlp.service_name_prefix = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] oslo_policy.enforce_new_defaults = True {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] oslo_policy.policy_default_rule = default {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] oslo_policy.policy_file = policy.yaml {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] oslo_policy.remote_timeout = 60.0 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] privsep_osbrick.group = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] privsep_osbrick.helper_command = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] privsep_osbrick.user = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] cinder_sys_admin.group = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] cinder_sys_admin.helper_command = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] cinder_sys_admin.user = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] service_user.auth_section = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] service_user.auth_type = password {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] service_user.cafile = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] service_user.certfile = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] service_user.collect_timing = False {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] service_user.insecure = False {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] service_user.keyfile = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] service_user.send_service_user_token = True {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] service_user.split_loggers = False {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] service_user.timeout = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] service_user.tls_ciphers = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] service_user.tls_min_version = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74662]: DEBUG oslo_concurrency.processutils [None req-ed882094-9fb8-4d97-97a4-879af18dfeab None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.078s {{(pid=74662) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] glance.auth_section = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] glance.auth_type = password {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] glance.certfile = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] glance.collect_timing = False {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] glance.insecure = False {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] glance.keyfile = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] glance.region_name = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] glance.split_loggers = False {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] glance.timeout = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] glance.tls_ciphers = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] glance.tls_min_version = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] backend_defaults.backend_availability_zone = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] backend_defaults.chap_password = **** {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] backend_defaults.chap_username = {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74662]: DEBUG oslo_concurrency.processutils [None req-ed882094-9fb8-4d97-97a4-879af18dfeab None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=74662) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] backend_defaults.disk_geometry = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] backend_defaults.driver_client_cert = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] backend_defaults.driver_client_cert_key = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] backend_defaults.driver_data_namespace = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] backend_defaults.driver_use_ssl = False {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] backend_defaults.enable_unsupported_driver = False {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] backend_defaults.extra_capabilities = {} {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] backend_defaults.filter_function = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] backend_defaults.goodness_function = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] backend_defaults.iscsi_target_flags = {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] backend_defaults.iscsi_write_cache = on {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] backend_defaults.iser_helper = tgtadm {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] backend_defaults.iser_ip_address = 192.168.122.41 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] backend_defaults.iser_port = 3260 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] backend_defaults.lvm_mirrors = 0 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] backend_defaults.lvm_share_target = False {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] backend_defaults.lvm_type = auto {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] backend_defaults.num_shell_tries = 3 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] backend_defaults.nvmet_port_id = 1 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] backend_defaults.replication_device = **** {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] backend_defaults.report_discard_supported = False {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] backend_defaults.reserved_percentage = 0 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] backend_defaults.scst_target_driver = iscsi {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] backend_defaults.scst_target_iqn_name = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] backend_defaults.storage_protocol = iSCSI {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] backend_defaults.target_helper = tgtadm {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] backend_defaults.target_ip_address = 192.168.122.41 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] backend_defaults.target_port = 3260 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] backend_defaults.target_protocol = iscsi {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] backend_defaults.trace_flags = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] backend_defaults.unique_fqdn_network = True {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] backend_defaults.use_chap_auth = False {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] backend_defaults.volume_backend_name = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] backend_defaults.volume_clear = zero {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] backend_defaults.volume_clear_ionice = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] backend_defaults.volume_clear_size = 0 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] backend_defaults.volume_group = cinder-volumes {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] oslo_reports.file_event_handler = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] oslo_reports.log_dir = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] lvmdriver-1.backend_availability_zone = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] lvmdriver-1.backend_host = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] lvmdriver-1.chap_password = **** {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] lvmdriver-1.chap_username = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] lvmdriver-1.chiscsi_conf = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] lvmdriver-1.disk_geometry = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] lvmdriver-1.driver_client_cert = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] lvmdriver-1.driver_data_namespace = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] lvmdriver-1.driver_use_ssl = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] lvmdriver-1.extra_capabilities = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] lvmdriver-1.filter_function = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] lvmdriver-1.goodness_function = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] lvmdriver-1.iser_helper = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] lvmdriver-1.iser_ip_address = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] lvmdriver-1.iser_port = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] lvmdriver-1.iser_target_prefix = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] lvmdriver-1.lvm_conf_file = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] lvmdriver-1.lvm_mirrors = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] lvmdriver-1.lvm_share_target = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] lvmdriver-1.lvm_type = auto {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] lvmdriver-1.num_shell_tries = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] lvmdriver-1.nvmet_port_id = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] lvmdriver-1.replication_device = **** {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] lvmdriver-1.report_discard_supported = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] lvmdriver-1.reserved_percentage = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] lvmdriver-1.scst_target_driver = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] lvmdriver-1.storage_protocol = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] lvmdriver-1.target_helper = lioadm {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] lvmdriver-1.target_ip_address = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74662]: DEBUG oslo_concurrency.processutils [None req-ed882094-9fb8-4d97-97a4-879af18dfeab None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.042s {{(pid=74662) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] lvmdriver-1.target_port = 3260 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] lvmdriver-1.target_protocol = iscsi {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] lvmdriver-1.trace_flags = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] lvmdriver-1.use_chap_auth = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] lvmdriver-1.volume_clear = zero {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] lvmdriver-1.volume_clear_size = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74662]: DEBUG oslo_concurrency.processutils [None req-ed882094-9fb8-4d97-97a4-879af18dfeab None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=74662) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] lvmdriver-1.volumes_dir = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] oslo_messaging_rabbit.ssl = False {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] oslo_messaging_rabbit.ssl_version = {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] oslo_messaging_notifications.driver = [] {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] oslo_messaging_notifications.retry = -1 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] oslo_messaging_notifications.transport_url = **** {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] key_manager.fixed_key = **** {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] barbican.barbican_api_version = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] barbican.barbican_endpoint = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] barbican.barbican_endpoint_type = public {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] barbican.barbican_region_name = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] barbican.cafile = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] barbican.certfile = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] barbican.collect_timing = False {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] barbican.insecure = False {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] barbican.keyfile = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] barbican.number_of_retries = 60 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] barbican.retry_delay = 1 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] barbican.send_service_user_token = False {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] barbican.split_loggers = False {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] barbican.timeout = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] barbican.tls_ciphers = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] barbican.tls_min_version = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] barbican.verify_ssl = True {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] barbican.verify_ssl_path = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] barbican_service_user.auth_section = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] barbican_service_user.auth_type = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] barbican_service_user.cafile = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] barbican_service_user.certfile = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] barbican_service_user.collect_timing = False {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] barbican_service_user.insecure = False {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] barbican_service_user.keyfile = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] barbican_service_user.split_loggers = False {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] barbican_service_user.timeout = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] barbican_service_user.tls_ciphers = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] barbican_service_user.tls_min_version = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] vault.approle_role_id = **** {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] vault.approle_secret_id = **** {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] vault.auth_method = approle {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] vault.auth_path = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] vault.kv_mountpoint = secret {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] vault.kv_path = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] vault.kv_version = 2 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] vault.namespace = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] vault.root_token_id = **** {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] vault.ssl_ca_crt_file = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] vault.timeout = 60.0 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] vault.token_file = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74662]: DEBUG oslo_concurrency.processutils [None req-ed882094-9fb8-4d97-97a4-879af18dfeab None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.036s {{(pid=74662) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] vault.token_role = None {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] vault.use_ssl = False {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:45:43 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] ******************************************************************************** {{(pid=74512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 17 21:45:43 devstack cinder-volume[74662]: DEBUG oslo_concurrency.processutils [None req-ed882094-9fb8-4d97-97a4-879af18dfeab None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=74662) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:45:43 devstack sudo[74666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 17 21:45:43 devstack sudo[74666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:45:43 devstack sudo[74666]: pam_unix(sudo:session): session closed for user root Sep 17 21:45:43 devstack cinder-volume[74662]: DEBUG oslo_concurrency.processutils [None req-ed882094-9fb8-4d97-97a4-879af18dfeab None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.274s {{(pid=74662) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:45:43 devstack cinder-volume[74662]: DEBUG oslo_concurrency.processutils [None req-ed882094-9fb8-4d97-97a4-879af18dfeab None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74662) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:45:43 devstack sudo[74670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 17 21:45:43 devstack sudo[74670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:45:43 devstack sudo[74670]: pam_unix(sudo:session): session closed for user root Sep 17 21:45:43 devstack cinder-volume[74662]: DEBUG oslo_concurrency.processutils [None req-ed882094-9fb8-4d97-97a4-879af18dfeab None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.275s {{(pid=74662) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:45:43 devstack cinder-volume[74662]: DEBUG oslo_concurrency.processutils [None req-ed882094-9fb8-4d97-97a4-879af18dfeab None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=74662) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 21:45:43 devstack cinder-volume[74662]: INFO cinder.brick.local_dev.lvm [None req-ed882094-9fb8-4d97-97a4-879af18dfeab None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 17 21:45:43 devstack cinder-volume[74662]: DEBUG oslo_concurrency.processutils [None req-ed882094-9fb8-4d97-97a4-879af18dfeab None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=74662) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:45:43 devstack cinder-volume[74662]: DEBUG oslo_concurrency.processutils [None req-ed882094-9fb8-4d97-97a4-879af18dfeab None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=74662) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:45:43 devstack cinder-volume[74662]: DEBUG oslo_concurrency.processutils [None req-ed882094-9fb8-4d97-97a4-879af18dfeab None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74662) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:45:43 devstack sudo[74725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 17 21:45:43 devstack sudo[74725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:45:44 devstack sudo[74725]: pam_unix(sudo:session): session closed for user root Sep 17 21:45:44 devstack cinder-volume[74662]: DEBUG oslo_concurrency.processutils [None req-ed882094-9fb8-4d97-97a4-879af18dfeab None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=74662) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:45:44 devstack cinder-volume[74662]: DEBUG cinder.brick.local_dev.lvm [None req-ed882094-9fb8-4d97-97a4-879af18dfeab None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=74662) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 17 21:45:44 devstack cinder-volume[74662]: DEBUG oslo_concurrency.processutils [None req-ed882094-9fb8-4d97-97a4-879af18dfeab None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74662) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:45:44 devstack sudo[74858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 17 21:45:44 devstack sudo[74858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:45:44 devstack sudo[74858]: pam_unix(sudo:session): session closed for user root Sep 17 21:45:44 devstack cinder-volume[74662]: DEBUG oslo_concurrency.processutils [None req-ed882094-9fb8-4d97-97a4-879af18dfeab None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.496s {{(pid=74662) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:45:44 devstack cinder-volume[74662]: DEBUG oslo_concurrency.processutils [None req-ed882094-9fb8-4d97-97a4-879af18dfeab None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=74662) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:45:44 devstack cinder-volume[74662]: DEBUG oslo_concurrency.processutils [None req-ed882094-9fb8-4d97-97a4-879af18dfeab None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=74662) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:45:44 devstack cinder-volume[74662]: DEBUG oslo_concurrency.processutils [None req-ed882094-9fb8-4d97-97a4-879af18dfeab None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74662) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:45:44 devstack sudo[75055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 17 21:45:44 devstack sudo[75055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:45:45 devstack sudo[75055]: pam_unix(sudo:session): session closed for user root Sep 17 21:45:45 devstack cinder-volume[74662]: DEBUG oslo_concurrency.processutils [None req-ed882094-9fb8-4d97-97a4-879af18dfeab None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.273s {{(pid=74662) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:45:45 devstack cinder-volume[74662]: DEBUG oslo_concurrency.processutils [None req-ed882094-9fb8-4d97-97a4-879af18dfeab None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=74662) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:45:45 devstack cinder-volume[74662]: DEBUG oslo_concurrency.processutils [None req-ed882094-9fb8-4d97-97a4-879af18dfeab None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=74662) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:45:45 devstack cinder-volume[74662]: DEBUG oslo_concurrency.processutils [None req-ed882094-9fb8-4d97-97a4-879af18dfeab None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=74662) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:45:45 devstack sudo[75152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 17 21:45:45 devstack sudo[75152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:45:45 devstack sudo[75152]: pam_unix(sudo:session): session closed for user root Sep 17 21:45:45 devstack cinder-volume[74662]: DEBUG oslo_concurrency.processutils [None req-ed882094-9fb8-4d97-97a4-879af18dfeab None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.279s {{(pid=74662) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:45:45 devstack cinder-volume[74662]: DEBUG oslo_concurrency.processutils [None req-ed882094-9fb8-4d97-97a4-879af18dfeab None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74662) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:45:45 devstack sudo[75264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 17 21:45:45 devstack sudo[75264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:45:45 devstack sudo[75264]: pam_unix(sudo:session): session closed for user root Sep 17 21:45:45 devstack cinder-volume[74662]: DEBUG oslo_concurrency.processutils [None req-ed882094-9fb8-4d97-97a4-879af18dfeab None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.312s {{(pid=74662) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:45:45 devstack cinder-volume[74662]: DEBUG oslo_concurrency.processutils [None req-ed882094-9fb8-4d97-97a4-879af18dfeab None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74662) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:45:45 devstack sudo[75277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 17 21:45:45 devstack sudo[75277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:45:46 devstack sudo[75277]: pam_unix(sudo:session): session closed for user root Sep 17 21:45:46 devstack cinder-volume[74662]: DEBUG oslo_concurrency.processutils [None req-ed882094-9fb8-4d97-97a4-879af18dfeab None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.353s {{(pid=74662) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:45:46 devstack cinder-volume[74662]: DEBUG oslo_concurrency.processutils [None req-ed882094-9fb8-4d97-97a4-879af18dfeab None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74662) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:45:46 devstack sudo[75360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 17 21:45:46 devstack sudo[75360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:45:46 devstack sudo[75360]: pam_unix(sudo:session): session closed for user root Sep 17 21:45:46 devstack cinder-volume[74662]: DEBUG oslo_concurrency.processutils [None req-ed882094-9fb8-4d97-97a4-879af18dfeab None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=74662) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:45:46 devstack cinder-volume[74662]: DEBUG oslo_concurrency.processutils [None req-ed882094-9fb8-4d97-97a4-879af18dfeab None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74662) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:45:46 devstack sudo[75363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 17 21:45:46 devstack sudo[75363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:45:46 devstack sudo[75363]: pam_unix(sudo:session): session closed for user root Sep 17 21:45:46 devstack cinder-volume[74662]: DEBUG oslo_concurrency.processutils [None req-ed882094-9fb8-4d97-97a4-879af18dfeab None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.284s {{(pid=74662) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:45:46 devstack cinder-volume[74662]: DEBUG oslo_concurrency.processutils [None req-ed882094-9fb8-4d97-97a4-879af18dfeab None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=74662) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:45:46 devstack cinder-volume[74662]: DEBUG oslo_concurrency.processutils [None req-ed882094-9fb8-4d97-97a4-879af18dfeab None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.029s {{(pid=74662) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:45:46 devstack cinder-volume[74662]: DEBUG oslo_concurrency.processutils [None req-ed882094-9fb8-4d97-97a4-879af18dfeab None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74662) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:45:46 devstack sudo[75419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 17 21:45:46 devstack sudo[75419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:45:46 devstack sudo[75419]: pam_unix(sudo:session): session closed for user root Sep 17 21:45:46 devstack cinder-volume[74662]: DEBUG oslo_concurrency.processutils [None req-ed882094-9fb8-4d97-97a4-879af18dfeab None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.284s {{(pid=74662) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:45:46 devstack cinder-volume[74662]: INFO cinder.volume.drivers.lvm [None req-ed882094-9fb8-4d97-97a4-879af18dfeab None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 17 21:45:46 devstack cinder-volume[74662]: DEBUG oslo_concurrency.processutils [None req-ed882094-9fb8-4d97-97a4-879af18dfeab None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=74662) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:45:46 devstack cinder-volume[74662]: DEBUG oslo_concurrency.processutils [None req-ed882094-9fb8-4d97-97a4-879af18dfeab None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=74662) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:45:46 devstack cinder-volume[74662]: DEBUG oslo_concurrency.processutils [None req-ed882094-9fb8-4d97-97a4-879af18dfeab None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74662) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:45:46 devstack sudo[75457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 17 21:45:46 devstack sudo[75457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:45:47 devstack sudo[75457]: pam_unix(sudo:session): session closed for user root Sep 17 21:45:47 devstack cinder-volume[74662]: DEBUG oslo_concurrency.processutils [None req-ed882094-9fb8-4d97-97a4-879af18dfeab None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.276s {{(pid=74662) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:45:47 devstack cinder-volume[74662]: DEBUG cinder.volume.drivers.lvm [None req-ed882094-9fb8-4d97-97a4-879af18dfeab None None] Updating volume stats {{(pid=74662) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 17 21:45:47 devstack cinder-volume[74662]: DEBUG oslo_concurrency.processutils [None req-ed882094-9fb8-4d97-97a4-879af18dfeab None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74662) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:45:47 devstack sudo[75460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 17 21:45:47 devstack sudo[75460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:45:47 devstack sudo[75460]: pam_unix(sudo:session): session closed for user root Sep 17 21:45:47 devstack cinder-volume[74662]: DEBUG oslo_concurrency.processutils [None req-ed882094-9fb8-4d97-97a4-879af18dfeab None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.294s {{(pid=74662) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:45:47 devstack cinder-volume[74662]: DEBUG oslo_concurrency.processutils [None req-ed882094-9fb8-4d97-97a4-879af18dfeab None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74662) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:45:47 devstack sudo[75469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 17 21:45:47 devstack sudo[75469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:45:47 devstack sudo[75469]: pam_unix(sudo:session): session closed for user root Sep 17 21:45:47 devstack cinder-volume[74662]: DEBUG oslo_concurrency.processutils [None req-ed882094-9fb8-4d97-97a4-879af18dfeab None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=74662) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:45:47 devstack cinder-volume[74662]: DEBUG oslo_concurrency.processutils [None req-ed882094-9fb8-4d97-97a4-879af18dfeab None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74662) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:45:47 devstack sudo[75472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 17 21:45:47 devstack sudo[75472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:45:48 devstack sudo[75472]: pam_unix(sudo:session): session closed for user root Sep 17 21:45:48 devstack cinder-volume[74662]: DEBUG oslo_concurrency.processutils [None req-ed882094-9fb8-4d97-97a4-879af18dfeab None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.267s {{(pid=74662) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:45:48 devstack cinder-volume[74662]: DEBUG oslo_concurrency.processutils [None req-ed882094-9fb8-4d97-97a4-879af18dfeab None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74662) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:45:48 devstack sudo[75476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 17 21:45:48 devstack sudo[75476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:45:48 devstack sudo[75476]: pam_unix(sudo:session): session closed for user root Sep 17 21:45:48 devstack cinder-volume[74662]: DEBUG oslo_concurrency.processutils [None req-ed882094-9fb8-4d97-97a4-879af18dfeab None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=74662) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:45:48 devstack cinder-volume[74662]: INFO cinder.volume.driver [None req-ed882094-9fb8-4d97-97a4-879af18dfeab None None] Driver hasn't implemented _init_vendor_properties() Sep 17 21:45:48 devstack cinder-volume[74662]: DEBUG cinder.volume.driver [None req-ed882094-9fb8-4d97-97a4-879af18dfeab None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=74662) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 17 21:45:48 devstack cinder-volume[74662]: DEBUG oslo_db.sqlalchemy.engines [None req-ed882094-9fb8-4d97-97a4-879af18dfeab None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=74662) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 17 21:45:48 devstack cinder-volume[74662]: DEBUG dbcounter [-] [74662] Writer thread running {{(pid=74662) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 17 21:45:48 devstack cinder-volume[74662]: DEBUG cinder.db.api [None req-ed882094-9fb8-4d97-97a4-879af18dfeab None None] Building query based on filter {{(pid=74662) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 17 21:45:48 devstack cinder-volume[74662]: DEBUG cinder.image.image_utils [None req-ed882094-9fb8-4d97-97a4-879af18dfeab None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=74662) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 17 21:45:48 devstack cinder-volume[74662]: INFO cinder.keymgr.migration [None req-c48ca13c-12fd-4e8a-b0e0-55ee9c87c6ad None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 17 21:45:48 devstack cinder-volume[74662]: DEBUG cinder.volume.drivers.lvm [None req-ed882094-9fb8-4d97-97a4-879af18dfeab None None] Updating volume stats {{(pid=74662) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 17 21:45:48 devstack cinder-volume[74662]: DEBUG oslo_concurrency.processutils [None req-ed882094-9fb8-4d97-97a4-879af18dfeab None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74662) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:45:48 devstack sudo[75481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 17 21:45:48 devstack sudo[75481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:45:48 devstack sudo[75481]: pam_unix(sudo:session): session closed for user root Sep 17 21:45:48 devstack cinder-volume[74662]: DEBUG oslo_concurrency.processutils [None req-ed882094-9fb8-4d97-97a4-879af18dfeab None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=74662) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:45:48 devstack cinder-volume[74662]: DEBUG oslo_concurrency.processutils [None req-ed882094-9fb8-4d97-97a4-879af18dfeab None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74662) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:45:48 devstack sudo[75485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 17 21:45:48 devstack sudo[75485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:45:48 devstack sudo[75485]: pam_unix(sudo:session): session closed for user root Sep 17 21:45:48 devstack cinder-volume[74662]: DEBUG oslo_concurrency.processutils [None req-ed882094-9fb8-4d97-97a4-879af18dfeab None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=74662) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:45:48 devstack cinder-volume[74662]: DEBUG oslo_concurrency.processutils [None req-ed882094-9fb8-4d97-97a4-879af18dfeab None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74662) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:45:48 devstack sudo[75489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 17 21:45:48 devstack sudo[75489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:45:49 devstack sudo[75489]: pam_unix(sudo:session): session closed for user root Sep 17 21:45:49 devstack cinder-volume[74662]: DEBUG oslo_concurrency.processutils [None req-ed882094-9fb8-4d97-97a4-879af18dfeab None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.278s {{(pid=74662) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:45:49 devstack cinder-volume[74662]: DEBUG oslo_concurrency.processutils [None req-ed882094-9fb8-4d97-97a4-879af18dfeab None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74662) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:45:49 devstack sudo[75492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 17 21:45:49 devstack sudo[75492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:45:49 devstack sudo[75492]: pam_unix(sudo:session): session closed for user root Sep 17 21:45:49 devstack cinder-volume[74662]: DEBUG oslo_concurrency.processutils [None req-ed882094-9fb8-4d97-97a4-879af18dfeab None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.279s {{(pid=74662) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:45:49 devstack cinder-volume[74662]: DEBUG cinder.manager [None req-ed882094-9fb8-4d97-97a4-879af18dfeab None None] Notifying Schedulers of capabilities ... {{(pid=74662) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 21:45:49 devstack cinder-volume[74662]: INFO cinder.volume.manager [None req-ed882094-9fb8-4d97-97a4-879af18dfeab None None] Driver initialization completed successfully. Sep 17 21:45:49 devstack cinder-volume[74662]: INFO cinder.manager [None req-ed882094-9fb8-4d97-97a4-879af18dfeab None None] Initiating service 2 cleanup Sep 17 21:45:49 devstack cinder-volume[74662]: INFO cinder.manager [None req-ed882094-9fb8-4d97-97a4-879af18dfeab None None] Service 2 cleanup completed. Sep 17 21:45:49 devstack cinder-volume[74662]: DEBUG cinder.service [None req-ed882094-9fb8-4d97-97a4-879af18dfeab None None] Creating RPC server for service cinder-volume {{(pid=74662) start /opt/stack/cinder/cinder/service.py:231}} Sep 17 21:45:49 devstack cinder-volume[74662]: DEBUG cinder.service [None req-ed882094-9fb8-4d97-97a4-879af18dfeab None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=74662) start /opt/stack/cinder/cinder/service.py:237}} Sep 17 21:45:49 devstack cinder-volume[74662]: INFO cinder.volume.manager [None req-ed882094-9fb8-4d97-97a4-879af18dfeab None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 17 21:45:49 devstack cinder-volume[74662]: DEBUG cinder.volume.drivers.lvm [None req-ed882094-9fb8-4d97-97a4-879af18dfeab None None] Updating volume stats {{(pid=74662) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 17 21:45:49 devstack cinder-volume[74662]: DEBUG oslo_concurrency.processutils [None req-ed882094-9fb8-4d97-97a4-879af18dfeab None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74662) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:45:49 devstack sudo[75495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 17 21:45:49 devstack sudo[75495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:45:49 devstack sudo[75495]: pam_unix(sudo:session): session closed for user root Sep 17 21:45:49 devstack cinder-volume[74662]: DEBUG oslo_concurrency.processutils [None req-ed882094-9fb8-4d97-97a4-879af18dfeab None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.278s {{(pid=74662) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:45:49 devstack cinder-volume[74662]: DEBUG oslo_concurrency.processutils [None req-ed882094-9fb8-4d97-97a4-879af18dfeab None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74662) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:45:49 devstack sudo[75499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 17 21:45:49 devstack sudo[75499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:45:50 devstack sudo[75499]: pam_unix(sudo:session): session closed for user root Sep 17 21:45:50 devstack cinder-volume[74662]: DEBUG oslo_concurrency.processutils [None req-ed882094-9fb8-4d97-97a4-879af18dfeab None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=74662) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:45:50 devstack cinder-volume[74662]: DEBUG oslo_concurrency.processutils [None req-ed882094-9fb8-4d97-97a4-879af18dfeab None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74662) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:45:50 devstack sudo[75503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 17 21:45:50 devstack sudo[75503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:45:50 devstack sudo[75503]: pam_unix(sudo:session): session closed for user root Sep 17 21:45:50 devstack cinder-volume[74662]: DEBUG oslo_concurrency.processutils [None req-ed882094-9fb8-4d97-97a4-879af18dfeab None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.266s {{(pid=74662) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:45:50 devstack cinder-volume[74662]: DEBUG oslo_concurrency.processutils [None req-ed882094-9fb8-4d97-97a4-879af18dfeab None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74662) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:45:50 devstack sudo[75506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 17 21:45:50 devstack sudo[75506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:45:50 devstack sudo[75506]: pam_unix(sudo:session): session closed for user root Sep 17 21:45:50 devstack cinder-volume[74662]: DEBUG oslo_concurrency.processutils [None req-ed882094-9fb8-4d97-97a4-879af18dfeab None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=74662) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:45:50 devstack cinder-volume[74662]: INFO cinder.volume.manager [None req-ed882094-9fb8-4d97-97a4-879af18dfeab None None] Driver post RPC initialization completed successfully. Sep 17 21:45:53 devstack cinder-volume[74512]: DEBUG dbcounter [-] [74512] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=74512) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 21:46:00 devstack cinder-volume[74662]: DEBUG dbcounter [-] [74662] Writing DB stats cinder:SELECT=4 {{(pid=74662) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 21:46:00 devstack cinder-volume[74662]: DEBUG dbcounter [-] [74662] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=74662) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 21:46:22 devstack cinder-volume[74662]: DEBUG oslo_service.periodic_task [None req-5a65feb9-46a6-4c48-8255-9cba5fec35d3 None None] Running periodic task VolumeManager._thread_info {{(pid=74662) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 21:46:22 devstack cinder-volume[74662]: DEBUG cinder.volume.manager [None req-5a65feb9-46a6-4c48-8255-9cba5fec35d3 None None] thread count: 6 {{(pid=74662) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 21:46:22 devstack cinder-volume[74662]: DEBUG cinder.volume.manager [None req-5a65feb9-46a6-4c48-8255-9cba5fec35d3 None None] thread info: [<_MainThread(MainThread, started 130995442770048)>, , , , , ] {{(pid=74662) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 21:47:22 devstack cinder-volume[74662]: DEBUG oslo_service.periodic_task [None req-5a65feb9-46a6-4c48-8255-9cba5fec35d3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=74662) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 21:47:22 devstack cinder-volume[74662]: DEBUG cinder.volume.drivers.lvm [None req-5a65feb9-46a6-4c48-8255-9cba5fec35d3 None None] Updating volume stats {{(pid=74662) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 17 21:47:22 devstack cinder-volume[74662]: DEBUG oslo_concurrency.processutils [None req-5a65feb9-46a6-4c48-8255-9cba5fec35d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74662) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:47:22 devstack sudo[80702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 17 21:47:22 devstack sudo[80702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:47:23 devstack sudo[80702]: pam_unix(sudo:session): session closed for user root Sep 17 21:47:23 devstack cinder-volume[74662]: DEBUG oslo_concurrency.processutils [None req-5a65feb9-46a6-4c48-8255-9cba5fec35d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.241s {{(pid=74662) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:47:23 devstack cinder-volume[74662]: DEBUG oslo_concurrency.processutils [None req-5a65feb9-46a6-4c48-8255-9cba5fec35d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74662) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:47:23 devstack sudo[80707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 17 21:47:23 devstack sudo[80707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:47:23 devstack sudo[80707]: pam_unix(sudo:session): session closed for user root Sep 17 21:47:23 devstack cinder-volume[74662]: DEBUG oslo_concurrency.processutils [None req-5a65feb9-46a6-4c48-8255-9cba5fec35d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.246s {{(pid=74662) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:47:23 devstack cinder-volume[74662]: DEBUG oslo_concurrency.processutils [None req-5a65feb9-46a6-4c48-8255-9cba5fec35d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74662) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:47:23 devstack sudo[80711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 17 21:47:23 devstack sudo[80711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:47:23 devstack sudo[80711]: pam_unix(sudo:session): session closed for user root Sep 17 21:47:23 devstack cinder-volume[74662]: DEBUG oslo_concurrency.processutils [None req-5a65feb9-46a6-4c48-8255-9cba5fec35d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.239s {{(pid=74662) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:47:23 devstack cinder-volume[74662]: DEBUG oslo_concurrency.processutils [None req-5a65feb9-46a6-4c48-8255-9cba5fec35d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74662) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:47:23 devstack sudo[80714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 17 21:47:23 devstack sudo[80714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:47:23 devstack sudo[80714]: pam_unix(sudo:session): session closed for user root Sep 17 21:47:23 devstack cinder-volume[74662]: DEBUG oslo_concurrency.processutils [None req-5a65feb9-46a6-4c48-8255-9cba5fec35d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=74662) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:47:23 devstack cinder-volume[74662]: DEBUG cinder.manager [None req-5a65feb9-46a6-4c48-8255-9cba5fec35d3 None None] Notifying Schedulers of capabilities ... {{(pid=74662) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 21:47:23 devstack cinder-volume[74662]: DEBUG oslo_service.periodic_task [None req-5a65feb9-46a6-4c48-8255-9cba5fec35d3 None None] Running periodic task VolumeManager._thread_info {{(pid=74662) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 21:47:23 devstack cinder-volume[74662]: DEBUG cinder.volume.manager [None req-5a65feb9-46a6-4c48-8255-9cba5fec35d3 None None] thread count: 6 {{(pid=74662) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 21:47:23 devstack cinder-volume[74662]: DEBUG cinder.volume.manager [None req-5a65feb9-46a6-4c48-8255-9cba5fec35d3 None None] thread info: [<_MainThread(MainThread, started 130995442770048)>, , , , , ] {{(pid=74662) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 21:48:00 devstack cinder-volume[74662]: DEBUG dbcounter [-] [74662] Writing DB stats cinder:SELECT=1 {{(pid=74662) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 21:48:00 devstack cinder-volume[74662]: DEBUG dbcounter [-] [74662] Writing DB stats cinder:UPDATE=1 {{(pid=74662) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 21:48:22 devstack cinder-volume[74662]: DEBUG oslo_service.periodic_task [None req-5a65feb9-46a6-4c48-8255-9cba5fec35d3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=74662) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 21:48:22 devstack cinder-volume[74662]: DEBUG cinder.volume.drivers.lvm [None req-5a65feb9-46a6-4c48-8255-9cba5fec35d3 None None] Updating volume stats {{(pid=74662) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 17 21:48:22 devstack cinder-volume[74662]: DEBUG oslo_concurrency.processutils [None req-5a65feb9-46a6-4c48-8255-9cba5fec35d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74662) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:48:22 devstack sudo[82208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 17 21:48:22 devstack sudo[82208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:48:23 devstack sudo[82208]: pam_unix(sudo:session): session closed for user root Sep 17 21:48:23 devstack cinder-volume[74662]: DEBUG oslo_concurrency.processutils [None req-5a65feb9-46a6-4c48-8255-9cba5fec35d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.272s {{(pid=74662) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:48:23 devstack cinder-volume[74662]: DEBUG oslo_concurrency.processutils [None req-5a65feb9-46a6-4c48-8255-9cba5fec35d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74662) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:48:23 devstack sudo[82216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 17 21:48:23 devstack sudo[82216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:48:23 devstack sudo[82216]: pam_unix(sudo:session): session closed for user root Sep 17 21:48:23 devstack cinder-volume[74662]: DEBUG oslo_concurrency.processutils [None req-5a65feb9-46a6-4c48-8255-9cba5fec35d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=74662) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:48:23 devstack cinder-volume[74662]: DEBUG oslo_concurrency.processutils [None req-5a65feb9-46a6-4c48-8255-9cba5fec35d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74662) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:48:23 devstack sudo[82221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 17 21:48:23 devstack sudo[82221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:48:23 devstack sudo[82221]: pam_unix(sudo:session): session closed for user root Sep 17 21:48:23 devstack cinder-volume[74662]: DEBUG oslo_concurrency.processutils [None req-5a65feb9-46a6-4c48-8255-9cba5fec35d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.251s {{(pid=74662) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:48:23 devstack cinder-volume[74662]: DEBUG oslo_concurrency.processutils [None req-5a65feb9-46a6-4c48-8255-9cba5fec35d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74662) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:48:23 devstack sudo[82224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 17 21:48:23 devstack sudo[82224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:48:23 devstack sudo[82224]: pam_unix(sudo:session): session closed for user root Sep 17 21:48:23 devstack cinder-volume[74662]: DEBUG oslo_concurrency.processutils [None req-5a65feb9-46a6-4c48-8255-9cba5fec35d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=74662) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:48:23 devstack cinder-volume[74662]: DEBUG cinder.manager [None req-5a65feb9-46a6-4c48-8255-9cba5fec35d3 None None] Notifying Schedulers of capabilities ... {{(pid=74662) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 21:48:23 devstack cinder-volume[74662]: DEBUG oslo_service.periodic_task [None req-5a65feb9-46a6-4c48-8255-9cba5fec35d3 None None] Running periodic task VolumeManager._thread_info {{(pid=74662) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 21:48:23 devstack cinder-volume[74662]: DEBUG cinder.volume.manager [None req-5a65feb9-46a6-4c48-8255-9cba5fec35d3 None None] thread count: 6 {{(pid=74662) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 21:48:23 devstack cinder-volume[74662]: DEBUG cinder.volume.manager [None req-5a65feb9-46a6-4c48-8255-9cba5fec35d3 None None] thread info: [<_MainThread(MainThread, started 130995442770048)>, , , , , ] {{(pid=74662) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 21:49:22 devstack cinder-volume[74662]: DEBUG oslo_service.periodic_task [None req-5a65feb9-46a6-4c48-8255-9cba5fec35d3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=74662) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 21:49:22 devstack cinder-volume[74662]: DEBUG cinder.volume.drivers.lvm [None req-5a65feb9-46a6-4c48-8255-9cba5fec35d3 None None] Updating volume stats {{(pid=74662) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 17 21:49:22 devstack cinder-volume[74662]: DEBUG oslo_concurrency.processutils [None req-5a65feb9-46a6-4c48-8255-9cba5fec35d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74662) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:49:22 devstack sudo[83689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 17 21:49:22 devstack sudo[83689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:49:23 devstack sudo[83689]: pam_unix(sudo:session): session closed for user root Sep 17 21:49:23 devstack cinder-volume[74662]: DEBUG oslo_concurrency.processutils [None req-5a65feb9-46a6-4c48-8255-9cba5fec35d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=74662) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:49:23 devstack cinder-volume[74662]: DEBUG oslo_concurrency.processutils [None req-5a65feb9-46a6-4c48-8255-9cba5fec35d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74662) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:49:23 devstack sudo[83715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 17 21:49:23 devstack sudo[83715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:49:23 devstack sudo[83715]: pam_unix(sudo:session): session closed for user root Sep 17 21:49:23 devstack cinder-volume[74662]: DEBUG oslo_concurrency.processutils [None req-5a65feb9-46a6-4c48-8255-9cba5fec35d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=74662) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:49:23 devstack cinder-volume[74662]: DEBUG oslo_concurrency.processutils [None req-5a65feb9-46a6-4c48-8255-9cba5fec35d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74662) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:49:23 devstack sudo[83718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 17 21:49:23 devstack sudo[83718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:49:23 devstack sudo[83718]: pam_unix(sudo:session): session closed for user root Sep 17 21:49:23 devstack cinder-volume[74662]: DEBUG oslo_concurrency.processutils [None req-5a65feb9-46a6-4c48-8255-9cba5fec35d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.259s {{(pid=74662) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:49:23 devstack cinder-volume[74662]: DEBUG oslo_concurrency.processutils [None req-5a65feb9-46a6-4c48-8255-9cba5fec35d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74662) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:49:23 devstack sudo[83724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 17 21:49:23 devstack sudo[83724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:49:23 devstack sudo[83724]: pam_unix(sudo:session): session closed for user root Sep 17 21:49:23 devstack cinder-volume[74662]: DEBUG oslo_concurrency.processutils [None req-5a65feb9-46a6-4c48-8255-9cba5fec35d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=74662) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:49:23 devstack cinder-volume[74662]: DEBUG cinder.manager [None req-5a65feb9-46a6-4c48-8255-9cba5fec35d3 None None] Notifying Schedulers of capabilities ... {{(pid=74662) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 21:50:00 devstack cinder-volume[74662]: DEBUG dbcounter [-] [74662] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=74662) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 21:50:07 devstack cinder-volume[74512]: INFO oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] Caught SIGTERM, stopping children Sep 17 21:50:07 devstack cinder-volume[74512]: DEBUG oslo_concurrency.lockutils [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] Acquiring lock "singleton_lock" {{(pid=74512) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 17 21:50:07 devstack cinder-volume[74512]: DEBUG oslo_concurrency.lockutils [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] Acquired lock "singleton_lock" {{(pid=74512) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 17 21:50:07 devstack cinder-volume[74512]: DEBUG oslo_concurrency.lockutils [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] Releasing lock "singleton_lock" {{(pid=74512) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 17 21:50:07 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] Stop services. {{(pid=74512) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 17 21:50:07 devstack cinder-volume[74512]: DEBUG oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] Killing children. {{(pid=74512) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 17 21:50:07 devstack cinder-volume[74512]: INFO oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] Waiting on 1 children to exit Sep 17 21:50:09 devstack cinder-volume[74662]: DEBUG oslo_concurrency.lockutils [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] Acquiring lock "singleton_lock" {{(pid=74662) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 17 21:50:09 devstack cinder-volume[74662]: DEBUG oslo_concurrency.lockutils [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] Acquired lock "singleton_lock" {{(pid=74662) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 17 21:50:09 devstack cinder-volume[74662]: DEBUG oslo_concurrency.lockutils [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] Releasing lock "singleton_lock" {{(pid=74662) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 17 21:50:09 devstack cinder-volume[74662]: WARNING amqp [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 17 21:50:09 devstack cinder-volume[74662]: WARNING amqp [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 17 21:50:09 devstack cinder-volume[74512]: INFO oslo_service.backend._eventlet.service [None req-d2b1c21b-4558-41ec-a10d-e49a762aa324 None None] Child 74662 exited with status 0 Sep 17 21:50:10 devstack cinder-volume[84676]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 17 21:50:10 devstack cinder-volume[84676]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 17 21:50:10 devstack cinder-volume[84676]: we strongly recommend against using it for new projects. Sep 17 21:50:10 devstack cinder-volume[84676]: If you are already using Eventlet, we recommend migrating to a different Sep 17 21:50:10 devstack cinder-volume[84676]: framework. For more detail see Sep 17 21:50:10 devstack cinder-volume[84676]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 17 21:50:10 devstack cinder-volume[84676]: import eventlet # noqa Sep 17 21:50:12 devstack cinder-volume[84676]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=84676) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 17 21:50:12 devstack cinder-volume[84676]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=84676) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 17 21:50:12 devstack cinder-volume[84676]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=84676) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 17 21:50:12 devstack cinder-volume[84676]: INFO dbcounter [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] Registered counter for database cinder Sep 17 21:50:12 devstack cinder-volume[84676]: DEBUG oslo_db.sqlalchemy.engines [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84676) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG dbcounter [-] [84676] Writer thread running {{(pid=84676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 17 21:50:13 devstack cinder-volume[84676]: INFO cinder.rpc [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 17 21:50:13 devstack cinder-volume[84676]: INFO cinder.rpc [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_db.sqlalchemy.engines [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84676) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 17 21:50:13 devstack cinder-volume[84676]: INFO cinder.volume.manager [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] Determined volume DB was empty at startup. Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG cinder.volume.manager [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] Cinder Volume DB check: vol_db_empty=True {{(pid=84676) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 17 21:50:13 devstack cinder-volume[84676]: INFO cinder.volume.manager [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 17 21:50:13 devstack cinder-volume[84676]: WARNING stevedore.named [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 17 21:50:13 devstack cinder-volume[84676]: WARNING castellan.key_manager [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 17 21:50:13 devstack cinder-volume[84676]: WARNING cinder.keymgr.conf_key_mgr [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 17 21:50:13 devstack cinder-volume[84676]: INFO cinder.volume.manager [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_db.sqlalchemy.engines [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84676) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 17 21:50:13 devstack cinder-volume[84676]: INFO oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] Starting 1 workers Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] Started child 84894 {{(pid=84676) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] Full set of CONF: {{(pid=84676) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] ******************************************************************************** {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] Configuration options gathered from: {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] ================================================================================ {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] allow_availability_zone_fallback = False {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] allow_compression_on_image_upload = False {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84894]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] allowed_direct_url_schemes = [] {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] api_rate_limit = True {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] auth_strategy = keystone {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] backend_availability_zone = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] backend_host = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] backend_name = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] backend_stats_polling_interval = 60 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] backup_api_class = cinder.backup.api.API {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] backup_name_template = backup-%s {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] backup_use_same_host = False {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] backup_use_temp_snapshot = False {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] chap_password = **** {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] chap_username = {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] cinder_internal_tenant_project_id = 3b24c828c1ac4ba7bd3633490d2b7af4 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] cinder_internal_tenant_user_id = 4a23a6533c444d74b2a03d8f9d26cc50 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] cluster = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] compression_format = gzip {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] compute_api_class = cinder.compute.nova.API {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] config_dir = [] {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] config_source = [] {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] control_exchange = openstack {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] debug = True {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] default_availability_zone = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] default_group_type = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] default_volume_type = QuobyteHD {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] disk_geometry = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] driver_client_cert = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] driver_client_cert_key = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] driver_data_namespace = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] driver_ssl_cert_path = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] driver_ssl_cert_verify = False {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] driver_use_ssl = False {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] enable_new_services = True {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] enable_unsupported_driver = False {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] enabled_backends = ['QuobyteHD'] {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] enforce_multipath_for_image_xfer = False {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] filter_function = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] glance_api_insecure = False {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] glance_api_servers = ['http://192.168.122.41/image'] {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] glance_api_ssl_compression = False {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] glance_ca_certificates_file = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] glance_catalog_info = image:glance:publicURL {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] glance_certfile = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] glance_keyfile = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] glance_num_retries = 3 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] glance_request_timeout = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] goodness_function = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] graceful_shutdown_timeout = 5 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] group_api_class = cinder.group.api.API {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] host = devstack {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] image_compress_on_upload = True {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] image_conversion_address_space_limit = 1 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] image_conversion_cpu_limit = 60 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] image_conversion_disable = False {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] image_introspection_address_space_limit = 1 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] image_introspection_cpu_limit = 60 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] image_upload_use_cinder_backend = False {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] image_upload_use_internal_tenant = False {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] image_volume_cache_enabled = False {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] image_volume_cache_max_count = 0 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] image_volume_cache_max_size_gb = 0 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84894]: INFO cinder.volume.manager [None req-ba3cc6d6-12f2-4a78-97db-0d34a55c0d45 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] init_host_max_objects_retrieval = 0 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] instance_format = [instance: %(uuid)s] {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84894]: DEBUG cinder.volume.drivers.remotefs [None req-ba3cc6d6-12f2-4a78-97db-0d34a55c0d45 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=84894) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] iscsi_target_flags = {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] iscsi_write_cache = on {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] iser_helper = tgtadm {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] iser_ip_address = 192.168.122.41 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] iser_port = 3260 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] log_color = False {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] log_config_append = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] log_dir = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] log_file = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] log_options = True {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] log_rotate_interval = 1 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] log_rotate_interval_type = days {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] log_rotation_type = none {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] max_age = 0 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] max_logfile_count = 30 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] max_logfile_size_mb = 200 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] max_over_subscription_ratio = 20.0 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] message_reap_interval = 86400 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] message_ttl = 2592000 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] migration_create_volume_timeout_secs = 300 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] monkey_patch = False {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] monkey_patch_modules = [] {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] my_ip = 192.168.122.41 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] no_snapshot_gb_quota = False {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] num_iser_scan_tries = 3 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] num_shell_tries = 3 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] num_volume_device_scan_tries = 3 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] nvmeof_conn_info_version = 1 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] nvmet_ns_id = 10 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] nvmet_port_id = 1 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] osapi_max_limit = 1000 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] osapi_volume_ext_list = [] {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] osapi_volume_listen = 0.0.0.0 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] osapi_volume_listen_port = 8776 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] osapi_volume_use_ssl = False {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] osapi_volume_workers = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] per_volume_size_limit = -1 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] periodic_fuzzy_delay = 60 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] periodic_interval = 60 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] project_id_regex = [0-9a-f\-]+ {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] public_endpoint = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] publish_errors = False {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] quota_backup_gigabytes = 1000 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] quota_backups = 10 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] quota_gigabytes = 1000 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] quota_groups = 10 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] quota_snapshots = 10 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] quota_volumes = 10 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] rate_limit_burst = 0 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] rate_limit_except_level = CRITICAL {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] rate_limit_interval = 0 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] reinit_driver_count = 3 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] replication_device = **** {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] report_discard_supported = False {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] report_interval = 120 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] reservation_clean_interval = 86400 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] reservation_expire = 86400 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] reserved_image_namespaces = [] {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] reserved_percentage = 0 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] rpc_response_timeout = 120 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] run_external_periodic_tasks = True {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] scst_target_driver = iscsi {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] scst_target_iqn_name = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] service_down_time = 720 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] shell_completion = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] snapshot_name_template = snapshot-%s {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] split_loggers = False {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] state_path = /opt/stack/data/cinder {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] storage_availability_zone = nova {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] storage_protocol = iSCSI {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] syslog_log_facility = LOG_USER {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] target_helper = lioadm {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] target_ip_address = 192.168.122.41 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] target_port = 3260 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] target_protocol = iscsi {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] target_secondary_ip_addresses = [] {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] trace_flags = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] transfer_api_class = cinder.transfer.api.API {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] transport_url = **** {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] until_refresh = 0 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] use_chap_auth = False {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] use_default_quota_class = True {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] use_journal = False {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] use_json = False {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] use_multipath_for_image_xfer = False {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] use_stderr = False {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] use_syslog = False {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] verify_glance_signatures = enabled {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] volume_api_class = cinder.volume.api.API {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] volume_backend_name = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] volume_clear = zero {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] volume_clear_ionice = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] volume_clear_size = 0 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] volume_copy_bps_limit = 0 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] volume_dd_blocksize = 1M {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] volume_name_template = volume-%s {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] volume_service_inithost_offload = False {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] volume_usage_audit_period = month {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] zoning_mode = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] oslo_concurrency.disable_process_locking = False {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] os_brick.lightos_discovery_client_address = localhost {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] os_brick.wait_mpath_device_interval = 1 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] keystone_authtoken.auth_section = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] keystone_authtoken.auth_type = password {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] keystone_authtoken.auth_version = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] keystone_authtoken.cache = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] keystone_authtoken.certfile = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] keystone_authtoken.delay_auth_decision = False {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84894]: DEBUG cinder.volume.drivers.quobyte [None req-ba3cc6d6-12f2-4a78-97db-0d34a55c0d45 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=84894) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] keystone_authtoken.http_connect_timeout = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] keystone_authtoken.include_service_catalog = True {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] keystone_authtoken.insecure = False {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] keystone_authtoken.interface = public {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84894]: WARNING cinder.volume.drivers.quobyte [None req-ba3cc6d6-12f2-4a78-97db-0d34a55c0d45 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] keystone_authtoken.keyfile = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84894]: WARNING cinder.volume.drivers.quobyte [None req-ba3cc6d6-12f2-4a78-97db-0d34a55c0d45 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] keystone_authtoken.memcache_password = **** {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84894]: DEBUG oslo_concurrency.processutils [None req-ba3cc6d6-12f2-4a78-97db-0d34a55c0d45 None None] Running cmd (subprocess): mount.quobyte {{(pid=84894) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] keystone_authtoken.memcache_secret_key = **** {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] keystone_authtoken.memcache_security_strategy = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] keystone_authtoken.memcache_username = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] keystone_authtoken.region_name = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] keystone_authtoken.service_token_roles_required = True {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] keystone_authtoken.service_type = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] keystone_authtoken.token_cache_time = 300 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.41/identity {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] cache.backend = dogpile.cache.null {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] cache.backend_argument = **** {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] cache.backend_expiration_time = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] cache.config_prefix = cache.oslo {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] cache.debug_cache_backend = False {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] cache.enable_retry_client = False {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] cache.enable_socket_keepalive = False {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] cache.enabled = False {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] cache.expiration_time = 600 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] cache.hashclient_dead_timeout = 60.0 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] cache.hashclient_retry_attempts = 2 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] cache.hashclient_retry_timeout = 1.0 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] cache.memcache_dead_retry = 300 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] cache.memcache_pool_maxsize = 10 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] cache.memcache_pool_unused_timeout = 60 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] cache.memcache_sasl_enabled = False {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] cache.memcache_servers = ['localhost:11211'] {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] cache.password = **** {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] cache.proxies = [] {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] cache.redis_db = 0 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] cache.redis_sentinel_service_name = mymaster {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] cache.redis_server = localhost:6379 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] cache.retry_attempts = 2 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] cache.retry_delay = 0.0 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] cache.socket_keepalive_count = 1 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] cache.socket_keepalive_idle = 1 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] cache.socket_keepalive_interval = 1 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] cache.socket_timeout = 1.0 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] cache.tls_allowed_ciphers = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] cache.tls_cafile = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] cache.tls_certfile = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] cache.tls_enabled = False {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] cache.tls_keyfile = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] cache.username = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] coordination.backend_url = **** {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] database.asyncio_connection = **** {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] database.asyncio_slave_connection = **** {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] database.backend = sqlalchemy {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] database.connection = **** {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] database.connection_debug = 0 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] database.connection_parameters = {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] database.connection_recycle_time = 3600 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] database.connection_trace = False {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] database.db_inc_retry_interval = True {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] database.db_max_retries = 20 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] database.db_max_retry_interval = 10 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] database.db_retry_interval = 1 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] database.max_overflow = 50 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] database.max_pool_size = 5 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] database.max_retries = 10 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] database.mysql_sql_mode = TRADITIONAL {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] database.mysql_wsrep_sync_wait = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] database.pool_timeout = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] database.retry_interval = 10 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] database.slave_connection = **** {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] database.sqlite_synchronous = True {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] database.synchronous_reader = True {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] database.use_db_reconnect = False {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] oslo_messaging_metrics.metrics_process_name = {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] oslo_messaging_tracing.insecure = False {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] profiler.connection_string = messaging:// {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] profiler.enabled = False {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] profiler.es_doc_type = notification {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] profiler.es_scroll_size = 10000 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] profiler.es_scroll_time = 2m {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] profiler.filter_error_trace = False {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] profiler.hmac_keys = **** {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] profiler.sentinel_service_name = mymaster {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] profiler.socket_timeout = 0.1 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] profiler.trace_requests = False {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] profiler.trace_sqlalchemy = False {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] profiler_jaeger.process_tags = {} {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] profiler_jaeger.service_name_prefix = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] profiler_otlp.service_name_prefix = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] oslo_policy.enforce_new_defaults = True {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] oslo_policy.policy_default_rule = default {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] oslo_policy.policy_file = policy.yaml {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] oslo_policy.remote_timeout = 60.0 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] privsep_osbrick.capabilities = [21, 2] {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] privsep_osbrick.group = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] privsep_osbrick.helper_command = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] privsep_osbrick.log_daemon_traceback = False {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] privsep_osbrick.thread_pool_size = 4 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] privsep_osbrick.user = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] cinder_sys_admin.group = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] cinder_sys_admin.helper_command = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] cinder_sys_admin.user = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] service_user.auth_section = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] service_user.auth_type = password {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] service_user.cafile = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] service_user.certfile = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] service_user.collect_timing = False {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] service_user.insecure = False {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] service_user.keyfile = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] service_user.send_service_user_token = True {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] service_user.split_loggers = False {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] service_user.timeout = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] service_user.tls_ciphers = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] service_user.tls_min_version = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] glance.auth_section = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] glance.auth_type = password {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] glance.certfile = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] glance.collect_timing = False {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] glance.insecure = False {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] glance.keyfile = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] glance.region_name = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] glance.split_loggers = False {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] glance.timeout = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] glance.tls_ciphers = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] glance.tls_min_version = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] backend_defaults.backend_availability_zone = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] backend_defaults.chap_password = **** {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] backend_defaults.chap_username = {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] backend_defaults.disk_geometry = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] backend_defaults.driver_client_cert = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] backend_defaults.driver_client_cert_key = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84894]: DEBUG oslo_concurrency.processutils [None req-ba3cc6d6-12f2-4a78-97db-0d34a55c0d45 None None] CMD "mount.quobyte" returned: 1 in 0.065s {{(pid=84894) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] backend_defaults.driver_data_namespace = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84894]: DEBUG oslo_concurrency.lockutils [None req-ba3cc6d6-12f2-4a78-97db-0d34a55c0d45 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84894) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] backend_defaults.driver_ssl_cert_path = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84894]: DEBUG oslo_concurrency.lockutils [None req-ba3cc6d6-12f2-4a78-97db-0d34a55c0d45 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84894) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84894]: DEBUG cinder.volume.drivers.quobyte [None req-ba3cc6d6-12f2-4a78-97db-0d34a55c0d45 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=84894) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] backend_defaults.driver_use_ssl = False {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] backend_defaults.enable_unsupported_driver = False {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84894]: INFO cinder.volume.drivers.quobyte [None req-ba3cc6d6-12f2-4a78-97db-0d34a55c0d45 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 ... Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] backend_defaults.extra_capabilities = {} {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] backend_defaults.filter_function = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84894]: DEBUG oslo_concurrency.processutils [None req-ba3cc6d6-12f2-4a78-97db-0d34a55c0d45 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 -c /etc/quobyte/client-cinder.cfg {{(pid=84894) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:50:13 devstack sudo[84896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 -c /etc/quobyte/client-cinder.cfg Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] backend_defaults.goodness_function = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] backend_defaults.image_volume_cache_enabled = False {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack sudo[84896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] backend_defaults.iscsi_target_flags = {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] backend_defaults.iscsi_write_cache = on {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] backend_defaults.iser_helper = tgtadm {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] backend_defaults.iser_ip_address = 192.168.122.41 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] backend_defaults.iser_port = 3260 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] backend_defaults.nas_host = {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] backend_defaults.nas_login = admin {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] backend_defaults.nas_mount_options = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] backend_defaults.nas_password = **** {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] backend_defaults.nas_private_key = {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] backend_defaults.nas_secure_file_operations = auto {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] backend_defaults.nas_share_path = {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] backend_defaults.nas_ssh_port = 22 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] backend_defaults.nas_volume_prov_type = thin {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] backend_defaults.num_shell_tries = 3 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] backend_defaults.nvmet_ns_id = 10 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] backend_defaults.nvmet_port_id = 1 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] backend_defaults.quobyte_client_cfg = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] backend_defaults.quobyte_volume_url = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] backend_defaults.replication_device = **** {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] backend_defaults.report_discard_supported = False {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] backend_defaults.reserved_percentage = 0 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] backend_defaults.scst_target_driver = iscsi {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] backend_defaults.scst_target_iqn_name = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] backend_defaults.storage_protocol = iSCSI {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] backend_defaults.target_helper = tgtadm {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] backend_defaults.target_ip_address = 192.168.122.41 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] backend_defaults.target_port = 3260 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] backend_defaults.target_protocol = iscsi {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] backend_defaults.trace_flags = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] backend_defaults.unique_fqdn_network = True {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] backend_defaults.use_chap_auth = False {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] backend_defaults.volume_backend_name = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] backend_defaults.volume_clear = zero {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] backend_defaults.volume_clear_ionice = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] backend_defaults.volume_clear_size = 0 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] oslo_reports.file_event_handler = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] oslo_reports.file_event_handler_interval = 1 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] oslo_reports.log_dir = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] QuobyteHD.backend_availability_zone = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] QuobyteHD.backend_host = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] QuobyteHD.chap_password = **** {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] QuobyteHD.chap_username = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] QuobyteHD.chiscsi_conf = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] QuobyteHD.disk_geometry = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] QuobyteHD.driver_client_cert = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] QuobyteHD.driver_client_cert_key = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] QuobyteHD.driver_data_namespace = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] QuobyteHD.driver_use_ssl = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] QuobyteHD.enable_unsupported_driver = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] QuobyteHD.extra_capabilities = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] QuobyteHD.filter_function = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] QuobyteHD.goodness_function = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] QuobyteHD.iscsi_target_flags = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] QuobyteHD.iscsi_write_cache = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] QuobyteHD.iser_helper = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] QuobyteHD.iser_ip_address = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] QuobyteHD.iser_port = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] QuobyteHD.iser_target_prefix = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] QuobyteHD.nas_host = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] QuobyteHD.nas_login = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] QuobyteHD.nas_mount_options = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] QuobyteHD.nas_password = **** {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] QuobyteHD.nas_private_key = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] QuobyteHD.nas_secure_file_operations = false {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] QuobyteHD.nas_share_path = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] QuobyteHD.nas_ssh_port = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] QuobyteHD.nas_volume_prov_type = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] QuobyteHD.num_iser_scan_tries = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] QuobyteHD.num_shell_tries = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] QuobyteHD.nvmet_ns_id = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] QuobyteHD.nvmet_port_id = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] QuobyteHD.replication_device = **** {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] QuobyteHD.report_discard_supported = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] QuobyteHD.reserved_percentage = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] QuobyteHD.scst_target_driver = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] QuobyteHD.scst_target_iqn_name = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] QuobyteHD.storage_protocol = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] QuobyteHD.target_helper = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] QuobyteHD.target_ip_address = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] QuobyteHD.target_port = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] QuobyteHD.target_prefix = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] QuobyteHD.target_protocol = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] QuobyteHD.trace_flags = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] QuobyteHD.unique_fqdn_network = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] QuobyteHD.use_chap_auth = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] QuobyteHD.volume_clear = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] QuobyteHD.volume_clear_ionice = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] QuobyteHD.volume_clear_size = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] QuobyteHD.volume_dd_blocksize = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] QuobyteHD.volumes_dir = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] oslo_messaging_rabbit.hostname = devstack {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] oslo_messaging_rabbit.ssl = False {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] oslo_messaging_rabbit.ssl_version = {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] oslo_messaging_notifications.driver = [] {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] oslo_messaging_notifications.retry = -1 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] oslo_messaging_notifications.transport_url = **** {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:13 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:14 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] key_manager.fixed_key = **** {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:14 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:14 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] barbican.barbican_api_version = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:14 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] barbican.barbican_endpoint = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:14 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] barbican.barbican_endpoint_type = public {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:14 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] barbican.barbican_region_name = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:14 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] barbican.cafile = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:14 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] barbican.certfile = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:14 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] barbican.collect_timing = False {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:14 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] barbican.insecure = False {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:14 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] barbican.keyfile = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:14 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] barbican.number_of_retries = 60 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:14 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] barbican.retry_delay = 1 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:14 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] barbican.send_service_user_token = False {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:14 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] barbican.split_loggers = False {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:14 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] barbican.timeout = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:14 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] barbican.tls_ciphers = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:14 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] barbican.tls_min_version = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:14 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] barbican.verify_ssl = True {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:14 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] barbican.verify_ssl_path = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:14 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] barbican_service_user.auth_section = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:14 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] barbican_service_user.auth_type = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:14 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] barbican_service_user.cafile = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:14 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] barbican_service_user.certfile = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:14 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] barbican_service_user.collect_timing = False {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:14 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] barbican_service_user.insecure = False {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:14 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] barbican_service_user.keyfile = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:14 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] barbican_service_user.split_loggers = False {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:14 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] barbican_service_user.timeout = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:14 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] barbican_service_user.tls_ciphers = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:14 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] barbican_service_user.tls_min_version = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:14 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] vault.approle_role_id = **** {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:14 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] vault.approle_secret_id = **** {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:14 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] vault.auth_method = approle {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:14 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] vault.auth_path = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:14 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] vault.kv_mountpoint = secret {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:14 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] vault.kv_path = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:14 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] vault.kv_version = 2 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:14 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] vault.namespace = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:14 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] vault.root_token_id = **** {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:14 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] vault.ssl_ca_crt_file = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:14 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] vault.timeout = 60.0 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:14 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] vault.token_file = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:14 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] vault.token_role = None {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:14 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] vault.use_ssl = False {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:14 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:14 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] ******************************************************************************** {{(pid=84676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 17 21:50:14 devstack sudo[84896]: pam_unix(sudo:session): session closed for user root Sep 17 21:50:14 devstack cinder-volume[84894]: DEBUG oslo_concurrency.processutils [None req-ba3cc6d6-12f2-4a78-97db-0d34a55c0d45 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.382s {{(pid=84894) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:50:14 devstack cinder-volume[84894]: INFO cinder.volume.drivers.quobyte [None req-ba3cc6d6-12f2-4a78-97db-0d34a55c0d45 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 succeeded Sep 17 21:50:14 devstack cinder-volume[84894]: DEBUG cinder.volume.drivers.quobyte [None req-ba3cc6d6-12f2-4a78-97db-0d34a55c0d45 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=84894) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 21:50:14 devstack cinder-volume[84894]: DEBUG oslo_concurrency.lockutils [None req-ba3cc6d6-12f2-4a78-97db-0d34a55c0d45 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.396s {{(pid=84894) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:50:14 devstack cinder-volume[84894]: DEBUG oslo_concurrency.processutils [None req-ba3cc6d6-12f2-4a78-97db-0d34a55c0d45 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=84894) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:50:14 devstack sudo[84995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 21:50:14 devstack sudo[84995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:50:14 devstack sudo[84995]: pam_unix(sudo:session): session closed for user root Sep 17 21:50:14 devstack cinder-volume[84894]: DEBUG oslo_concurrency.processutils [None req-ba3cc6d6-12f2-4a78-97db-0d34a55c0d45 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.240s {{(pid=84894) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:50:14 devstack cinder-volume[84894]: INFO cinder.volume.driver [None req-ba3cc6d6-12f2-4a78-97db-0d34a55c0d45 None None] Driver hasn't implemented _init_vendor_properties() Sep 17 21:50:14 devstack cinder-volume[84894]: DEBUG cinder.volume.driver [None req-ba3cc6d6-12f2-4a78-97db-0d34a55c0d45 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7508163452148, 'free_capacity_gb': 1775.7508163452148, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=84894) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 17 21:50:14 devstack cinder-volume[84894]: DEBUG oslo_db.sqlalchemy.engines [None req-ba3cc6d6-12f2-4a78-97db-0d34a55c0d45 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84894) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 17 21:50:14 devstack cinder-volume[84894]: DEBUG dbcounter [-] [84894] Writer thread running {{(pid=84894) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 17 21:50:14 devstack cinder-volume[84894]: DEBUG cinder.db.api [None req-ba3cc6d6-12f2-4a78-97db-0d34a55c0d45 None None] Building query based on filter {{(pid=84894) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 17 21:50:14 devstack cinder-volume[84894]: DEBUG cinder.image.image_utils [None req-ba3cc6d6-12f2-4a78-97db-0d34a55c0d45 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=84894) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 17 21:50:14 devstack cinder-volume[84894]: INFO cinder.keymgr.migration [None req-3d762365-455f-4b50-967b-c034d4de25d1 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 17 21:50:14 devstack cinder-volume[84894]: DEBUG oslo_concurrency.lockutils [None req-ba3cc6d6-12f2-4a78-97db-0d34a55c0d45 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84894) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:50:14 devstack cinder-volume[84894]: DEBUG oslo_concurrency.lockutils [None req-ba3cc6d6-12f2-4a78-97db-0d34a55c0d45 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84894) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:50:14 devstack cinder-volume[84894]: DEBUG cinder.volume.drivers.quobyte [None req-ba3cc6d6-12f2-4a78-97db-0d34a55c0d45 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=84894) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 21:50:14 devstack cinder-volume[84894]: DEBUG cinder.volume.drivers.quobyte [None req-ba3cc6d6-12f2-4a78-97db-0d34a55c0d45 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=84894) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 21:50:14 devstack cinder-volume[84894]: DEBUG oslo_concurrency.lockutils [None req-ba3cc6d6-12f2-4a78-97db-0d34a55c0d45 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84894) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:50:14 devstack cinder-volume[84894]: DEBUG oslo_concurrency.processutils [None req-ba3cc6d6-12f2-4a78-97db-0d34a55c0d45 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=84894) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:50:14 devstack sudo[84999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 21:50:14 devstack sudo[84999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:50:14 devstack sudo[84999]: pam_unix(sudo:session): session closed for user root Sep 17 21:50:14 devstack cinder-volume[84894]: DEBUG oslo_concurrency.processutils [None req-ba3cc6d6-12f2-4a78-97db-0d34a55c0d45 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.231s {{(pid=84894) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:50:14 devstack cinder-volume[84894]: DEBUG cinder.manager [None req-ba3cc6d6-12f2-4a78-97db-0d34a55c0d45 None None] Notifying Schedulers of capabilities ... {{(pid=84894) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 21:50:14 devstack cinder-volume[84894]: INFO cinder.volume.manager [None req-ba3cc6d6-12f2-4a78-97db-0d34a55c0d45 None None] Driver initialization completed successfully. Sep 17 21:50:14 devstack cinder-volume[84894]: INFO cinder.manager [None req-ba3cc6d6-12f2-4a78-97db-0d34a55c0d45 None None] Initiating service 3 cleanup Sep 17 21:50:14 devstack cinder-volume[84894]: INFO cinder.manager [None req-ba3cc6d6-12f2-4a78-97db-0d34a55c0d45 None None] Service 3 cleanup completed. Sep 17 21:50:14 devstack cinder-volume[84894]: DEBUG cinder.service [None req-ba3cc6d6-12f2-4a78-97db-0d34a55c0d45 None None] Creating RPC server for service cinder-volume {{(pid=84894) start /opt/stack/cinder/cinder/service.py:231}} Sep 17 21:50:14 devstack cinder-volume[84894]: DEBUG cinder.service [None req-ba3cc6d6-12f2-4a78-97db-0d34a55c0d45 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=84894) start /opt/stack/cinder/cinder/service.py:237}} Sep 17 21:50:15 devstack cinder-volume[84894]: INFO cinder.volume.manager [None req-ba3cc6d6-12f2-4a78-97db-0d34a55c0d45 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 17 21:50:15 devstack cinder-volume[84894]: DEBUG oslo_concurrency.lockutils [None req-ba3cc6d6-12f2-4a78-97db-0d34a55c0d45 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84894) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:50:15 devstack cinder-volume[84894]: DEBUG oslo_concurrency.lockutils [None req-ba3cc6d6-12f2-4a78-97db-0d34a55c0d45 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84894) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:50:15 devstack cinder-volume[84894]: DEBUG cinder.volume.drivers.quobyte [None req-ba3cc6d6-12f2-4a78-97db-0d34a55c0d45 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=84894) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 21:50:15 devstack cinder-volume[84894]: DEBUG cinder.volume.drivers.quobyte [None req-ba3cc6d6-12f2-4a78-97db-0d34a55c0d45 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=84894) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 21:50:15 devstack cinder-volume[84894]: DEBUG oslo_concurrency.lockutils [None req-ba3cc6d6-12f2-4a78-97db-0d34a55c0d45 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84894) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:50:15 devstack cinder-volume[84894]: DEBUG oslo_concurrency.processutils [None req-ba3cc6d6-12f2-4a78-97db-0d34a55c0d45 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=84894) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:50:15 devstack sudo[85002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 21:50:15 devstack sudo[85002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:50:15 devstack sudo[85002]: pam_unix(sudo:session): session closed for user root Sep 17 21:50:15 devstack cinder-volume[84894]: DEBUG oslo_concurrency.processutils [None req-ba3cc6d6-12f2-4a78-97db-0d34a55c0d45 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.230s {{(pid=84894) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:50:15 devstack cinder-volume[84894]: INFO cinder.volume.manager [None req-ba3cc6d6-12f2-4a78-97db-0d34a55c0d45 None None] Driver post RPC initialization completed successfully. Sep 17 21:50:19 devstack cinder-volume[84676]: INFO oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] Caught SIGTERM, stopping children Sep 17 21:50:19 devstack cinder-volume[84676]: DEBUG oslo_concurrency.lockutils [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] Acquiring lock "singleton_lock" {{(pid=84676) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 17 21:50:19 devstack cinder-volume[84676]: DEBUG oslo_concurrency.lockutils [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] Acquired lock "singleton_lock" {{(pid=84676) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 17 21:50:19 devstack cinder-volume[84676]: DEBUG oslo_concurrency.lockutils [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] Releasing lock "singleton_lock" {{(pid=84676) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 17 21:50:19 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] Stop services. {{(pid=84676) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 17 21:50:19 devstack cinder-volume[84676]: DEBUG oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] Killing children. {{(pid=84676) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 17 21:50:19 devstack cinder-volume[84676]: INFO oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] Waiting on 1 children to exit Sep 17 21:50:19 devstack cinder-volume[84894]: DEBUG oslo_concurrency.lockutils [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] Acquiring lock "singleton_lock" {{(pid=84894) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 17 21:50:19 devstack cinder-volume[84894]: DEBUG oslo_concurrency.lockutils [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] Acquired lock "singleton_lock" {{(pid=84894) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 17 21:50:19 devstack cinder-volume[84894]: DEBUG oslo_concurrency.lockutils [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] Releasing lock "singleton_lock" {{(pid=84894) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 17 21:50:19 devstack cinder-volume[84894]: WARNING amqp [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 17 21:50:19 devstack cinder-volume[84894]: WARNING amqp [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 17 21:50:19 devstack cinder-volume[84676]: INFO oslo_service.backend._eventlet.service [None req-855fdc68-c42b-4d73-abee-4ce8862b8d9a None None] Child 84894 exited with status 0 Sep 17 21:50:19 devstack cinder-volume[85192]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 17 21:50:19 devstack cinder-volume[85192]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 17 21:50:19 devstack cinder-volume[85192]: we strongly recommend against using it for new projects. Sep 17 21:50:19 devstack cinder-volume[85192]: If you are already using Eventlet, we recommend migrating to a different Sep 17 21:50:19 devstack cinder-volume[85192]: framework. For more detail see Sep 17 21:50:19 devstack cinder-volume[85192]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 17 21:50:19 devstack cinder-volume[85192]: import eventlet # noqa Sep 17 21:50:22 devstack cinder-volume[85192]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85192) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 17 21:50:22 devstack cinder-volume[85192]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85192) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 17 21:50:22 devstack cinder-volume[85192]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85192) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 17 21:50:23 devstack cinder-volume[85192]: INFO dbcounter [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] Registered counter for database cinder Sep 17 21:50:23 devstack cinder-volume[85192]: DEBUG oslo_db.sqlalchemy.engines [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85192) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG dbcounter [-] [85192] Writer thread running {{(pid=85192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 17 21:50:24 devstack cinder-volume[85192]: INFO cinder.rpc [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 17 21:50:24 devstack cinder-volume[85192]: INFO cinder.rpc [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_db.sqlalchemy.engines [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85192) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 17 21:50:24 devstack cinder-volume[85192]: INFO cinder.volume.manager [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] Determined volume DB was empty at startup. Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG cinder.volume.manager [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85192) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 17 21:50:24 devstack cinder-volume[85192]: WARNING stevedore.named [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 17 21:50:24 devstack cinder-volume[85192]: WARNING castellan.key_manager [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 17 21:50:24 devstack cinder-volume[85192]: WARNING cinder.keymgr.conf_key_mgr [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 17 21:50:24 devstack cinder-volume[85192]: INFO cinder.volume.manager [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_db.sqlalchemy.engines [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85192) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 17 21:50:24 devstack cinder-volume[85192]: INFO oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] Starting 1 workers Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] Started child 85458 {{(pid=85192) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] Full set of CONF: {{(pid=85192) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] ******************************************************************************** {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] Configuration options gathered from: {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] ================================================================================ {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] allow_availability_zone_fallback = False {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] allow_compression_on_image_upload = False {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] allowed_direct_url_schemes = [] {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] api_rate_limit = True {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] auth_strategy = keystone {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] backend_availability_zone = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] backend_host = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] backend_name = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] backend_stats_polling_interval = 60 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] backup_api_class = cinder.backup.api.API {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] backup_name_template = backup-%s {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] backup_use_same_host = False {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] backup_use_temp_snapshot = False {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] chap_password = **** {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] chap_username = {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] cinder_internal_tenant_project_id = 3b24c828c1ac4ba7bd3633490d2b7af4 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] cinder_internal_tenant_user_id = 4a23a6533c444d74b2a03d8f9d26cc50 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] cluster = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] compression_format = gzip {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85458]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] compute_api_class = cinder.compute.nova.API {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] config_dir = [] {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] config_source = [] {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] control_exchange = openstack {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] debug = True {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] default_availability_zone = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] default_group_type = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] default_volume_type = QuobyteHD {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] disk_geometry = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] driver_client_cert = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] driver_client_cert_key = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] driver_data_namespace = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] driver_ssl_cert_path = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] driver_ssl_cert_verify = False {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] driver_use_ssl = False {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] enable_new_services = True {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] enable_unsupported_driver = False {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] enabled_backends = ['QuobyteHD'] {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] enforce_multipath_for_image_xfer = False {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] filter_function = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] glance_api_insecure = False {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] glance_api_servers = ['http://192.168.122.41/image'] {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] glance_api_ssl_compression = False {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] glance_ca_certificates_file = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] glance_catalog_info = image:glance:publicURL {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] glance_certfile = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] glance_keyfile = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] glance_num_retries = 3 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] glance_request_timeout = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] goodness_function = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] graceful_shutdown_timeout = 5 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] group_api_class = cinder.group.api.API {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] host = devstack {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] image_compress_on_upload = True {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] image_conversion_address_space_limit = 1 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] image_conversion_cpu_limit = 60 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] image_conversion_disable = False {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] image_introspection_address_space_limit = 1 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] image_introspection_cpu_limit = 60 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] image_upload_use_cinder_backend = False {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] image_upload_use_internal_tenant = False {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] image_volume_cache_enabled = False {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] image_volume_cache_max_count = 0 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] image_volume_cache_max_size_gb = 0 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] init_host_max_objects_retrieval = 0 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] instance_format = [instance: %(uuid)s] {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] iscsi_target_flags = {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] iscsi_write_cache = on {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] iser_helper = tgtadm {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] iser_ip_address = 192.168.122.41 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] iser_port = 3260 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] log_color = False {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] log_config_append = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] log_dir = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] log_file = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] log_options = True {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] log_rotate_interval = 1 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] log_rotate_interval_type = days {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] log_rotation_type = none {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] max_age = 0 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] max_logfile_count = 30 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] max_logfile_size_mb = 200 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] max_over_subscription_ratio = 20.0 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] message_reap_interval = 86400 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] message_ttl = 2592000 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] migration_create_volume_timeout_secs = 300 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] monkey_patch = False {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] monkey_patch_modules = [] {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] my_ip = 192.168.122.41 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] no_snapshot_gb_quota = False {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-566772ea-ca37-4111-8f65-cfd01fa61192 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 17 21:50:24 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-566772ea-ca37-4111-8f65-cfd01fa61192 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=85458) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] num_iser_scan_tries = 3 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] num_shell_tries = 3 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] num_volume_device_scan_tries = 3 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] nvmeof_conn_info_version = 1 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] nvmet_ns_id = 10 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] nvmet_port_id = 1 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] osapi_max_limit = 1000 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] osapi_volume_ext_list = [] {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] osapi_volume_listen = 0.0.0.0 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] osapi_volume_listen_port = 8776 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] osapi_volume_use_ssl = False {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] osapi_volume_workers = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] per_volume_size_limit = -1 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] periodic_fuzzy_delay = 60 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] periodic_interval = 60 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] project_id_regex = [0-9a-f\-]+ {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] public_endpoint = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] publish_errors = False {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] quota_backup_gigabytes = 1000 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] quota_backups = 10 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] quota_gigabytes = 1000 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] quota_groups = 10 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] quota_snapshots = 10 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] quota_volumes = 10 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] rate_limit_burst = 0 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] rate_limit_except_level = CRITICAL {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] rate_limit_interval = 0 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] reinit_driver_count = 3 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] replication_device = **** {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] report_discard_supported = False {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] report_interval = 120 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] reservation_clean_interval = 86400 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] reservation_expire = 86400 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] reserved_image_namespaces = [] {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] reserved_percentage = 0 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] rpc_response_timeout = 120 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] run_external_periodic_tasks = True {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] scst_target_driver = iscsi {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] scst_target_iqn_name = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] service_down_time = 720 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] shell_completion = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] snapshot_name_template = snapshot-%s {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] split_loggers = False {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] state_path = /opt/stack/data/cinder {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] storage_availability_zone = nova {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] storage_protocol = iSCSI {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] syslog_log_facility = LOG_USER {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:24 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] target_helper = lioadm {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] target_ip_address = 192.168.122.41 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] target_port = 3260 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] target_protocol = iscsi {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] target_secondary_ip_addresses = [] {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] trace_flags = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] transfer_api_class = cinder.transfer.api.API {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] transport_url = **** {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] until_refresh = 0 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] use_chap_auth = False {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] use_default_quota_class = True {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] use_journal = False {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] use_json = False {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] use_multipath_for_image_xfer = False {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] use_stderr = False {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] use_syslog = False {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] verify_glance_signatures = enabled {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] volume_api_class = cinder.volume.api.API {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] volume_backend_name = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] volume_clear = zero {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] volume_clear_ionice = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] volume_clear_size = 0 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] volume_copy_bps_limit = 0 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] volume_dd_blocksize = 1M {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] volume_name_template = volume-%s {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] volume_service_inithost_offload = False {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] volume_usage_audit_period = month {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] zoning_mode = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] oslo_concurrency.disable_process_locking = False {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] keystone_authtoken.auth_section = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] keystone_authtoken.auth_type = password {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] keystone_authtoken.auth_version = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] keystone_authtoken.cache = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] keystone_authtoken.certfile = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] keystone_authtoken.delay_auth_decision = False {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] keystone_authtoken.http_connect_timeout = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] keystone_authtoken.include_service_catalog = True {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] keystone_authtoken.insecure = False {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] keystone_authtoken.interface = public {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] keystone_authtoken.keyfile = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] keystone_authtoken.memcache_password = **** {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] keystone_authtoken.memcache_username = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] keystone_authtoken.region_name = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] keystone_authtoken.service_token_roles_required = True {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] keystone_authtoken.service_type = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] keystone_authtoken.token_cache_time = 300 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.41/identity {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] cache.backend = dogpile.cache.null {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] cache.backend_argument = **** {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] cache.backend_expiration_time = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] cache.config_prefix = cache.oslo {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] cache.debug_cache_backend = False {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] cache.enable_retry_client = False {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] cache.enable_socket_keepalive = False {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] cache.enabled = False {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] cache.expiration_time = 600 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] cache.hashclient_dead_timeout = 60.0 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] cache.hashclient_retry_attempts = 2 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] cache.memcache_dead_retry = 300 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] cache.memcache_pool_maxsize = 10 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] cache.memcache_sasl_enabled = False {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] cache.memcache_servers = ['localhost:11211'] {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] cache.password = **** {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] cache.proxies = [] {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] cache.redis_db = 0 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] cache.redis_sentinel_service_name = mymaster {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] cache.redis_server = localhost:6379 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] cache.retry_attempts = 2 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] cache.retry_delay = 0.0 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] cache.socket_keepalive_count = 1 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] cache.socket_keepalive_idle = 1 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] cache.socket_keepalive_interval = 1 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] cache.socket_timeout = 1.0 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] cache.tls_allowed_ciphers = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] cache.tls_cafile = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] cache.tls_certfile = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] cache.tls_enabled = False {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] cache.tls_keyfile = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] cache.username = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-566772ea-ca37-4111-8f65-cfd01fa61192 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=85458) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] coordination.backend_url = **** {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] database.asyncio_connection = **** {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] database.asyncio_slave_connection = **** {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] database.backend = sqlalchemy {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85458]: WARNING cinder.volume.drivers.quobyte [None req-566772ea-ca37-4111-8f65-cfd01fa61192 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] database.connection = **** {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85458]: WARNING cinder.volume.drivers.quobyte [None req-566772ea-ca37-4111-8f65-cfd01fa61192 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] database.connection_debug = 0 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] database.connection_parameters = {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] database.connection_recycle_time = 3600 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] database.connection_trace = False {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] database.db_inc_retry_interval = True {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] database.db_max_retries = 20 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] database.db_max_retry_interval = 10 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] database.db_retry_interval = 1 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-566772ea-ca37-4111-8f65-cfd01fa61192 None None] Running cmd (subprocess): mount.quobyte {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] database.max_overflow = 50 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] database.max_pool_size = 5 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] database.max_retries = 10 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] database.mysql_sql_mode = TRADITIONAL {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] database.mysql_wsrep_sync_wait = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] database.pool_timeout = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] database.retry_interval = 10 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] database.slave_connection = **** {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] database.sqlite_synchronous = True {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] database.synchronous_reader = True {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] database.use_db_reconnect = False {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] oslo_messaging_metrics.metrics_process_name = {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] oslo_messaging_tracing.insecure = False {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] profiler.connection_string = messaging:// {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] profiler.enabled = False {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] profiler.es_doc_type = notification {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] profiler.es_scroll_size = 10000 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] profiler.es_scroll_time = 2m {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] profiler.filter_error_trace = False {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] profiler.hmac_keys = **** {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] profiler.sentinel_service_name = mymaster {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] profiler.socket_timeout = 0.1 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] profiler.trace_requests = False {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] profiler.trace_sqlalchemy = False {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] profiler_jaeger.process_tags = {} {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] profiler_jaeger.service_name_prefix = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] profiler_otlp.service_name_prefix = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] oslo_policy.enforce_new_defaults = True {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] oslo_policy.policy_default_rule = default {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] oslo_policy.policy_file = policy.yaml {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] oslo_policy.remote_timeout = 60.0 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] privsep_osbrick.capabilities = [21, 2] {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] privsep_osbrick.group = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] privsep_osbrick.helper_command = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] privsep_osbrick.user = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] cinder_sys_admin.group = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] cinder_sys_admin.helper_command = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] cinder_sys_admin.user = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] service_user.auth_section = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] service_user.auth_type = password {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] service_user.cafile = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] service_user.certfile = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] service_user.collect_timing = False {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] service_user.insecure = False {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] service_user.keyfile = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] service_user.send_service_user_token = True {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] service_user.split_loggers = False {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] service_user.timeout = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] service_user.tls_ciphers = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] service_user.tls_min_version = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] glance.auth_section = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] glance.auth_type = password {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] glance.certfile = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] glance.collect_timing = False {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] glance.insecure = False {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] glance.keyfile = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] glance.region_name = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] glance.split_loggers = False {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] glance.timeout = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] glance.tls_ciphers = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] glance.tls_min_version = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] backend_defaults.backend_availability_zone = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] backend_defaults.chap_password = **** {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] backend_defaults.chap_username = {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] backend_defaults.disk_geometry = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] backend_defaults.driver_client_cert = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] backend_defaults.driver_client_cert_key = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] backend_defaults.driver_data_namespace = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] backend_defaults.driver_use_ssl = False {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] backend_defaults.enable_unsupported_driver = False {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] backend_defaults.extra_capabilities = {} {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] backend_defaults.filter_function = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] backend_defaults.goodness_function = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] backend_defaults.iscsi_target_flags = {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] backend_defaults.iscsi_write_cache = on {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] backend_defaults.iser_helper = tgtadm {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] backend_defaults.iser_ip_address = 192.168.122.41 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] backend_defaults.iser_port = 3260 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] backend_defaults.nas_host = {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] backend_defaults.nas_login = admin {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] backend_defaults.nas_mount_options = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] backend_defaults.nas_password = **** {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] backend_defaults.nas_private_key = {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] backend_defaults.nas_share_path = {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] backend_defaults.nas_ssh_port = 22 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] backend_defaults.num_shell_tries = 3 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] backend_defaults.nvmet_ns_id = 10 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] backend_defaults.nvmet_port_id = 1 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] backend_defaults.quobyte_client_cfg = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] backend_defaults.quobyte_volume_url = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] backend_defaults.replication_device = **** {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] backend_defaults.report_discard_supported = False {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] backend_defaults.reserved_percentage = 0 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] backend_defaults.scst_target_driver = iscsi {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] backend_defaults.scst_target_iqn_name = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] backend_defaults.storage_protocol = iSCSI {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] backend_defaults.target_helper = tgtadm {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] backend_defaults.target_ip_address = 192.168.122.41 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] backend_defaults.target_port = 3260 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] backend_defaults.target_protocol = iscsi {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] backend_defaults.trace_flags = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] backend_defaults.unique_fqdn_network = True {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] backend_defaults.use_chap_auth = False {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] backend_defaults.volume_backend_name = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] backend_defaults.volume_clear = zero {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] backend_defaults.volume_clear_ionice = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] backend_defaults.volume_clear_size = 0 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] oslo_reports.file_event_handler = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] oslo_reports.log_dir = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] QuobyteHD.backend_availability_zone = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] QuobyteHD.backend_host = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] QuobyteHD.chap_password = **** {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] QuobyteHD.chap_username = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] QuobyteHD.chiscsi_conf = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] QuobyteHD.disk_geometry = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] QuobyteHD.driver_client_cert = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] QuobyteHD.driver_client_cert_key = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] QuobyteHD.driver_data_namespace = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] QuobyteHD.driver_use_ssl = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] QuobyteHD.enable_unsupported_driver = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] QuobyteHD.extra_capabilities = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] QuobyteHD.filter_function = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] QuobyteHD.goodness_function = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] QuobyteHD.iscsi_target_flags = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] QuobyteHD.iscsi_write_cache = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] QuobyteHD.iser_helper = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] QuobyteHD.iser_ip_address = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] QuobyteHD.iser_port = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] QuobyteHD.iser_target_prefix = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] QuobyteHD.nas_host = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] QuobyteHD.nas_login = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] QuobyteHD.nas_mount_options = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] QuobyteHD.nas_password = **** {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] QuobyteHD.nas_private_key = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-566772ea-ca37-4111-8f65-cfd01fa61192 None None] CMD "mount.quobyte" returned: 1 in 0.131s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] QuobyteHD.nas_share_path = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] QuobyteHD.nas_ssh_port = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] QuobyteHD.num_iser_scan_tries = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] QuobyteHD.num_shell_tries = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-566772ea-ca37-4111-8f65-cfd01fa61192 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-566772ea-ca37-4111-8f65-cfd01fa61192 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] QuobyteHD.nvmet_ns_id = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-566772ea-ca37-4111-8f65-cfd01fa61192 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] QuobyteHD.nvmet_port_id = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] QuobyteHD.replication_device = **** {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] QuobyteHD.report_discard_supported = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] QuobyteHD.reserved_percentage = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] QuobyteHD.scst_target_driver = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] QuobyteHD.storage_protocol = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] QuobyteHD.target_helper = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] QuobyteHD.target_ip_address = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] QuobyteHD.target_port = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] QuobyteHD.target_prefix = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] QuobyteHD.target_protocol = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] QuobyteHD.trace_flags = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] QuobyteHD.unique_fqdn_network = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] QuobyteHD.use_chap_auth = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] QuobyteHD.volume_clear = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] QuobyteHD.volume_clear_ionice = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] QuobyteHD.volume_clear_size = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-566772ea-ca37-4111-8f65-cfd01fa61192 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 21:50:25 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-566772ea-ca37-4111-8f65-cfd01fa61192 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:50:25 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-566772ea-ca37-4111-8f65-cfd01fa61192 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] QuobyteHD.volume_dd_blocksize = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] QuobyteHD.volumes_dir = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] oslo_messaging_rabbit.ssl = False {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack sudo[85469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] oslo_messaging_rabbit.ssl_version = {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack sudo[85469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] oslo_messaging_notifications.driver = [] {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] oslo_messaging_notifications.retry = -1 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] oslo_messaging_notifications.transport_url = **** {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] key_manager.fixed_key = **** {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] barbican.barbican_api_version = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] barbican.barbican_endpoint = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] barbican.barbican_endpoint_type = public {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] barbican.barbican_region_name = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] barbican.cafile = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] barbican.certfile = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] barbican.collect_timing = False {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] barbican.insecure = False {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] barbican.keyfile = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] barbican.number_of_retries = 60 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] barbican.retry_delay = 1 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] barbican.send_service_user_token = False {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] barbican.split_loggers = False {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] barbican.timeout = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] barbican.tls_ciphers = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] barbican.tls_min_version = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] barbican.verify_ssl = True {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] barbican.verify_ssl_path = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] barbican_service_user.auth_section = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] barbican_service_user.auth_type = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] barbican_service_user.cafile = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] barbican_service_user.certfile = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] barbican_service_user.collect_timing = False {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] barbican_service_user.insecure = False {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] barbican_service_user.keyfile = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] barbican_service_user.split_loggers = False {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] barbican_service_user.timeout = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] barbican_service_user.tls_ciphers = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] barbican_service_user.tls_min_version = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] vault.approle_role_id = **** {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] vault.approle_secret_id = **** {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] vault.auth_method = approle {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] vault.auth_path = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] vault.kv_mountpoint = secret {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] vault.kv_path = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] vault.kv_version = 2 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] vault.namespace = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] vault.root_token_id = **** {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] vault.ssl_ca_crt_file = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] vault.timeout = 60.0 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] vault.token_file = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] vault.token_role = None {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] vault.use_ssl = False {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 21:50:25 devstack cinder-volume[85192]: DEBUG oslo_service.backend._eventlet.service [None req-3cc55501-94c5-4ce6-8842-263c4c5bc5bc None None] ******************************************************************************** {{(pid=85192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 17 21:50:25 devstack sudo[85469]: pam_unix(sudo:session): session closed for user root Sep 17 21:50:25 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-566772ea-ca37-4111-8f65-cfd01fa61192 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.360s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:50:25 devstack cinder-volume[85458]: INFO cinder.volume.driver [None req-566772ea-ca37-4111-8f65-cfd01fa61192 None None] Driver hasn't implemented _init_vendor_properties() Sep 17 21:50:25 devstack cinder-volume[85458]: DEBUG cinder.volume.driver [None req-566772ea-ca37-4111-8f65-cfd01fa61192 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.759220123291, 'free_capacity_gb': 1775.759220123291, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=85458) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 17 21:50:25 devstack cinder-volume[85458]: DEBUG oslo_db.sqlalchemy.engines [None req-566772ea-ca37-4111-8f65-cfd01fa61192 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85458) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 17 21:50:25 devstack cinder-volume[85458]: DEBUG dbcounter [-] [85458] Writer thread running {{(pid=85458) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 17 21:50:25 devstack cinder-volume[85458]: DEBUG cinder.db.api [None req-566772ea-ca37-4111-8f65-cfd01fa61192 None None] Building query based on filter {{(pid=85458) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 17 21:50:25 devstack cinder-volume[85458]: DEBUG cinder.image.image_utils [None req-566772ea-ca37-4111-8f65-cfd01fa61192 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=85458) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 17 21:50:25 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-566772ea-ca37-4111-8f65-cfd01fa61192 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:50:25 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-566772ea-ca37-4111-8f65-cfd01fa61192 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:50:25 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-566772ea-ca37-4111-8f65-cfd01fa61192 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 21:50:25 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-566772ea-ca37-4111-8f65-cfd01fa61192 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 21:50:25 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-566772ea-ca37-4111-8f65-cfd01fa61192 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:50:25 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-566772ea-ca37-4111-8f65-cfd01fa61192 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:50:25 devstack cinder-volume[85458]: INFO cinder.keymgr.migration [None req-4fd2bd3f-a37a-4852-81c9-89550269faa8 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 17 21:50:25 devstack sudo[85480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 21:50:25 devstack sudo[85480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:50:26 devstack sudo[85480]: pam_unix(sudo:session): session closed for user root Sep 17 21:50:26 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-566772ea-ca37-4111-8f65-cfd01fa61192 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.317s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:50:26 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-566772ea-ca37-4111-8f65-cfd01fa61192 None None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 21:50:26 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-566772ea-ca37-4111-8f65-cfd01fa61192 None None] Driver initialization completed successfully. Sep 17 21:50:26 devstack cinder-volume[85458]: INFO cinder.manager [None req-566772ea-ca37-4111-8f65-cfd01fa61192 None None] Initiating service 3 cleanup Sep 17 21:50:26 devstack cinder-volume[85458]: INFO cinder.manager [None req-566772ea-ca37-4111-8f65-cfd01fa61192 None None] Service 3 cleanup completed. Sep 17 21:50:26 devstack cinder-volume[85458]: DEBUG cinder.service [None req-566772ea-ca37-4111-8f65-cfd01fa61192 None None] Creating RPC server for service cinder-volume {{(pid=85458) start /opt/stack/cinder/cinder/service.py:231}} Sep 17 21:50:26 devstack cinder-volume[85458]: DEBUG cinder.service [None req-566772ea-ca37-4111-8f65-cfd01fa61192 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=85458) start /opt/stack/cinder/cinder/service.py:237}} Sep 17 21:50:26 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-566772ea-ca37-4111-8f65-cfd01fa61192 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 17 21:50:26 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-566772ea-ca37-4111-8f65-cfd01fa61192 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:50:26 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-566772ea-ca37-4111-8f65-cfd01fa61192 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:50:26 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-566772ea-ca37-4111-8f65-cfd01fa61192 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 21:50:26 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-566772ea-ca37-4111-8f65-cfd01fa61192 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 21:50:26 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-566772ea-ca37-4111-8f65-cfd01fa61192 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:50:26 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-566772ea-ca37-4111-8f65-cfd01fa61192 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:50:26 devstack sudo[85485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 21:50:26 devstack sudo[85485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:50:26 devstack sudo[85485]: pam_unix(sudo:session): session closed for user root Sep 17 21:50:26 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-566772ea-ca37-4111-8f65-cfd01fa61192 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.421s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:50:26 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-566772ea-ca37-4111-8f65-cfd01fa61192 None None] Driver post RPC initialization completed successfully. Sep 17 21:50:27 devstack cinder-volume[85458]: DEBUG oslo_service.periodic_task [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Running periodic task VolumeManager._thread_info {{(pid=85458) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 21:50:27 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] thread count: 6 {{(pid=85458) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 21:50:27 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] thread info: [<_MainThread(MainThread, started 127546830999680)>, , , , , ] {{(pid=85458) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 21:50:34 devstack cinder-volume[85192]: DEBUG dbcounter [-] [85192] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=85192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 21:50:35 devstack cinder-volume[85458]: DEBUG dbcounter [-] [85458] Writing DB stats cinder:SELECT=1 {{(pid=85458) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 21:50:36 devstack cinder-volume[85458]: DEBUG dbcounter [-] [85458] Writing DB stats cinder:SELECT=9,cinder:UPDATE=1 {{(pid=85458) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 21:51:25 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-225e2083-d5f2-44aa-9e4b-a588bd2cab25 tempest-TaggedAttachmentsTest-1958506614 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 21:51:25 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-225e2083-d5f2-44aa-9e4b-a588bd2cab25 tempest-TaggedAttachmentsTest-1958506614 None] Flow 'volume_create_manager' (e57db57c-2511-4e6e-8d18-10a28df28800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 21:51:25 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-225e2083-d5f2-44aa-9e4b-a588bd2cab25 tempest-TaggedAttachmentsTest-1958506614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be2ab820-a2f6-49c1-8d1e-7d04bfa47954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:51:25 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-225e2083-d5f2-44aa-9e4b-a588bd2cab25 tempest-TaggedAttachmentsTest-1958506614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be2ab820-a2f6-49c1-8d1e-7d04bfa47954) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T19:51:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1195268095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8467725a-892b-4d3f-9d5d-f0f2f1b6f52e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d00b5d3c4ca2479c92a9f48491a1d8a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T19:51:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T19:51:26Z,use_quota=True,user_id='8ca87d80c7a04ffdad5a3789af9e3020',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:51:25 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-225e2083-d5f2-44aa-9e4b-a588bd2cab25 tempest-TaggedAttachmentsTest-1958506614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e390d740-c644-4994-bcc6-44c69d8399bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:51:25 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-225e2083-d5f2-44aa-9e4b-a588bd2cab25 tempest-TaggedAttachmentsTest-1958506614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e390d740-c644-4994-bcc6-44c69d8399bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:51:25 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-225e2083-d5f2-44aa-9e4b-a588bd2cab25 tempest-TaggedAttachmentsTest-1958506614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07d0869e-a6f2-4184-ab72-926f90729acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:51:25 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-225e2083-d5f2-44aa-9e4b-a588bd2cab25 tempest-TaggedAttachmentsTest-1958506614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07d0869e-a6f2-4184-ab72-926f90729acf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8467725a-892b-4d3f-9d5d-f0f2f1b6f52e', 'volume_name': 'volume-8467725a-892b-4d3f-9d5d-f0f2f1b6f52e', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:51:25 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-225e2083-d5f2-44aa-9e4b-a588bd2cab25 tempest-TaggedAttachmentsTest-1958506614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2f6a952-db09-48e5-9339-1584267330c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:51:25 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-225e2083-d5f2-44aa-9e4b-a588bd2cab25 tempest-TaggedAttachmentsTest-1958506614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2f6a952-db09-48e5-9339-1584267330c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:51:25 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-225e2083-d5f2-44aa-9e4b-a588bd2cab25 tempest-TaggedAttachmentsTest-1958506614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9054376d-65a4-4684-97bc-6cd58ecdcbac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:51:25 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-225e2083-d5f2-44aa-9e4b-a588bd2cab25 tempest-TaggedAttachmentsTest-1958506614 None] Volume 8467725a-892b-4d3f-9d5d-f0f2f1b6f52e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8467725a-892b-4d3f-9d5d-f0f2f1b6f52e', 'volume_size': 1} Sep 17 21:51:25 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-225e2083-d5f2-44aa-9e4b-a588bd2cab25 tempest-TaggedAttachmentsTest-1958506614 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:51:25 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-225e2083-d5f2-44aa-9e4b-a588bd2cab25 tempest-TaggedAttachmentsTest-1958506614 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:51:25 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-225e2083-d5f2-44aa-9e4b-a588bd2cab25 tempest-TaggedAttachmentsTest-1958506614 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T19:51:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1195268095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8467725a-892b-4d3f-9d5d-f0f2f1b6f52e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d00b5d3c4ca2479c92a9f48491a1d8a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T19:51:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T19:51:26Z,use_quota=True,user_id='8ca87d80c7a04ffdad5a3789af9e3020',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 21:51:25 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-225e2083-d5f2-44aa-9e4b-a588bd2cab25 tempest-TaggedAttachmentsTest-1958506614 None] Creating volume 8467725a-892b-4d3f-9d5d-f0f2f1b6f52e {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 21:51:25 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-225e2083-d5f2-44aa-9e4b-a588bd2cab25 tempest-TaggedAttachmentsTest-1958506614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:51:25 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-225e2083-d5f2-44aa-9e4b-a588bd2cab25 tempest-TaggedAttachmentsTest-1958506614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:51:25 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-225e2083-d5f2-44aa-9e4b-a588bd2cab25 tempest-TaggedAttachmentsTest-1958506614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 21:51:25 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-225e2083-d5f2-44aa-9e4b-a588bd2cab25 tempest-TaggedAttachmentsTest-1958506614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 21:51:25 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-225e2083-d5f2-44aa-9e4b-a588bd2cab25 tempest-TaggedAttachmentsTest-1958506614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:51:25 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-225e2083-d5f2-44aa-9e4b-a588bd2cab25 tempest-TaggedAttachmentsTest-1958506614 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 21:51:25 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-225e2083-d5f2-44aa-9e4b-a588bd2cab25 tempest-TaggedAttachmentsTest-1958506614 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 21:51:25 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-225e2083-d5f2-44aa-9e4b-a588bd2cab25 tempest-TaggedAttachmentsTest-1958506614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8467725a-892b-4d3f-9d5d-f0f2f1b6f52e 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:51:25 devstack sudo[85879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8467725a-892b-4d3f-9d5d-f0f2f1b6f52e 1073741824 Sep 17 21:51:25 devstack sudo[85879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:51:26 devstack sudo[85879]: pam_unix(sudo:session): session closed for user root Sep 17 21:51:26 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-225e2083-d5f2-44aa-9e4b-a588bd2cab25 tempest-TaggedAttachmentsTest-1958506614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8467725a-892b-4d3f-9d5d-f0f2f1b6f52e 1073741824" returned: 0 in 0.536s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:51:26 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-225e2083-d5f2-44aa-9e4b-a588bd2cab25 tempest-TaggedAttachmentsTest-1958506614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8467725a-892b-4d3f-9d5d-f0f2f1b6f52e {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:51:26 devstack sudo[86198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8467725a-892b-4d3f-9d5d-f0f2f1b6f52e Sep 17 21:51:26 devstack sudo[86198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:51:26 devstack sudo[86198]: pam_unix(sudo:session): session closed for user root Sep 17 21:51:26 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-225e2083-d5f2-44aa-9e4b-a588bd2cab25 tempest-TaggedAttachmentsTest-1958506614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8467725a-892b-4d3f-9d5d-f0f2f1b6f52e" returned: 0 in 0.305s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:51:26 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-225e2083-d5f2-44aa-9e4b-a588bd2cab25 tempest-TaggedAttachmentsTest-1958506614 None] <== create_volume: return (912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 21:51:26 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-225e2083-d5f2-44aa-9e4b-a588bd2cab25 tempest-TaggedAttachmentsTest-1958506614 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:51:26 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-225e2083-d5f2-44aa-9e4b-a588bd2cab25 tempest-TaggedAttachmentsTest-1958506614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9054376d-65a4-4684-97bc-6cd58ecdcbac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8467725a-892b-4d3f-9d5d-f0f2f1b6f52e', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:51:26 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-225e2083-d5f2-44aa-9e4b-a588bd2cab25 tempest-TaggedAttachmentsTest-1958506614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0abf9052-ef07-405d-ac03-6f9d996750d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:51:26 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-225e2083-d5f2-44aa-9e4b-a588bd2cab25 tempest-TaggedAttachmentsTest-1958506614 None] Volume volume-8467725a-892b-4d3f-9d5d-f0f2f1b6f52e (8467725a-892b-4d3f-9d5d-f0f2f1b6f52e): created successfully Sep 17 21:51:26 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-225e2083-d5f2-44aa-9e4b-a588bd2cab25 tempest-TaggedAttachmentsTest-1958506614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0abf9052-ef07-405d-ac03-6f9d996750d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:51:26 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-225e2083-d5f2-44aa-9e4b-a588bd2cab25 tempest-TaggedAttachmentsTest-1958506614 None] Flow 'volume_create_manager' (e57db57c-2511-4e6e-8d18-10a28df28800) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 21:51:26 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-225e2083-d5f2-44aa-9e4b-a588bd2cab25 tempest-TaggedAttachmentsTest-1958506614 None] Created volume successfully. Sep 17 21:51:27 devstack cinder-volume[85458]: DEBUG oslo_service.periodic_task [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85458) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 21:51:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:51:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:51:27 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 21:51:27 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 21:51:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:51:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:51:27 devstack sudo[86205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 21:51:27 devstack sudo[86205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:51:28 devstack sudo[86205]: pam_unix(sudo:session): session closed for user root Sep 17 21:51:28 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.297s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:51:28 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 21:51:28 devstack cinder-volume[85458]: DEBUG oslo_service.periodic_task [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Running periodic task VolumeManager._thread_info {{(pid=85458) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 21:51:28 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] thread count: 6 {{(pid=85458) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 21:51:28 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] thread info: [<_MainThread(MainThread, started 127546830999680)>, , , , , ] {{(pid=85458) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 21:51:36 devstack cinder-volume[85458]: DEBUG dbcounter [-] [85458] Writing DB stats cinder:SELECT=3,cinder:UPDATE=4 {{(pid=85458) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 21:51:36 devstack cinder-volume[85458]: DEBUG dbcounter [-] [85458] Writing DB stats cinder:SELECT=1,cinder:UPDATE=2,cinder:INSERT=1,cinder:DELETE=1 {{(pid=85458) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 21:51:54 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-32e68f72-9a5c-43e4-8020-48bf47970a7f tempest-VolumesAdminNegativeTest-441870667 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 21:51:54 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-32e68f72-9a5c-43e4-8020-48bf47970a7f tempest-VolumesAdminNegativeTest-441870667 None] Flow 'volume_create_manager' (4a34698f-8ddc-4fe1-b27d-771cd561678c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 21:51:54 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-32e68f72-9a5c-43e4-8020-48bf47970a7f tempest-VolumesAdminNegativeTest-441870667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55174f6b-db2a-4856-90c2-0f468f9b1b24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:51:54 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-32e68f72-9a5c-43e4-8020-48bf47970a7f tempest-VolumesAdminNegativeTest-441870667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55174f6b-db2a-4856-90c2-0f468f9b1b24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T19:51:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1385650168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8e75b33-9a39-4c8d-a9fd-d74bff57477f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85d54bc57c02435f8c1ad33b00762562',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T19:51:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T19:51:55Z,use_quota=True,user_id='a15b832a4a1b480a9461c094ca5fd64f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:51:54 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-32e68f72-9a5c-43e4-8020-48bf47970a7f tempest-VolumesAdminNegativeTest-441870667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5090ec2-528d-4f73-b703-835f56f3ea37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:51:54 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-32e68f72-9a5c-43e4-8020-48bf47970a7f tempest-VolumesAdminNegativeTest-441870667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5090ec2-528d-4f73-b703-835f56f3ea37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:51:54 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-32e68f72-9a5c-43e4-8020-48bf47970a7f tempest-VolumesAdminNegativeTest-441870667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff60881c-6a6d-4c20-a063-6bfd63030783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:51:54 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-32e68f72-9a5c-43e4-8020-48bf47970a7f tempest-VolumesAdminNegativeTest-441870667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff60881c-6a6d-4c20-a063-6bfd63030783) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8e75b33-9a39-4c8d-a9fd-d74bff57477f', 'volume_name': 'volume-e8e75b33-9a39-4c8d-a9fd-d74bff57477f', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:51:55 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-32e68f72-9a5c-43e4-8020-48bf47970a7f tempest-VolumesAdminNegativeTest-441870667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18700358-67e2-41a8-b5d4-c2aad3c23ff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:51:55 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-32e68f72-9a5c-43e4-8020-48bf47970a7f tempest-VolumesAdminNegativeTest-441870667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18700358-67e2-41a8-b5d4-c2aad3c23ff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:51:55 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-32e68f72-9a5c-43e4-8020-48bf47970a7f tempest-VolumesAdminNegativeTest-441870667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14a1ebae-0122-4a6b-984f-211c52d32e53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:51:55 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-32e68f72-9a5c-43e4-8020-48bf47970a7f tempest-VolumesAdminNegativeTest-441870667 None] Volume e8e75b33-9a39-4c8d-a9fd-d74bff57477f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8e75b33-9a39-4c8d-a9fd-d74bff57477f', 'volume_size': 1} Sep 17 21:51:55 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-32e68f72-9a5c-43e4-8020-48bf47970a7f tempest-VolumesAdminNegativeTest-441870667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:51:55 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-32e68f72-9a5c-43e4-8020-48bf47970a7f tempest-VolumesAdminNegativeTest-441870667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:51:55 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-32e68f72-9a5c-43e4-8020-48bf47970a7f tempest-VolumesAdminNegativeTest-441870667 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T19:51:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1385650168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8e75b33-9a39-4c8d-a9fd-d74bff57477f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85d54bc57c02435f8c1ad33b00762562',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T19:51:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T19:51:55Z,use_quota=True,user_id='a15b832a4a1b480a9461c094ca5fd64f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 21:51:55 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-32e68f72-9a5c-43e4-8020-48bf47970a7f tempest-VolumesAdminNegativeTest-441870667 None] Creating volume e8e75b33-9a39-4c8d-a9fd-d74bff57477f {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 21:51:55 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-32e68f72-9a5c-43e4-8020-48bf47970a7f tempest-VolumesAdminNegativeTest-441870667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:51:55 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-32e68f72-9a5c-43e4-8020-48bf47970a7f tempest-VolumesAdminNegativeTest-441870667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:51:55 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-32e68f72-9a5c-43e4-8020-48bf47970a7f tempest-VolumesAdminNegativeTest-441870667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 21:51:55 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-32e68f72-9a5c-43e4-8020-48bf47970a7f tempest-VolumesAdminNegativeTest-441870667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 21:51:55 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-32e68f72-9a5c-43e4-8020-48bf47970a7f tempest-VolumesAdminNegativeTest-441870667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:51:55 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-32e68f72-9a5c-43e4-8020-48bf47970a7f tempest-VolumesAdminNegativeTest-441870667 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 21:51:55 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-32e68f72-9a5c-43e4-8020-48bf47970a7f tempest-VolumesAdminNegativeTest-441870667 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 21:51:55 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-32e68f72-9a5c-43e4-8020-48bf47970a7f tempest-VolumesAdminNegativeTest-441870667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e8e75b33-9a39-4c8d-a9fd-d74bff57477f 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:51:55 devstack sudo[86630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e8e75b33-9a39-4c8d-a9fd-d74bff57477f 1073741824 Sep 17 21:51:55 devstack sudo[86630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:51:56 devstack sudo[86630]: pam_unix(sudo:session): session closed for user root Sep 17 21:51:56 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-32e68f72-9a5c-43e4-8020-48bf47970a7f tempest-VolumesAdminNegativeTest-441870667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e8e75b33-9a39-4c8d-a9fd-d74bff57477f 1073741824" returned: 0 in 1.083s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:51:56 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-32e68f72-9a5c-43e4-8020-48bf47970a7f tempest-VolumesAdminNegativeTest-441870667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e8e75b33-9a39-4c8d-a9fd-d74bff57477f {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:51:56 devstack sudo[86639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e8e75b33-9a39-4c8d-a9fd-d74bff57477f Sep 17 21:51:56 devstack sudo[86639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:51:56 devstack sudo[86639]: pam_unix(sudo:session): session closed for user root Sep 17 21:51:56 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-32e68f72-9a5c-43e4-8020-48bf47970a7f tempest-VolumesAdminNegativeTest-441870667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e8e75b33-9a39-4c8d-a9fd-d74bff57477f" returned: 0 in 0.352s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:51:56 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-32e68f72-9a5c-43e4-8020-48bf47970a7f tempest-VolumesAdminNegativeTest-441870667 None] <== create_volume: return (1531ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 21:51:56 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-32e68f72-9a5c-43e4-8020-48bf47970a7f tempest-VolumesAdminNegativeTest-441870667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.535s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:51:56 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-32e68f72-9a5c-43e4-8020-48bf47970a7f tempest-VolumesAdminNegativeTest-441870667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14a1ebae-0122-4a6b-984f-211c52d32e53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8e75b33-9a39-4c8d-a9fd-d74bff57477f', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:51:56 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-32e68f72-9a5c-43e4-8020-48bf47970a7f tempest-VolumesAdminNegativeTest-441870667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfdc9fef-21cf-40b6-a4de-a258454fd4af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:51:56 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-32e68f72-9a5c-43e4-8020-48bf47970a7f tempest-VolumesAdminNegativeTest-441870667 None] Volume volume-e8e75b33-9a39-4c8d-a9fd-d74bff57477f (e8e75b33-9a39-4c8d-a9fd-d74bff57477f): created successfully Sep 17 21:51:56 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-32e68f72-9a5c-43e4-8020-48bf47970a7f tempest-VolumesAdminNegativeTest-441870667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfdc9fef-21cf-40b6-a4de-a258454fd4af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:51:56 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-32e68f72-9a5c-43e4-8020-48bf47970a7f tempest-VolumesAdminNegativeTest-441870667 None] Flow 'volume_create_manager' (4a34698f-8ddc-4fe1-b27d-771cd561678c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 21:51:56 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-32e68f72-9a5c-43e4-8020-48bf47970a7f tempest-VolumesAdminNegativeTest-441870667 None] Created volume successfully. Sep 17 21:51:58 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-6f540d4d-7b5e-4d66-9be9-01c0969d08b7 tempest-VolumesAdminNegativeTest-441870667 None] Acquiring lock "cinder-e8e75b33-9a39-4c8d-a9fd-d74bff57477f-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 21:51:58 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-6f540d4d-7b5e-4d66-9be9-01c0969d08b7 tempest-VolumesAdminNegativeTest-441870667 None] Lock "cinder-e8e75b33-9a39-4c8d-a9fd-d74bff57477f-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 21:51:58 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-6f540d4d-7b5e-4d66-9be9-01c0969d08b7 tempest-VolumesAdminNegativeTest-441870667 None] Acquiring lock "cinder-quobyte-e8e75b33-9a39-4c8d-a9fd-d74bff57477f" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 21:51:58 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-6f540d4d-7b5e-4d66-9be9-01c0969d08b7 tempest-VolumesAdminNegativeTest-441870667 None] Lock "cinder-quobyte-e8e75b33-9a39-4c8d-a9fd-d74bff57477f" acquired by "delete_volume" :: waited 0.035s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 21:51:58 devstack cinder-volume[85458]: INFO oslo.privsep.daemon [None req-6f540d4d-7b5e-4d66-9be9-01c0969d08b7 tempest-VolumesAdminNegativeTest-441870667 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpsz0olpyi/privsep.sock'] Sep 17 21:51:58 devstack sudo[86664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpsz0olpyi/privsep.sock Sep 17 21:51:58 devstack sudo[86664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:51:59 devstack cinder-volume[85458]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 17 21:51:59 devstack cinder-volume[85458]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 17 21:51:59 devstack cinder-volume[85458]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 17 21:51:59 devstack cinder-volume[85458]: WARNING oslo.privsep.daemon [-] privsep log: Sep 17 21:51:59 devstack cinder-volume[85458]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 17 21:51:59 devstack cinder-volume[85458]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 17 21:51:59 devstack cinder-volume[85458]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 17 21:51:59 devstack cinder-volume[85458]: WARNING oslo.privsep.daemon [-] privsep log: Sep 17 21:51:59 devstack cinder-volume[85458]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 17 21:52:00 devstack sudo[86664]: pam_unix(sudo:session): session closed for user root Sep 17 21:52:00 devstack cinder-volume[85458]: INFO oslo.privsep.daemon [None req-6f540d4d-7b5e-4d66-9be9-01c0969d08b7 tempest-VolumesAdminNegativeTest-441870667 None] Spawned new privsep daemon via rootwrap Sep 17 21:52:00 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [None req-6f540d4d-7b5e-4d66-9be9-01c0969d08b7 tempest-VolumesAdminNegativeTest-441870667 None] Accepted privsep connection to /tmp/tmpsz0olpyi/privsep.sock {{(pid=85458) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 17 21:52:00 devstack cinder-volume[85458]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 17 21:52:00 devstack cinder-volume[85458]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 17 21:52:00 devstack cinder-volume[85458]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 17 21:52:00 devstack cinder-volume[85458]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 86668 Sep 17 21:52:00 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[920637db-1eb3-40f6-80c3-12f81d74cb58]: (2,) {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 21:52:00 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[20ae6a50-f7b6-465e-9b6d-2775e537b8d8]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 21:52:00 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-6f540d4d-7b5e-4d66-9be9-01c0969d08b7 tempest-VolumesAdminNegativeTest-441870667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e8e75b33-9a39-4c8d-a9fd-d74bff57477f {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:52:00 devstack sudo[86671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e8e75b33-9a39-4c8d-a9fd-d74bff57477f Sep 17 21:52:00 devstack sudo[86671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:52:01 devstack sudo[86671]: pam_unix(sudo:session): session closed for user root Sep 17 21:52:01 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-6f540d4d-7b5e-4d66-9be9-01c0969d08b7 tempest-VolumesAdminNegativeTest-441870667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e8e75b33-9a39-4c8d-a9fd-d74bff57477f" returned: 0 in 0.769s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:52:01 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-6f540d4d-7b5e-4d66-9be9-01c0969d08b7 tempest-VolumesAdminNegativeTest-441870667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e8e75b33-9a39-4c8d-a9fd-d74bff57477f {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:52:01 devstack sudo[86678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e8e75b33-9a39-4c8d-a9fd-d74bff57477f Sep 17 21:52:01 devstack sudo[86678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:52:01 devstack sudo[86678]: pam_unix(sudo:session): session closed for user root Sep 17 21:52:01 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-6f540d4d-7b5e-4d66-9be9-01c0969d08b7 tempest-VolumesAdminNegativeTest-441870667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e8e75b33-9a39-4c8d-a9fd-d74bff57477f" returned: 0 in 0.430s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:52:01 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-6f540d4d-7b5e-4d66-9be9-01c0969d08b7 tempest-VolumesAdminNegativeTest-441870667 None] Lock "cinder-quobyte-e8e75b33-9a39-4c8d-a9fd-d74bff57477f" released by "delete_volume" :: held 3.141s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 21:52:01 devstack cinder-volume[85458]: WARNING cinder.quota [None req-6f540d4d-7b5e-4d66-9be9-01c0969d08b7 tempest-VolumesAdminNegativeTest-441870667 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 17 21:52:01 devstack cinder-volume[85458]: WARNING cinder.quota [None req-6f540d4d-7b5e-4d66-9be9-01c0969d08b7 tempest-VolumesAdminNegativeTest-441870667 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 17 21:52:01 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-6f540d4d-7b5e-4d66-9be9-01c0969d08b7 tempest-VolumesAdminNegativeTest-441870667 None] Created reservations ['03584a3f-e170-4012-80f9-3c57b811ddb1', 'd7a846ca-9c52-44d0-9eee-6938e44138bb', '05618fe5-cecd-41ad-b11d-65afeb8d2f96', 'b91145a1-c6df-4108-be68-1cc543d05d20'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 21:52:02 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-6f540d4d-7b5e-4d66-9be9-01c0969d08b7 tempest-VolumesAdminNegativeTest-441870667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:52:02 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-6f540d4d-7b5e-4d66-9be9-01c0969d08b7 tempest-VolumesAdminNegativeTest-441870667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:52:02 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-6f540d4d-7b5e-4d66-9be9-01c0969d08b7 tempest-VolumesAdminNegativeTest-441870667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 21:52:02 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-6f540d4d-7b5e-4d66-9be9-01c0969d08b7 tempest-VolumesAdminNegativeTest-441870667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 21:52:02 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-6f540d4d-7b5e-4d66-9be9-01c0969d08b7 tempest-VolumesAdminNegativeTest-441870667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:52:02 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-6f540d4d-7b5e-4d66-9be9-01c0969d08b7 tempest-VolumesAdminNegativeTest-441870667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:52:02 devstack sudo[86681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 21:52:02 devstack sudo[86681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:52:02 devstack sudo[86681]: pam_unix(sudo:session): session closed for user root Sep 17 21:52:02 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-6f540d4d-7b5e-4d66-9be9-01c0969d08b7 tempest-VolumesAdminNegativeTest-441870667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.609s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:52:02 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-6f540d4d-7b5e-4d66-9be9-01c0969d08b7 tempest-VolumesAdminNegativeTest-441870667 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 21:52:02 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-6f540d4d-7b5e-4d66-9be9-01c0969d08b7 tempest-VolumesAdminNegativeTest-441870667 None] Deleted volume successfully. Sep 17 21:52:02 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-6f540d4d-7b5e-4d66-9be9-01c0969d08b7 tempest-VolumesAdminNegativeTest-441870667 None] Lock "cinder-e8e75b33-9a39-4c8d-a9fd-d74bff57477f-delete_volume" released by "delete_volume" :: held 4.333s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 21:52:12 devstack cinder-volume[85458]: DEBUG dbcounter [-] [85458] Writing DB stats cinder:SELECT=6,cinder:UPDATE=8,cinder:INSERT=2,cinder:DELETE=1 {{(pid=85458) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 21:52:12 devstack cinder-volume[85458]: DEBUG dbcounter [-] [85458] Writing DB stats cinder:SELECT=8,cinder:UPDATE=14,cinder:INSERT=3,cinder:DELETE=1 {{(pid=85458) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 21:52:16 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-988b14ec-8858-4d41-b7f2-77bf401bab14 tempest-ServerActionsTestOtherA-1688039033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 21:52:16 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-988b14ec-8858-4d41-b7f2-77bf401bab14 tempest-ServerActionsTestOtherA-1688039033 None] Flow 'volume_create_manager' (478ce79e-d7d2-4264-835b-a791bed1140e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 21:52:16 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-988b14ec-8858-4d41-b7f2-77bf401bab14 tempest-ServerActionsTestOtherA-1688039033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01cbfbf5-b99c-47bb-8c8f-ad6671564c9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:52:16 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-988b14ec-8858-4d41-b7f2-77bf401bab14 tempest-ServerActionsTestOtherA-1688039033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01cbfbf5-b99c-47bb-8c8f-ad6671564c9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T19:52:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1776688446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb79f981-6a5d-45a5-960c-ded53c10cb48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a52305617f5452abb280eb1a54a568e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T19:52:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T19:52:16Z,use_quota=True,user_id='f31e43d29968410d8e7f006bc35a6824',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:52:16 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-988b14ec-8858-4d41-b7f2-77bf401bab14 tempest-ServerActionsTestOtherA-1688039033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c41751d-3fb1-4a7e-af01-630ddc9e2c4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:52:16 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-988b14ec-8858-4d41-b7f2-77bf401bab14 tempest-ServerActionsTestOtherA-1688039033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c41751d-3fb1-4a7e-af01-630ddc9e2c4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:52:16 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-988b14ec-8858-4d41-b7f2-77bf401bab14 tempest-ServerActionsTestOtherA-1688039033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ecd084b-3969-45e9-95c7-e6055d20909e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:52:16 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-988b14ec-8858-4d41-b7f2-77bf401bab14 tempest-ServerActionsTestOtherA-1688039033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ecd084b-3969-45e9-95c7-e6055d20909e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb79f981-6a5d-45a5-960c-ded53c10cb48', 'volume_name': 'volume-fb79f981-6a5d-45a5-960c-ded53c10cb48', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:52:16 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-988b14ec-8858-4d41-b7f2-77bf401bab14 tempest-ServerActionsTestOtherA-1688039033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (def64946-1954-4b5c-ac78-c846933ffcf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:52:16 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-988b14ec-8858-4d41-b7f2-77bf401bab14 tempest-ServerActionsTestOtherA-1688039033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (def64946-1954-4b5c-ac78-c846933ffcf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:52:16 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-988b14ec-8858-4d41-b7f2-77bf401bab14 tempest-ServerActionsTestOtherA-1688039033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98bffac4-325c-4644-be9b-9e8133bf55ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:52:16 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-988b14ec-8858-4d41-b7f2-77bf401bab14 tempest-ServerActionsTestOtherA-1688039033 None] Volume fb79f981-6a5d-45a5-960c-ded53c10cb48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb79f981-6a5d-45a5-960c-ded53c10cb48', 'volume_size': 1} Sep 17 21:52:16 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-988b14ec-8858-4d41-b7f2-77bf401bab14 tempest-ServerActionsTestOtherA-1688039033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:52:16 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-988b14ec-8858-4d41-b7f2-77bf401bab14 tempest-ServerActionsTestOtherA-1688039033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:52:16 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-988b14ec-8858-4d41-b7f2-77bf401bab14 tempest-ServerActionsTestOtherA-1688039033 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T19:52:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1776688446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb79f981-6a5d-45a5-960c-ded53c10cb48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a52305617f5452abb280eb1a54a568e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T19:52:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T19:52:16Z,use_quota=True,user_id='f31e43d29968410d8e7f006bc35a6824',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 21:52:16 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-988b14ec-8858-4d41-b7f2-77bf401bab14 tempest-ServerActionsTestOtherA-1688039033 None] Creating volume fb79f981-6a5d-45a5-960c-ded53c10cb48 {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 21:52:16 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-988b14ec-8858-4d41-b7f2-77bf401bab14 tempest-ServerActionsTestOtherA-1688039033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:52:16 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-988b14ec-8858-4d41-b7f2-77bf401bab14 tempest-ServerActionsTestOtherA-1688039033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:52:16 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-988b14ec-8858-4d41-b7f2-77bf401bab14 tempest-ServerActionsTestOtherA-1688039033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 21:52:16 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-988b14ec-8858-4d41-b7f2-77bf401bab14 tempest-ServerActionsTestOtherA-1688039033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 21:52:16 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-988b14ec-8858-4d41-b7f2-77bf401bab14 tempest-ServerActionsTestOtherA-1688039033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:52:16 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-988b14ec-8858-4d41-b7f2-77bf401bab14 tempest-ServerActionsTestOtherA-1688039033 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 21:52:16 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-988b14ec-8858-4d41-b7f2-77bf401bab14 tempest-ServerActionsTestOtherA-1688039033 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 21:52:16 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-988b14ec-8858-4d41-b7f2-77bf401bab14 tempest-ServerActionsTestOtherA-1688039033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-fb79f981-6a5d-45a5-960c-ded53c10cb48 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:52:16 devstack sudo[86772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-fb79f981-6a5d-45a5-960c-ded53c10cb48 1073741824 Sep 17 21:52:16 devstack sudo[86772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:52:17 devstack sudo[86772]: pam_unix(sudo:session): session closed for user root Sep 17 21:52:17 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-988b14ec-8858-4d41-b7f2-77bf401bab14 tempest-ServerActionsTestOtherA-1688039033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-fb79f981-6a5d-45a5-960c-ded53c10cb48 1073741824" returned: 0 in 0.616s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:52:17 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-988b14ec-8858-4d41-b7f2-77bf401bab14 tempest-ServerActionsTestOtherA-1688039033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-fb79f981-6a5d-45a5-960c-ded53c10cb48 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:52:17 devstack sudo[86780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-fb79f981-6a5d-45a5-960c-ded53c10cb48 Sep 17 21:52:17 devstack sudo[86780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:52:17 devstack sudo[86780]: pam_unix(sudo:session): session closed for user root Sep 17 21:52:17 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-988b14ec-8858-4d41-b7f2-77bf401bab14 tempest-ServerActionsTestOtherA-1688039033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-fb79f981-6a5d-45a5-960c-ded53c10cb48" returned: 0 in 0.400s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:52:17 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-988b14ec-8858-4d41-b7f2-77bf401bab14 tempest-ServerActionsTestOtherA-1688039033 None] <== create_volume: return (1087ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 21:52:17 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-988b14ec-8858-4d41-b7f2-77bf401bab14 tempest-ServerActionsTestOtherA-1688039033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.089s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:52:17 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-988b14ec-8858-4d41-b7f2-77bf401bab14 tempest-ServerActionsTestOtherA-1688039033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98bffac4-325c-4644-be9b-9e8133bf55ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb79f981-6a5d-45a5-960c-ded53c10cb48', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:52:17 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-988b14ec-8858-4d41-b7f2-77bf401bab14 tempest-ServerActionsTestOtherA-1688039033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea074996-8ed3-48ba-aa3b-b4a350d50efb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:52:17 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-988b14ec-8858-4d41-b7f2-77bf401bab14 tempest-ServerActionsTestOtherA-1688039033 None] Volume volume-fb79f981-6a5d-45a5-960c-ded53c10cb48 (fb79f981-6a5d-45a5-960c-ded53c10cb48): created successfully Sep 17 21:52:17 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-988b14ec-8858-4d41-b7f2-77bf401bab14 tempest-ServerActionsTestOtherA-1688039033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea074996-8ed3-48ba-aa3b-b4a350d50efb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:52:17 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-988b14ec-8858-4d41-b7f2-77bf401bab14 tempest-ServerActionsTestOtherA-1688039033 None] Flow 'volume_create_manager' (478ce79e-d7d2-4264-835b-a791bed1140e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 21:52:17 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-988b14ec-8858-4d41-b7f2-77bf401bab14 tempest-ServerActionsTestOtherA-1688039033 None] Created volume successfully. Sep 17 21:52:27 devstack cinder-volume[85458]: DEBUG dbcounter [-] [85458] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=85458) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 21:52:27 devstack cinder-volume[85458]: DEBUG oslo_service.periodic_task [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85458) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 21:52:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:52:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:52:27 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 21:52:27 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 21:52:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:52:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:52:27 devstack sudo[86864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 21:52:27 devstack sudo[86864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:52:28 devstack sudo[86864]: pam_unix(sudo:session): session closed for user root Sep 17 21:52:28 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.323s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:52:28 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 21:52:28 devstack cinder-volume[85458]: DEBUG oslo_service.periodic_task [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Running periodic task VolumeManager._thread_info {{(pid=85458) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 21:52:28 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] thread count: 8 {{(pid=85458) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 21:52:28 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] thread info: [<_MainThread(MainThread, started 127546830999680)>, , , , , , , ] {{(pid=85458) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 21:52:36 devstack cinder-volume[85458]: WARNING py.warnings [req-841bd796-0f57-4aff-ae46-3ce95058e4eb req-510b0f97-564f-4b89-95a3-3d11beae7b46 tempest-TaggedAttachmentsTest-1958506614 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Sep 17 21:52:36 devstack cinder-volume[85458]: .first() Sep 17 21:52:36 devstack cinder-volume[85458]: Sep 17 21:52:36 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [req-841bd796-0f57-4aff-ae46-3ce95058e4eb req-510b0f97-564f-4b89-95a3-3d11beae7b46 tempest-TaggedAttachmentsTest-1958506614 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:52:36 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [req-841bd796-0f57-4aff-ae46-3ce95058e4eb req-510b0f97-564f-4b89-95a3-3d11beae7b46 tempest-TaggedAttachmentsTest-1958506614 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:52:36 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [req-841bd796-0f57-4aff-ae46-3ce95058e4eb req-510b0f97-564f-4b89-95a3-3d11beae7b46 tempest-TaggedAttachmentsTest-1958506614 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:52:36 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [req-841bd796-0f57-4aff-ae46-3ce95058e4eb req-510b0f97-564f-4b89-95a3-3d11beae7b46 tempest-TaggedAttachmentsTest-1958506614 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5', 'name': 'volume-8467725a-892b-4d3f-9d5d-f0f2f1b6f52e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3639a458-dbe1-4213-b2d6-b23543c883c4', 'enforce_multipath': True} {{(pid=85458) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 21:52:36 devstack cinder-volume[85458]: INFO cinder.volume.manager [req-841bd796-0f57-4aff-ae46-3ce95058e4eb req-510b0f97-564f-4b89-95a3-3d11beae7b46 tempest-TaggedAttachmentsTest-1958506614 None] attachment_update completed successfully. Sep 17 21:52:42 devstack cinder-volume[85458]: INFO cinder.volume.manager [req-02c46496-f181-491b-b3c0-ac69e10e25de req-53b24fc4-9d10-479b-858c-ec966ee7c310 tempest-TaggedAttachmentsTest-1958506614 None] Terminate volume connection completed successfully. Sep 17 21:52:42 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [req-02c46496-f181-491b-b3c0-ac69e10e25de req-53b24fc4-9d10-479b-858c-ec966ee7c310 tempest-TaggedAttachmentsTest-1958506614 None] Deleting attachment 3639a458-dbe1-4213-b2d6-b23543c883c4. {{(pid=85458) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 21:52:52 devstack cinder-volume[85458]: DEBUG dbcounter [-] [85458] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=85458) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 21:52:52 devstack cinder-volume[85458]: DEBUG dbcounter [-] [85458] Writing DB stats cinder:SELECT=10,cinder:UPDATE=6,cinder:INSERT=1 {{(pid=85458) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 21:52:56 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-5e89b147-4946-4164-9734-1978ab4bb0c2 tempest-TaggedAttachmentsTest-1958506614 None] Acquiring lock "cinder-8467725a-892b-4d3f-9d5d-f0f2f1b6f52e-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 21:52:56 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-5e89b147-4946-4164-9734-1978ab4bb0c2 tempest-TaggedAttachmentsTest-1958506614 None] Lock "cinder-8467725a-892b-4d3f-9d5d-f0f2f1b6f52e-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 21:52:56 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-5e89b147-4946-4164-9734-1978ab4bb0c2 tempest-TaggedAttachmentsTest-1958506614 None] Acquiring lock "cinder-quobyte-8467725a-892b-4d3f-9d5d-f0f2f1b6f52e" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 21:52:56 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-5e89b147-4946-4164-9734-1978ab4bb0c2 tempest-TaggedAttachmentsTest-1958506614 None] Lock "cinder-quobyte-8467725a-892b-4d3f-9d5d-f0f2f1b6f52e" acquired by "delete_volume" :: waited 0.045s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 21:52:56 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a310493-caae-4221-aa1e-417fa2602088]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 21:52:56 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-5e89b147-4946-4164-9734-1978ab4bb0c2 tempest-TaggedAttachmentsTest-1958506614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8467725a-892b-4d3f-9d5d-f0f2f1b6f52e {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:52:56 devstack sudo[87727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8467725a-892b-4d3f-9d5d-f0f2f1b6f52e Sep 17 21:52:56 devstack sudo[87727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:52:57 devstack sudo[87727]: pam_unix(sudo:session): session closed for user root Sep 17 21:52:57 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-5e89b147-4946-4164-9734-1978ab4bb0c2 tempest-TaggedAttachmentsTest-1958506614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8467725a-892b-4d3f-9d5d-f0f2f1b6f52e" returned: 0 in 0.538s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:52:57 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-5e89b147-4946-4164-9734-1978ab4bb0c2 tempest-TaggedAttachmentsTest-1958506614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8467725a-892b-4d3f-9d5d-f0f2f1b6f52e {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:52:57 devstack sudo[87735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8467725a-892b-4d3f-9d5d-f0f2f1b6f52e Sep 17 21:52:57 devstack sudo[87735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:52:57 devstack sudo[87735]: pam_unix(sudo:session): session closed for user root Sep 17 21:52:57 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-5e89b147-4946-4164-9734-1978ab4bb0c2 tempest-TaggedAttachmentsTest-1958506614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8467725a-892b-4d3f-9d5d-f0f2f1b6f52e" returned: 0 in 0.264s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:52:57 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-5e89b147-4946-4164-9734-1978ab4bb0c2 tempest-TaggedAttachmentsTest-1958506614 None] Lock "cinder-quobyte-8467725a-892b-4d3f-9d5d-f0f2f1b6f52e" released by "delete_volume" :: held 0.873s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 21:52:57 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-5e89b147-4946-4164-9734-1978ab4bb0c2 tempest-TaggedAttachmentsTest-1958506614 None] Created reservations ['3dd96967-8e93-4d2d-92bf-4506970769de', '1faadb91-c894-46bb-a85f-53ef3eab2a1b', '6ec06a47-6310-47c6-93ea-c6bcd8c9bd37', 'ad142c04-fea5-4bd9-939d-36ebd4ee8204'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 21:52:57 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-5e89b147-4946-4164-9734-1978ab4bb0c2 tempest-TaggedAttachmentsTest-1958506614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:52:57 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-5e89b147-4946-4164-9734-1978ab4bb0c2 tempest-TaggedAttachmentsTest-1958506614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:52:57 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-5e89b147-4946-4164-9734-1978ab4bb0c2 tempest-TaggedAttachmentsTest-1958506614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 21:52:57 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-5e89b147-4946-4164-9734-1978ab4bb0c2 tempest-TaggedAttachmentsTest-1958506614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 21:52:57 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-5e89b147-4946-4164-9734-1978ab4bb0c2 tempest-TaggedAttachmentsTest-1958506614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:52:57 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-5e89b147-4946-4164-9734-1978ab4bb0c2 tempest-TaggedAttachmentsTest-1958506614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:52:57 devstack sudo[87738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 21:52:57 devstack sudo[87738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:52:58 devstack sudo[87738]: pam_unix(sudo:session): session closed for user root Sep 17 21:52:58 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-5e89b147-4946-4164-9734-1978ab4bb0c2 tempest-TaggedAttachmentsTest-1958506614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.402s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:52:58 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-5e89b147-4946-4164-9734-1978ab4bb0c2 tempest-TaggedAttachmentsTest-1958506614 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 21:52:58 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-5e89b147-4946-4164-9734-1978ab4bb0c2 tempest-TaggedAttachmentsTest-1958506614 None] Deleted volume successfully. Sep 17 21:52:58 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-5e89b147-4946-4164-9734-1978ab4bb0c2 tempest-TaggedAttachmentsTest-1958506614 None] Lock "cinder-8467725a-892b-4d3f-9d5d-f0f2f1b6f52e-delete_volume" released by "delete_volume" :: held 1.681s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 21:52:58 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-092ee717-f9a6-4582-800b-62d41054d5c0 tempest-DeleteServersTestJSON-766990118 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 21:52:58 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-092ee717-f9a6-4582-800b-62d41054d5c0 tempest-DeleteServersTestJSON-766990118 None] Flow 'volume_create_manager' (f621bb49-09a1-481e-88e6-d9a33a2b00f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 21:52:58 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-092ee717-f9a6-4582-800b-62d41054d5c0 tempest-DeleteServersTestJSON-766990118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fac1a1b-7b0f-433e-9e26-4a53e81ce3a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:52:58 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-092ee717-f9a6-4582-800b-62d41054d5c0 tempest-DeleteServersTestJSON-766990118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fac1a1b-7b0f-433e-9e26-4a53e81ce3a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T19:52:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-116653128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=999b13ac-0828-41df-b064-7c1054a947a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66c83795a7e94c0c98942004ae83dd52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T19:52:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T19:52:59Z,use_quota=True,user_id='d2f713dfb48d4399a1c38aa402981ae7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:52:58 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-092ee717-f9a6-4582-800b-62d41054d5c0 tempest-DeleteServersTestJSON-766990118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68857e86-6ca7-428b-9bfb-9937a037bdca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:52:58 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-092ee717-f9a6-4582-800b-62d41054d5c0 tempest-DeleteServersTestJSON-766990118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68857e86-6ca7-428b-9bfb-9937a037bdca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:52:58 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-092ee717-f9a6-4582-800b-62d41054d5c0 tempest-DeleteServersTestJSON-766990118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6c1a705-a95a-496e-a949-2cfe5fa08adc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:52:58 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-092ee717-f9a6-4582-800b-62d41054d5c0 tempest-DeleteServersTestJSON-766990118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6c1a705-a95a-496e-a949-2cfe5fa08adc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '999b13ac-0828-41df-b064-7c1054a947a0', 'volume_name': 'volume-999b13ac-0828-41df-b064-7c1054a947a0', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:52:58 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-092ee717-f9a6-4582-800b-62d41054d5c0 tempest-DeleteServersTestJSON-766990118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f16d4ee-c438-4eec-8740-bc43bdca5aa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:52:59 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-092ee717-f9a6-4582-800b-62d41054d5c0 tempest-DeleteServersTestJSON-766990118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f16d4ee-c438-4eec-8740-bc43bdca5aa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:52:59 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-092ee717-f9a6-4582-800b-62d41054d5c0 tempest-DeleteServersTestJSON-766990118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0f1fef1-bd1f-46b5-9e03-e081d043af29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:52:59 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-092ee717-f9a6-4582-800b-62d41054d5c0 tempest-DeleteServersTestJSON-766990118 None] Volume 999b13ac-0828-41df-b064-7c1054a947a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-999b13ac-0828-41df-b064-7c1054a947a0', 'volume_size': 1} Sep 17 21:52:59 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-092ee717-f9a6-4582-800b-62d41054d5c0 tempest-DeleteServersTestJSON-766990118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:52:59 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-092ee717-f9a6-4582-800b-62d41054d5c0 tempest-DeleteServersTestJSON-766990118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:52:59 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-092ee717-f9a6-4582-800b-62d41054d5c0 tempest-DeleteServersTestJSON-766990118 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T19:52:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-116653128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=999b13ac-0828-41df-b064-7c1054a947a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66c83795a7e94c0c98942004ae83dd52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T19:52:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T19:52:59Z,use_quota=True,user_id='d2f713dfb48d4399a1c38aa402981ae7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 21:52:59 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-092ee717-f9a6-4582-800b-62d41054d5c0 tempest-DeleteServersTestJSON-766990118 None] Creating volume 999b13ac-0828-41df-b064-7c1054a947a0 {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 21:52:59 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-092ee717-f9a6-4582-800b-62d41054d5c0 tempest-DeleteServersTestJSON-766990118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:52:59 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-092ee717-f9a6-4582-800b-62d41054d5c0 tempest-DeleteServersTestJSON-766990118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:52:59 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-092ee717-f9a6-4582-800b-62d41054d5c0 tempest-DeleteServersTestJSON-766990118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 21:52:59 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-092ee717-f9a6-4582-800b-62d41054d5c0 tempest-DeleteServersTestJSON-766990118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 21:52:59 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-092ee717-f9a6-4582-800b-62d41054d5c0 tempest-DeleteServersTestJSON-766990118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:52:59 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-092ee717-f9a6-4582-800b-62d41054d5c0 tempest-DeleteServersTestJSON-766990118 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 21:52:59 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-092ee717-f9a6-4582-800b-62d41054d5c0 tempest-DeleteServersTestJSON-766990118 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 21:52:59 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-092ee717-f9a6-4582-800b-62d41054d5c0 tempest-DeleteServersTestJSON-766990118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-999b13ac-0828-41df-b064-7c1054a947a0 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:52:59 devstack sudo[87743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-999b13ac-0828-41df-b064-7c1054a947a0 1073741824 Sep 17 21:52:59 devstack sudo[87743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:52:59 devstack sudo[87743]: pam_unix(sudo:session): session closed for user root Sep 17 21:52:59 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-092ee717-f9a6-4582-800b-62d41054d5c0 tempest-DeleteServersTestJSON-766990118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-999b13ac-0828-41df-b064-7c1054a947a0 1073741824" returned: 0 in 0.625s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:52:59 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-092ee717-f9a6-4582-800b-62d41054d5c0 tempest-DeleteServersTestJSON-766990118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-999b13ac-0828-41df-b064-7c1054a947a0 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:52:59 devstack sudo[87750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-999b13ac-0828-41df-b064-7c1054a947a0 Sep 17 21:52:59 devstack sudo[87750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:53:00 devstack sudo[87750]: pam_unix(sudo:session): session closed for user root Sep 17 21:53:00 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-092ee717-f9a6-4582-800b-62d41054d5c0 tempest-DeleteServersTestJSON-766990118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-999b13ac-0828-41df-b064-7c1054a947a0" returned: 0 in 0.404s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:53:00 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-092ee717-f9a6-4582-800b-62d41054d5c0 tempest-DeleteServersTestJSON-766990118 None] <== create_volume: return (1090ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 21:53:00 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-092ee717-f9a6-4582-800b-62d41054d5c0 tempest-DeleteServersTestJSON-766990118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.093s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:53:00 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-092ee717-f9a6-4582-800b-62d41054d5c0 tempest-DeleteServersTestJSON-766990118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0f1fef1-bd1f-46b5-9e03-e081d043af29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-999b13ac-0828-41df-b064-7c1054a947a0', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:53:00 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-092ee717-f9a6-4582-800b-62d41054d5c0 tempest-DeleteServersTestJSON-766990118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c5e6e95-bb4b-4246-a2cc-9b01e095c7c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:53:00 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-092ee717-f9a6-4582-800b-62d41054d5c0 tempest-DeleteServersTestJSON-766990118 None] Volume volume-999b13ac-0828-41df-b064-7c1054a947a0 (999b13ac-0828-41df-b064-7c1054a947a0): created successfully Sep 17 21:53:00 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-092ee717-f9a6-4582-800b-62d41054d5c0 tempest-DeleteServersTestJSON-766990118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c5e6e95-bb4b-4246-a2cc-9b01e095c7c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:53:00 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-092ee717-f9a6-4582-800b-62d41054d5c0 tempest-DeleteServersTestJSON-766990118 None] Flow 'volume_create_manager' (f621bb49-09a1-481e-88e6-d9a33a2b00f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 21:53:00 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-092ee717-f9a6-4582-800b-62d41054d5c0 tempest-DeleteServersTestJSON-766990118 None] Created volume successfully. Sep 17 21:53:01 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [req-6be29f5d-ddde-4f24-8729-b3bcabde1d6a req-2dd97c01-47ef-47de-bb45-ae5e3e3386ad tempest-ServerActionsTestOtherA-1688039033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:53:01 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [req-6be29f5d-ddde-4f24-8729-b3bcabde1d6a req-2dd97c01-47ef-47de-bb45-ae5e3e3386ad tempest-ServerActionsTestOtherA-1688039033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:53:01 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [req-6be29f5d-ddde-4f24-8729-b3bcabde1d6a req-2dd97c01-47ef-47de-bb45-ae5e3e3386ad tempest-ServerActionsTestOtherA-1688039033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:53:01 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [req-6be29f5d-ddde-4f24-8729-b3bcabde1d6a req-2dd97c01-47ef-47de-bb45-ae5e3e3386ad tempest-ServerActionsTestOtherA-1688039033 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5', 'name': 'volume-fb79f981-6a5d-45a5-960c-ded53c10cb48', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7d8a6b18-4b83-4af7-8a74-c208a7051e6a', 'enforce_multipath': True} {{(pid=85458) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 21:53:01 devstack cinder-volume[85458]: INFO cinder.volume.manager [req-6be29f5d-ddde-4f24-8729-b3bcabde1d6a req-2dd97c01-47ef-47de-bb45-ae5e3e3386ad tempest-ServerActionsTestOtherA-1688039033 None] attachment_update completed successfully. Sep 17 21:53:02 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-599d993f-fe69-41c7-94c9-629da8869528 tempest-AttachVolumeShelveTestJSON-1055753500 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 21:53:02 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-599d993f-fe69-41c7-94c9-629da8869528 tempest-AttachVolumeShelveTestJSON-1055753500 None] Flow 'volume_create_manager' (410f968d-a222-4b34-81e9-2740527dca0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 21:53:02 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-599d993f-fe69-41c7-94c9-629da8869528 tempest-AttachVolumeShelveTestJSON-1055753500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf116df2-4390-409a-a6b4-de694220aa4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:53:02 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-599d993f-fe69-41c7-94c9-629da8869528 tempest-AttachVolumeShelveTestJSON-1055753500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf116df2-4390-409a-a6b4-de694220aa4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T19:53:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1952673807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f23e84fb-af8b-4136-ae5f-e44dd6a27212,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4deae05d67bb40b2a8078c9125c76d99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T19:53:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T19:53:02Z,use_quota=True,user_id='9a4dabb1d8464a28a1f8b040b46ef71d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:53:02 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-599d993f-fe69-41c7-94c9-629da8869528 tempest-AttachVolumeShelveTestJSON-1055753500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45baa368-9588-47cd-bf58-d79e0b7f129a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:53:02 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-599d993f-fe69-41c7-94c9-629da8869528 tempest-AttachVolumeShelveTestJSON-1055753500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45baa368-9588-47cd-bf58-d79e0b7f129a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:53:02 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-599d993f-fe69-41c7-94c9-629da8869528 tempest-AttachVolumeShelveTestJSON-1055753500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fb5092a-fffe-4b81-830c-79fefab51dc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:53:02 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-599d993f-fe69-41c7-94c9-629da8869528 tempest-AttachVolumeShelveTestJSON-1055753500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fb5092a-fffe-4b81-830c-79fefab51dc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f23e84fb-af8b-4136-ae5f-e44dd6a27212', 'volume_name': 'volume-f23e84fb-af8b-4136-ae5f-e44dd6a27212', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:53:02 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-599d993f-fe69-41c7-94c9-629da8869528 tempest-AttachVolumeShelveTestJSON-1055753500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a761692-6127-4305-80c8-32748b724eaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:53:02 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-599d993f-fe69-41c7-94c9-629da8869528 tempest-AttachVolumeShelveTestJSON-1055753500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a761692-6127-4305-80c8-32748b724eaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:53:02 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-599d993f-fe69-41c7-94c9-629da8869528 tempest-AttachVolumeShelveTestJSON-1055753500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a69ee476-facd-421a-bc25-1ae8dde82297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:53:02 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-599d993f-fe69-41c7-94c9-629da8869528 tempest-AttachVolumeShelveTestJSON-1055753500 None] Volume f23e84fb-af8b-4136-ae5f-e44dd6a27212: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f23e84fb-af8b-4136-ae5f-e44dd6a27212', 'volume_size': 1} Sep 17 21:53:02 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-599d993f-fe69-41c7-94c9-629da8869528 tempest-AttachVolumeShelveTestJSON-1055753500 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:53:02 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-599d993f-fe69-41c7-94c9-629da8869528 tempest-AttachVolumeShelveTestJSON-1055753500 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:53:02 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-599d993f-fe69-41c7-94c9-629da8869528 tempest-AttachVolumeShelveTestJSON-1055753500 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T19:53:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1952673807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f23e84fb-af8b-4136-ae5f-e44dd6a27212,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4deae05d67bb40b2a8078c9125c76d99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T19:53:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T19:53:02Z,use_quota=True,user_id='9a4dabb1d8464a28a1f8b040b46ef71d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 21:53:02 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-599d993f-fe69-41c7-94c9-629da8869528 tempest-AttachVolumeShelveTestJSON-1055753500 None] Creating volume f23e84fb-af8b-4136-ae5f-e44dd6a27212 {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 21:53:02 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-599d993f-fe69-41c7-94c9-629da8869528 tempest-AttachVolumeShelveTestJSON-1055753500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:53:02 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-599d993f-fe69-41c7-94c9-629da8869528 tempest-AttachVolumeShelveTestJSON-1055753500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:53:02 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-599d993f-fe69-41c7-94c9-629da8869528 tempest-AttachVolumeShelveTestJSON-1055753500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 21:53:02 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-599d993f-fe69-41c7-94c9-629da8869528 tempest-AttachVolumeShelveTestJSON-1055753500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 21:53:02 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-599d993f-fe69-41c7-94c9-629da8869528 tempest-AttachVolumeShelveTestJSON-1055753500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:53:02 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-599d993f-fe69-41c7-94c9-629da8869528 tempest-AttachVolumeShelveTestJSON-1055753500 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 21:53:02 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-599d993f-fe69-41c7-94c9-629da8869528 tempest-AttachVolumeShelveTestJSON-1055753500 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 21:53:02 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-599d993f-fe69-41c7-94c9-629da8869528 tempest-AttachVolumeShelveTestJSON-1055753500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f23e84fb-af8b-4136-ae5f-e44dd6a27212 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:53:02 devstack sudo[88188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f23e84fb-af8b-4136-ae5f-e44dd6a27212 1073741824 Sep 17 21:53:02 devstack sudo[88188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:53:03 devstack sudo[88188]: pam_unix(sudo:session): session closed for user root Sep 17 21:53:03 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-599d993f-fe69-41c7-94c9-629da8869528 tempest-AttachVolumeShelveTestJSON-1055753500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f23e84fb-af8b-4136-ae5f-e44dd6a27212 1073741824" returned: 0 in 0.787s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:53:03 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-599d993f-fe69-41c7-94c9-629da8869528 tempest-AttachVolumeShelveTestJSON-1055753500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f23e84fb-af8b-4136-ae5f-e44dd6a27212 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:53:03 devstack sudo[88202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f23e84fb-af8b-4136-ae5f-e44dd6a27212 Sep 17 21:53:03 devstack sudo[88202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:53:03 devstack sudo[88202]: pam_unix(sudo:session): session closed for user root Sep 17 21:53:03 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-599d993f-fe69-41c7-94c9-629da8869528 tempest-AttachVolumeShelveTestJSON-1055753500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f23e84fb-af8b-4136-ae5f-e44dd6a27212" returned: 0 in 0.367s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:53:03 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-599d993f-fe69-41c7-94c9-629da8869528 tempest-AttachVolumeShelveTestJSON-1055753500 None] <== create_volume: return (1265ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 21:53:03 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-599d993f-fe69-41c7-94c9-629da8869528 tempest-AttachVolumeShelveTestJSON-1055753500 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.267s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:53:03 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-599d993f-fe69-41c7-94c9-629da8869528 tempest-AttachVolumeShelveTestJSON-1055753500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a69ee476-facd-421a-bc25-1ae8dde82297) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f23e84fb-af8b-4136-ae5f-e44dd6a27212', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:53:03 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-599d993f-fe69-41c7-94c9-629da8869528 tempest-AttachVolumeShelveTestJSON-1055753500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6218796-2274-4f82-8688-fb795c5daa71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:53:03 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-599d993f-fe69-41c7-94c9-629da8869528 tempest-AttachVolumeShelveTestJSON-1055753500 None] Volume volume-f23e84fb-af8b-4136-ae5f-e44dd6a27212 (f23e84fb-af8b-4136-ae5f-e44dd6a27212): created successfully Sep 17 21:53:03 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-599d993f-fe69-41c7-94c9-629da8869528 tempest-AttachVolumeShelveTestJSON-1055753500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6218796-2274-4f82-8688-fb795c5daa71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:53:03 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-599d993f-fe69-41c7-94c9-629da8869528 tempest-AttachVolumeShelveTestJSON-1055753500 None] Flow 'volume_create_manager' (410f968d-a222-4b34-81e9-2740527dca0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 21:53:03 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-599d993f-fe69-41c7-94c9-629da8869528 tempest-AttachVolumeShelveTestJSON-1055753500 None] Created volume successfully. Sep 17 21:53:03 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [req-1230e432-db46-4e88-bdcd-0bc1d9aa6a0e req-8f4c9523-26b5-4690-9140-32aa83302d85 tempest-DeleteServersTestJSON-766990118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:53:03 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [req-1230e432-db46-4e88-bdcd-0bc1d9aa6a0e req-8f4c9523-26b5-4690-9140-32aa83302d85 tempest-DeleteServersTestJSON-766990118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:53:03 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [req-1230e432-db46-4e88-bdcd-0bc1d9aa6a0e req-8f4c9523-26b5-4690-9140-32aa83302d85 tempest-DeleteServersTestJSON-766990118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:53:03 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [req-1230e432-db46-4e88-bdcd-0bc1d9aa6a0e req-8f4c9523-26b5-4690-9140-32aa83302d85 tempest-DeleteServersTestJSON-766990118 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5', 'name': 'volume-999b13ac-0828-41df-b064-7c1054a947a0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6cebd926-f164-4a4e-8416-26812f787b85', 'enforce_multipath': True} {{(pid=85458) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 21:53:03 devstack cinder-volume[85458]: INFO cinder.volume.manager [req-1230e432-db46-4e88-bdcd-0bc1d9aa6a0e req-8f4c9523-26b5-4690-9140-32aa83302d85 tempest-DeleteServersTestJSON-766990118 None] attachment_update completed successfully. Sep 17 21:53:06 devstack cinder-volume[85458]: INFO cinder.volume.manager [req-02d685da-5da7-4f04-93a1-5ddafa598db5 req-58f1fe44-761c-428e-a460-a3ee997fc881 tempest-ServerActionsTestOtherA-1688039033 None] Terminate volume connection completed successfully. Sep 17 21:53:06 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [req-02d685da-5da7-4f04-93a1-5ddafa598db5 req-58f1fe44-761c-428e-a460-a3ee997fc881 tempest-ServerActionsTestOtherA-1688039033 None] Deleting attachment 7d8a6b18-4b83-4af7-8a74-c208a7051e6a. {{(pid=85458) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 21:53:07 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [req-02d685da-5da7-4f04-93a1-5ddafa598db5 req-ce253e76-d688-4f5c-8bad-7edc19d9ed47 tempest-ServerActionsTestOtherA-1688039033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:53:08 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [req-02d685da-5da7-4f04-93a1-5ddafa598db5 req-ce253e76-d688-4f5c-8bad-7edc19d9ed47 tempest-ServerActionsTestOtherA-1688039033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:53:08 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [req-02d685da-5da7-4f04-93a1-5ddafa598db5 req-ce253e76-d688-4f5c-8bad-7edc19d9ed47 tempest-ServerActionsTestOtherA-1688039033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:53:08 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [req-02d685da-5da7-4f04-93a1-5ddafa598db5 req-ce253e76-d688-4f5c-8bad-7edc19d9ed47 tempest-ServerActionsTestOtherA-1688039033 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5', 'name': 'volume-fb79f981-6a5d-45a5-960c-ded53c10cb48', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '25314f0f-3bf9-48f1-b2ce-0d9c21040993', 'enforce_multipath': True} {{(pid=85458) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 21:53:08 devstack cinder-volume[85458]: INFO cinder.volume.manager [req-02d685da-5da7-4f04-93a1-5ddafa598db5 req-ce253e76-d688-4f5c-8bad-7edc19d9ed47 tempest-ServerActionsTestOtherA-1688039033 None] attachment_update completed successfully. Sep 17 21:53:08 devstack cinder-volume[85458]: INFO cinder.volume.manager [req-27df72f1-f489-421a-891e-5cd93e6a4560 req-4d7e5e8a-8f4e-4d53-9963-a8a9ede2e7b4 tempest-DeleteServersTestJSON-766990118 None] Terminate volume connection completed successfully. Sep 17 21:53:08 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [req-27df72f1-f489-421a-891e-5cd93e6a4560 req-4d7e5e8a-8f4e-4d53-9963-a8a9ede2e7b4 tempest-DeleteServersTestJSON-766990118 None] Deleting attachment 6cebd926-f164-4a4e-8416-26812f787b85. {{(pid=85458) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 21:53:10 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-6681cec0-f599-4f1a-8c67-9977201b2399 tempest-DeleteServersTestJSON-766990118 None] Acquiring lock "cinder-999b13ac-0828-41df-b064-7c1054a947a0-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 21:53:10 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-6681cec0-f599-4f1a-8c67-9977201b2399 tempest-DeleteServersTestJSON-766990118 None] Lock "cinder-999b13ac-0828-41df-b064-7c1054a947a0-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 21:53:10 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-6681cec0-f599-4f1a-8c67-9977201b2399 tempest-DeleteServersTestJSON-766990118 None] Acquiring lock "cinder-quobyte-999b13ac-0828-41df-b064-7c1054a947a0" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 21:53:10 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-6681cec0-f599-4f1a-8c67-9977201b2399 tempest-DeleteServersTestJSON-766990118 None] Lock "cinder-quobyte-999b13ac-0828-41df-b064-7c1054a947a0" acquired by "delete_volume" :: waited 0.027s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 21:53:10 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[25d66894-141b-49f0-9874-368bf521f29f]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 21:53:10 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-6681cec0-f599-4f1a-8c67-9977201b2399 tempest-DeleteServersTestJSON-766990118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-999b13ac-0828-41df-b064-7c1054a947a0 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:53:10 devstack sudo[88808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-999b13ac-0828-41df-b064-7c1054a947a0 Sep 17 21:53:10 devstack sudo[88808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:53:11 devstack sudo[88808]: pam_unix(sudo:session): session closed for user root Sep 17 21:53:11 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-6681cec0-f599-4f1a-8c67-9977201b2399 tempest-DeleteServersTestJSON-766990118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-999b13ac-0828-41df-b064-7c1054a947a0" returned: 0 in 0.610s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:53:11 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-6681cec0-f599-4f1a-8c67-9977201b2399 tempest-DeleteServersTestJSON-766990118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-999b13ac-0828-41df-b064-7c1054a947a0 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:53:11 devstack sudo[88826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-999b13ac-0828-41df-b064-7c1054a947a0 Sep 17 21:53:11 devstack sudo[88826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:53:11 devstack sudo[88826]: pam_unix(sudo:session): session closed for user root Sep 17 21:53:11 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-6681cec0-f599-4f1a-8c67-9977201b2399 tempest-DeleteServersTestJSON-766990118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-999b13ac-0828-41df-b064-7c1054a947a0" returned: 0 in 0.551s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:53:11 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-6681cec0-f599-4f1a-8c67-9977201b2399 tempest-DeleteServersTestJSON-766990118 None] Lock "cinder-quobyte-999b13ac-0828-41df-b064-7c1054a947a0" released by "delete_volume" :: held 1.237s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 21:53:12 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-6681cec0-f599-4f1a-8c67-9977201b2399 tempest-DeleteServersTestJSON-766990118 None] Created reservations ['bb845c38-e666-4986-a1d2-950e489ce7a2', 'bb4f1379-8213-43ca-8695-e5baac2e3b74', '0db50549-2bd7-4b50-9fdb-68e5fba8579e', '7b30b202-d338-4d66-89d1-9145d85ef054'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 21:53:12 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-6681cec0-f599-4f1a-8c67-9977201b2399 tempest-DeleteServersTestJSON-766990118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:53:12 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-6681cec0-f599-4f1a-8c67-9977201b2399 tempest-DeleteServersTestJSON-766990118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:53:12 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-6681cec0-f599-4f1a-8c67-9977201b2399 tempest-DeleteServersTestJSON-766990118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 21:53:12 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-6681cec0-f599-4f1a-8c67-9977201b2399 tempest-DeleteServersTestJSON-766990118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 21:53:12 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-6681cec0-f599-4f1a-8c67-9977201b2399 tempest-DeleteServersTestJSON-766990118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:53:12 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-6681cec0-f599-4f1a-8c67-9977201b2399 tempest-DeleteServersTestJSON-766990118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:53:12 devstack sudo[88830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 21:53:12 devstack sudo[88830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:53:12 devstack sudo[88830]: pam_unix(sudo:session): session closed for user root Sep 17 21:53:12 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-6681cec0-f599-4f1a-8c67-9977201b2399 tempest-DeleteServersTestJSON-766990118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.506s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:53:12 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-6681cec0-f599-4f1a-8c67-9977201b2399 tempest-DeleteServersTestJSON-766990118 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 21:53:12 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-6681cec0-f599-4f1a-8c67-9977201b2399 tempest-DeleteServersTestJSON-766990118 None] Deleted volume successfully. Sep 17 21:53:12 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-6681cec0-f599-4f1a-8c67-9977201b2399 tempest-DeleteServersTestJSON-766990118 None] Lock "cinder-999b13ac-0828-41df-b064-7c1054a947a0-delete_volume" released by "delete_volume" :: held 2.143s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 21:53:20 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [req-cdf9d306-b102-47f9-8680-ed390c82e114 req-adcdb54c-5ec7-451c-b1c7-5a5886a1218c tempest-AttachVolumeShelveTestJSON-1055753500 None] No connector for attachment 55d04eb4-c978-4711-87ab-984a03270b41; skipping storage backend terminate_connection call. {{(pid=85458) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 17 21:53:20 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [req-cdf9d306-b102-47f9-8680-ed390c82e114 req-adcdb54c-5ec7-451c-b1c7-5a5886a1218c tempest-AttachVolumeShelveTestJSON-1055753500 None] Deleting attachment 55d04eb4-c978-4711-87ab-984a03270b41. {{(pid=85458) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 21:53:22 devstack cinder-volume[85458]: DEBUG dbcounter [-] [85458] Writing DB stats cinder:SELECT=36,cinder:INSERT=6,cinder:UPDATE=28,cinder:DELETE=3 {{(pid=85458) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 21:53:27 devstack cinder-volume[85458]: DEBUG oslo_service.periodic_task [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85458) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 21:53:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:53:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:53:27 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 21:53:27 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 21:53:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:53:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:53:27 devstack sudo[88933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 21:53:27 devstack sudo[88933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:53:28 devstack sudo[88933]: pam_unix(sudo:session): session closed for user root Sep 17 21:53:28 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.297s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:53:28 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 21:53:28 devstack cinder-volume[85458]: DEBUG oslo_service.periodic_task [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Running periodic task VolumeManager._thread_info {{(pid=85458) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 21:53:28 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] thread count: 8 {{(pid=85458) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 21:53:28 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] thread info: [<_MainThread(MainThread, started 127546830999680)>, , , , , , , ] {{(pid=85458) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 21:53:30 devstack cinder-volume[85458]: DEBUG dbcounter [-] [85458] Writing DB stats cinder:UPDATE=25,cinder:SELECT=37,cinder:INSERT=4,cinder:DELETE=1 {{(pid=85458) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 21:53:40 devstack cinder-volume[85458]: INFO cinder.volume.manager [req-9a2f82d6-868c-45fd-b4ff-0c038a57d0bb req-370c0875-e2f2-4c32-a541-4eaddf4b9b19 tempest-ServerActionsTestOtherA-1688039033 None] Terminate volume connection completed successfully. Sep 17 21:53:40 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [req-9a2f82d6-868c-45fd-b4ff-0c038a57d0bb req-370c0875-e2f2-4c32-a541-4eaddf4b9b19 tempest-ServerActionsTestOtherA-1688039033 None] Deleting attachment 25314f0f-3bf9-48f1-b2ce-0d9c21040993. {{(pid=85458) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 21:53:50 devstack cinder-volume[85458]: DEBUG dbcounter [-] [85458] Writing DB stats cinder:SELECT=2 {{(pid=85458) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 21:53:56 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-17cf504d-0f08-457c-8ceb-dca910be32f5 tempest-ServerActionsTestOtherA-1688039033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 21:53:56 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-17cf504d-0f08-457c-8ceb-dca910be32f5 tempest-ServerActionsTestOtherA-1688039033 None] Flow 'volume_create_manager' (a68ba63d-197d-4c00-8db0-bea1c3f796f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 21:53:56 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-17cf504d-0f08-457c-8ceb-dca910be32f5 tempest-ServerActionsTestOtherA-1688039033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97b21b4a-b1ae-46e4-ac64-e6bfc25e59ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:53:56 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-17cf504d-0f08-457c-8ceb-dca910be32f5 tempest-ServerActionsTestOtherA-1688039033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97b21b4a-b1ae-46e4-ac64-e6bfc25e59ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T19:53:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-363542301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c0d7f76-65e3-4200-bc1f-07932b86fdb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a52305617f5452abb280eb1a54a568e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T19:53:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T19:53:56Z,use_quota=True,user_id='f31e43d29968410d8e7f006bc35a6824',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:53:56 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-17cf504d-0f08-457c-8ceb-dca910be32f5 tempest-ServerActionsTestOtherA-1688039033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (430910ab-c271-42da-8796-ab7024035f5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:53:56 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-17cf504d-0f08-457c-8ceb-dca910be32f5 tempest-ServerActionsTestOtherA-1688039033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (430910ab-c271-42da-8796-ab7024035f5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:53:56 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-17cf504d-0f08-457c-8ceb-dca910be32f5 tempest-ServerActionsTestOtherA-1688039033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6594548-3823-4283-9d97-b806e4719b30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:53:56 devstack cinder-volume[85458]: DEBUG cinder.image.glance [None req-17cf504d-0f08-457c-8ceb-dca910be32f5 tempest-ServerActionsTestOtherA-1688039033 None] Creating Keystone auth plugin from conf {{(pid=85458) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 17 21:53:57 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-17cf504d-0f08-457c-8ceb-dca910be32f5 tempest-ServerActionsTestOtherA-1688039033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6594548-3823-4283-9d97-b806e4719b30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5c0d7f76-65e3-4200-bc1f-07932b86fdb6', 'volume_name': 'volume-5c0d7f76-65e3-4200-bc1f-07932b86fdb6', 'volume_size': 1, 'image_id': '764e44ff-49f7-469a-925c-23f254888b59', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/764e44ff-49f7-469a-925c-23f254888b59', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '530062d71c924da39eff46373302dc71', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '764e44ff-49f7-469a-925c-23f254888b59', 'created_at': datetime.datetime(2026, 9, 17, 19, 45, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 19, 45, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/764e44ff-49f7-469a-925c-23f254888b59/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:53:57 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-17cf504d-0f08-457c-8ceb-dca910be32f5 tempest-ServerActionsTestOtherA-1688039033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b35cd37d-e10b-43f7-b1c3-9f4f9d2cb9a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:53:57 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-17cf504d-0f08-457c-8ceb-dca910be32f5 tempest-ServerActionsTestOtherA-1688039033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b35cd37d-e10b-43f7-b1c3-9f4f9d2cb9a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:53:57 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-17cf504d-0f08-457c-8ceb-dca910be32f5 tempest-ServerActionsTestOtherA-1688039033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10b140dd-5a35-4e41-8349-b1c3f78896a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:53:57 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-17cf504d-0f08-457c-8ceb-dca910be32f5 tempest-ServerActionsTestOtherA-1688039033 None] Volume 5c0d7f76-65e3-4200-bc1f-07932b86fdb6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5c0d7f76-65e3-4200-bc1f-07932b86fdb6', 'volume_size': 1, 'image_id': '764e44ff-49f7-469a-925c-23f254888b59', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/764e44ff-49f7-469a-925c-23f254888b59', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '530062d71c924da39eff46373302dc71', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '764e44ff-49f7-469a-925c-23f254888b59', 'created_at': datetime.datetime(2026, 9, 17, 19, 45, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 19, 45, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/764e44ff-49f7-469a-925c-23f254888b59/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 17 21:53:57 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-17cf504d-0f08-457c-8ceb-dca910be32f5 tempest-ServerActionsTestOtherA-1688039033 None] Trying to clone 5c0d7f76-65e3-4200-bc1f-07932b86fdb6 from image 764e44ff-49f7-469a-925c-23f254888b59 at location (None, [{'url': 'file:///opt/stack/data/glance/images/764e44ff-49f7-469a-925c-23f254888b59', 'metadata': {}}]). {{(pid=85458) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 17 21:53:58 devstack cinder-volume[85458]: DEBUG cinder.image.image_utils [None req-17cf504d-0f08-457c-8ceb-dca910be32f5 tempest-ServerActionsTestOtherA-1688039033 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_764e44ff-49f7-469a-925c-23f254888b59_vjva89gddevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=85458) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 17 21:53:58 devstack cinder-volume[85458]: INFO cinder.image.image_utils [None req-17cf504d-0f08-457c-8ceb-dca910be32f5 tempest-ServerActionsTestOtherA-1688039033 None] Image download 20.69 MB at 20.69 MB/s Sep 17 21:53:58 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5c76532-45ef-47a3-9d68-ab6f47bdb172]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 21:53:58 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-17cf504d-0f08-457c-8ceb-dca910be32f5 tempest-ServerActionsTestOtherA-1688039033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_764e44ff-49f7-469a-925c-23f254888b59_vjva89gddevstack@QuobyteHD {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:53:58 devstack sudo[89349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_764e44ff-49f7-469a-925c-23f254888b59_vjva89gddevstack@QuobyteHD Sep 17 21:53:58 devstack sudo[89349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:53:58 devstack sudo[89349]: pam_unix(sudo:session): session closed for user root Sep 17 21:53:58 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-17cf504d-0f08-457c-8ceb-dca910be32f5 tempest-ServerActionsTestOtherA-1688039033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_764e44ff-49f7-469a-925c-23f254888b59_vjva89gddevstack@QuobyteHD" returned: 0 in 0.377s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:53:58 devstack cinder-volume[85458]: DEBUG cinder.image.image_utils [None req-17cf504d-0f08-457c-8ceb-dca910be32f5 tempest-ServerActionsTestOtherA-1688039033 None] Temporary image 764e44ff-49f7-469a-925c-23f254888b59 is fetched for user f31e43d29968410d8e7f006bc35a6824. {{(pid=85458) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 17 21:53:59 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c535453-ac1a-4ec6-86a1-d9bb8a3d4af8]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 21:53:59 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-17cf504d-0f08-457c-8ceb-dca910be32f5 tempest-ServerActionsTestOtherA-1688039033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_764e44ff-49f7-469a-925c-23f254888b59_vjva89gddevstack@QuobyteHD {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:53:59 devstack sudo[89354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_764e44ff-49f7-469a-925c-23f254888b59_vjva89gddevstack@QuobyteHD Sep 17 21:53:59 devstack sudo[89354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:54:00 devstack sudo[89354]: pam_unix(sudo:session): session closed for user root Sep 17 21:54:00 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-17cf504d-0f08-457c-8ceb-dca910be32f5 tempest-ServerActionsTestOtherA-1688039033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_764e44ff-49f7-469a-925c-23f254888b59_vjva89gddevstack@QuobyteHD" returned: 0 in 0.976s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:54:00 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-17cf504d-0f08-457c-8ceb-dca910be32f5 tempest-ServerActionsTestOtherA-1688039033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:54:00 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-17cf504d-0f08-457c-8ceb-dca910be32f5 tempest-ServerActionsTestOtherA-1688039033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:54:00 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-17cf504d-0f08-457c-8ceb-dca910be32f5 tempest-ServerActionsTestOtherA-1688039033 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T19:53:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-363542301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c0d7f76-65e3-4200-bc1f-07932b86fdb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a52305617f5452abb280eb1a54a568e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T19:53:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T19:53:56Z,use_quota=True,user_id='f31e43d29968410d8e7f006bc35a6824',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 21:54:00 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-17cf504d-0f08-457c-8ceb-dca910be32f5 tempest-ServerActionsTestOtherA-1688039033 None] Creating volume 5c0d7f76-65e3-4200-bc1f-07932b86fdb6 {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 21:54:00 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-17cf504d-0f08-457c-8ceb-dca910be32f5 tempest-ServerActionsTestOtherA-1688039033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:54:00 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-17cf504d-0f08-457c-8ceb-dca910be32f5 tempest-ServerActionsTestOtherA-1688039033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:54:00 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-17cf504d-0f08-457c-8ceb-dca910be32f5 tempest-ServerActionsTestOtherA-1688039033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 21:54:00 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-17cf504d-0f08-457c-8ceb-dca910be32f5 tempest-ServerActionsTestOtherA-1688039033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 21:54:00 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-17cf504d-0f08-457c-8ceb-dca910be32f5 tempest-ServerActionsTestOtherA-1688039033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:54:00 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-17cf504d-0f08-457c-8ceb-dca910be32f5 tempest-ServerActionsTestOtherA-1688039033 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 21:54:00 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-17cf504d-0f08-457c-8ceb-dca910be32f5 tempest-ServerActionsTestOtherA-1688039033 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 21:54:00 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-17cf504d-0f08-457c-8ceb-dca910be32f5 tempest-ServerActionsTestOtherA-1688039033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-5c0d7f76-65e3-4200-bc1f-07932b86fdb6 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:54:00 devstack sudo[89401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-5c0d7f76-65e3-4200-bc1f-07932b86fdb6 1073741824 Sep 17 21:54:00 devstack sudo[89401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:54:01 devstack sudo[89401]: pam_unix(sudo:session): session closed for user root Sep 17 21:54:01 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-17cf504d-0f08-457c-8ceb-dca910be32f5 tempest-ServerActionsTestOtherA-1688039033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-5c0d7f76-65e3-4200-bc1f-07932b86fdb6 1073741824" returned: 0 in 0.996s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:54:01 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-17cf504d-0f08-457c-8ceb-dca910be32f5 tempest-ServerActionsTestOtherA-1688039033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-5c0d7f76-65e3-4200-bc1f-07932b86fdb6 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:54:01 devstack sudo[89431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-5c0d7f76-65e3-4200-bc1f-07932b86fdb6 Sep 17 21:54:01 devstack sudo[89431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:54:01 devstack sudo[89431]: pam_unix(sudo:session): session closed for user root Sep 17 21:54:01 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-17cf504d-0f08-457c-8ceb-dca910be32f5 tempest-ServerActionsTestOtherA-1688039033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-5c0d7f76-65e3-4200-bc1f-07932b86fdb6" returned: 0 in 0.648s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:54:01 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-17cf504d-0f08-457c-8ceb-dca910be32f5 tempest-ServerActionsTestOtherA-1688039033 None] <== create_volume: return (1733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 21:54:01 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-17cf504d-0f08-457c-8ceb-dca910be32f5 tempest-ServerActionsTestOtherA-1688039033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.736s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:54:01 devstack cinder-volume[85458]: DEBUG cinder.volume.volume_utils [None req-17cf504d-0f08-457c-8ceb-dca910be32f5 tempest-ServerActionsTestOtherA-1688039033 None] Attempting download of 764e44ff-49f7-469a-925c-23f254888b59 ((None, [{'url': 'file:///opt/stack/data/glance/images/764e44ff-49f7-469a-925c-23f254888b59', 'metadata': {}}])) to volume 5c0d7f76-65e3-4200-bc1f-07932b86fdb6. {{(pid=85458) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 17 21:54:01 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e901392-0677-4a93-b637-c2b88bc6a4c6]: (4, 'raw') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 21:54:01 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-17cf504d-0f08-457c-8ceb-dca910be32f5 tempest-ServerActionsTestOtherA-1688039033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_764e44ff-49f7-469a-925c-23f254888b59_3eeg9lo1 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:54:02 devstack sudo[89437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_764e44ff-49f7-469a-925c-23f254888b59_3eeg9lo1 Sep 17 21:54:02 devstack sudo[89437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:54:02 devstack sudo[89437]: pam_unix(sudo:session): session closed for user root Sep 17 21:54:02 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-17cf504d-0f08-457c-8ceb-dca910be32f5 tempest-ServerActionsTestOtherA-1688039033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_764e44ff-49f7-469a-925c-23f254888b59_3eeg9lo1" returned: 0 in 0.399s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:54:02 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-17cf504d-0f08-457c-8ceb-dca910be32f5 tempest-ServerActionsTestOtherA-1688039033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_764e44ff-49f7-469a-925c-23f254888b59_3eeg9lo1 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:54:02 devstack sudo[89443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_764e44ff-49f7-469a-925c-23f254888b59_3eeg9lo1 Sep 17 21:54:02 devstack sudo[89443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:54:02 devstack sudo[89443]: pam_unix(sudo:session): session closed for user root Sep 17 21:54:02 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-17cf504d-0f08-457c-8ceb-dca910be32f5 tempest-ServerActionsTestOtherA-1688039033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_764e44ff-49f7-469a-925c-23f254888b59_3eeg9lo1" returned: 1 in 0.610s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:54:02 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-17cf504d-0f08-457c-8ceb-dca910be32f5 tempest-ServerActionsTestOtherA-1688039033 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_764e44ff-49f7-469a-925c-23f254888b59_3eeg9lo1' failed. Not Retrying. {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 21:54:02 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a183b4-03e1-4a61-8e13-058402a281b6]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 21:54:02 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-17cf504d-0f08-457c-8ceb-dca910be32f5 tempest-ServerActionsTestOtherA-1688039033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_764e44ff-49f7-469a-925c-23f254888b59_vjva89gddevstack@QuobyteHD {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:54:03 devstack sudo[89447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_764e44ff-49f7-469a-925c-23f254888b59_vjva89gddevstack@QuobyteHD Sep 17 21:54:03 devstack sudo[89447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:54:03 devstack sudo[89447]: pam_unix(sudo:session): session closed for user root Sep 17 21:54:03 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-17cf504d-0f08-457c-8ceb-dca910be32f5 tempest-ServerActionsTestOtherA-1688039033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_764e44ff-49f7-469a-925c-23f254888b59_vjva89gddevstack@QuobyteHD" returned: 0 in 0.571s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:54:03 devstack cinder-volume[85458]: DEBUG cinder.image.image_utils [None req-17cf504d-0f08-457c-8ceb-dca910be32f5 tempest-ServerActionsTestOtherA-1688039033 None] 764e44ff-49f7-469a-925c-23f254888b59 was qcow2, converting to qcow2 {{(pid=85458) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 17 21:54:03 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-17cf504d-0f08-457c-8ceb-dca910be32f5 tempest-ServerActionsTestOtherA-1688039033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_764e44ff-49f7-469a-925c-23f254888b59_vjva89gddevstack@QuobyteHD /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-5c0d7f76-65e3-4200-bc1f-07932b86fdb6 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:54:03 devstack sudo[89454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_764e44ff-49f7-469a-925c-23f254888b59_vjva89gddevstack@QuobyteHD /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-5c0d7f76-65e3-4200-bc1f-07932b86fdb6 Sep 17 21:54:03 devstack sudo[89454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:54:05 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-df9d9f1e-c5c9-4c43-8db1-a176d5890b9c tempest-ServerRescueNegativeTestJSON-1246269230 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 21:54:05 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-df9d9f1e-c5c9-4c43-8db1-a176d5890b9c tempest-ServerRescueNegativeTestJSON-1246269230 None] Flow 'volume_create_manager' (f0b857e5-74df-43eb-a2ed-3876f485b396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 21:54:05 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-df9d9f1e-c5c9-4c43-8db1-a176d5890b9c tempest-ServerRescueNegativeTestJSON-1246269230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e623cc8-2ba5-4266-add1-34a52edf1c91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:54:05 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-df9d9f1e-c5c9-4c43-8db1-a176d5890b9c tempest-ServerRescueNegativeTestJSON-1246269230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e623cc8-2ba5-4266-add1-34a52edf1c91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T19:54:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1711113898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e49ee08-1c79-4638-990c-939bae0cffa8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5ae31c45f5c41e1ad66cb3e2e93372a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T19:54:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T19:54:05Z,use_quota=True,user_id='87e5d36f791440939ed58edcce4e38f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:54:05 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-df9d9f1e-c5c9-4c43-8db1-a176d5890b9c tempest-ServerRescueNegativeTestJSON-1246269230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d9131b5-bc26-4442-a4a5-b656e114f265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:54:05 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-df9d9f1e-c5c9-4c43-8db1-a176d5890b9c tempest-ServerRescueNegativeTestJSON-1246269230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d9131b5-bc26-4442-a4a5-b656e114f265) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:54:05 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-df9d9f1e-c5c9-4c43-8db1-a176d5890b9c tempest-ServerRescueNegativeTestJSON-1246269230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d603231-f6c2-43d8-b676-666fa7dfaa28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:54:05 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-df9d9f1e-c5c9-4c43-8db1-a176d5890b9c tempest-ServerRescueNegativeTestJSON-1246269230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d603231-f6c2-43d8-b676-666fa7dfaa28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e49ee08-1c79-4638-990c-939bae0cffa8', 'volume_name': 'volume-0e49ee08-1c79-4638-990c-939bae0cffa8', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:54:05 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-df9d9f1e-c5c9-4c43-8db1-a176d5890b9c tempest-ServerRescueNegativeTestJSON-1246269230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f05d57f-beac-4897-9074-7d71575cc93c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:54:05 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-df9d9f1e-c5c9-4c43-8db1-a176d5890b9c tempest-ServerRescueNegativeTestJSON-1246269230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f05d57f-beac-4897-9074-7d71575cc93c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:54:05 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-df9d9f1e-c5c9-4c43-8db1-a176d5890b9c tempest-ServerRescueNegativeTestJSON-1246269230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bbcd3dd-b24a-47ac-96f9-62b3d3888c2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:54:05 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-df9d9f1e-c5c9-4c43-8db1-a176d5890b9c tempest-ServerRescueNegativeTestJSON-1246269230 None] Volume 0e49ee08-1c79-4638-990c-939bae0cffa8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e49ee08-1c79-4638-990c-939bae0cffa8', 'volume_size': 1} Sep 17 21:54:05 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-df9d9f1e-c5c9-4c43-8db1-a176d5890b9c tempest-ServerRescueNegativeTestJSON-1246269230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:54:05 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-df9d9f1e-c5c9-4c43-8db1-a176d5890b9c tempest-ServerRescueNegativeTestJSON-1246269230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:54:05 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-df9d9f1e-c5c9-4c43-8db1-a176d5890b9c tempest-ServerRescueNegativeTestJSON-1246269230 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T19:54:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1711113898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e49ee08-1c79-4638-990c-939bae0cffa8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5ae31c45f5c41e1ad66cb3e2e93372a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T19:54:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T19:54:05Z,use_quota=True,user_id='87e5d36f791440939ed58edcce4e38f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 21:54:05 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-df9d9f1e-c5c9-4c43-8db1-a176d5890b9c tempest-ServerRescueNegativeTestJSON-1246269230 None] Creating volume 0e49ee08-1c79-4638-990c-939bae0cffa8 {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 21:54:05 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-df9d9f1e-c5c9-4c43-8db1-a176d5890b9c tempest-ServerRescueNegativeTestJSON-1246269230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:54:05 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-df9d9f1e-c5c9-4c43-8db1-a176d5890b9c tempest-ServerRescueNegativeTestJSON-1246269230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:54:05 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-df9d9f1e-c5c9-4c43-8db1-a176d5890b9c tempest-ServerRescueNegativeTestJSON-1246269230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 21:54:05 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-df9d9f1e-c5c9-4c43-8db1-a176d5890b9c tempest-ServerRescueNegativeTestJSON-1246269230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 21:54:05 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-df9d9f1e-c5c9-4c43-8db1-a176d5890b9c tempest-ServerRescueNegativeTestJSON-1246269230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:54:05 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-df9d9f1e-c5c9-4c43-8db1-a176d5890b9c tempest-ServerRescueNegativeTestJSON-1246269230 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 21:54:05 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-df9d9f1e-c5c9-4c43-8db1-a176d5890b9c tempest-ServerRescueNegativeTestJSON-1246269230 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 21:54:05 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-df9d9f1e-c5c9-4c43-8db1-a176d5890b9c tempest-ServerRescueNegativeTestJSON-1246269230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0e49ee08-1c79-4638-990c-939bae0cffa8 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:54:05 devstack sudo[89463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0e49ee08-1c79-4638-990c-939bae0cffa8 1073741824 Sep 17 21:54:05 devstack sudo[89463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:54:07 devstack sudo[89463]: pam_unix(sudo:session): session closed for user root Sep 17 21:54:07 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-df9d9f1e-c5c9-4c43-8db1-a176d5890b9c tempest-ServerRescueNegativeTestJSON-1246269230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0e49ee08-1c79-4638-990c-939bae0cffa8 1073741824" returned: 0 in 1.715s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:54:07 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-df9d9f1e-c5c9-4c43-8db1-a176d5890b9c tempest-ServerRescueNegativeTestJSON-1246269230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0e49ee08-1c79-4638-990c-939bae0cffa8 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:54:07 devstack sudo[89480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0e49ee08-1c79-4638-990c-939bae0cffa8 Sep 17 21:54:07 devstack sudo[89480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:54:08 devstack sudo[89480]: pam_unix(sudo:session): session closed for user root Sep 17 21:54:08 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-df9d9f1e-c5c9-4c43-8db1-a176d5890b9c tempest-ServerRescueNegativeTestJSON-1246269230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0e49ee08-1c79-4638-990c-939bae0cffa8" returned: 0 in 1.439s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:54:08 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-df9d9f1e-c5c9-4c43-8db1-a176d5890b9c tempest-ServerRescueNegativeTestJSON-1246269230 None] <== create_volume: return (3320ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 21:54:08 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-df9d9f1e-c5c9-4c43-8db1-a176d5890b9c tempest-ServerRescueNegativeTestJSON-1246269230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.331s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:54:08 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-df9d9f1e-c5c9-4c43-8db1-a176d5890b9c tempest-ServerRescueNegativeTestJSON-1246269230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bbcd3dd-b24a-47ac-96f9-62b3d3888c2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e49ee08-1c79-4638-990c-939bae0cffa8', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:54:08 devstack sudo[89454]: pam_unix(sudo:session): session closed for user root Sep 17 21:54:08 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-df9d9f1e-c5c9-4c43-8db1-a176d5890b9c tempest-ServerRescueNegativeTestJSON-1246269230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08ffa912-d92e-4dfa-9522-bca4dd1bb977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:54:08 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-17cf504d-0f08-457c-8ceb-dca910be32f5 tempest-ServerActionsTestOtherA-1688039033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_764e44ff-49f7-469a-925c-23f254888b59_vjva89gddevstack@QuobyteHD /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-5c0d7f76-65e3-4200-bc1f-07932b86fdb6" returned: 0 in 5.429s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:54:09 devstack cinder-volume[85458]: DEBUG cinder.image.image_utils [None req-17cf504d-0f08-457c-8ceb-dca910be32f5 tempest-ServerActionsTestOtherA-1688039033 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_764e44ff-49f7-469a-925c-23f254888b59_vjva89gddevstack@QuobyteHD, size 112.00 MB, duration 5.44 sec, destination /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-5c0d7f76-65e3-4200-bc1f-07932b86fdb6 {{(pid=85458) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 17 21:54:09 devstack cinder-volume[85458]: INFO cinder.image.image_utils [None req-17cf504d-0f08-457c-8ceb-dca910be32f5 tempest-ServerActionsTestOtherA-1688039033 None] Converted 112.00 MB image at 20.60 MB/s Sep 17 21:54:09 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-17cf504d-0f08-457c-8ceb-dca910be32f5 tempest-ServerActionsTestOtherA-1688039033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-5c0d7f76-65e3-4200-bc1f-07932b86fdb6 1G {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:54:09 devstack sudo[89564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-5c0d7f76-65e3-4200-bc1f-07932b86fdb6 1G Sep 17 21:54:09 devstack sudo[89564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:54:09 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-df9d9f1e-c5c9-4c43-8db1-a176d5890b9c tempest-ServerRescueNegativeTestJSON-1246269230 None] Volume volume-0e49ee08-1c79-4638-990c-939bae0cffa8 (0e49ee08-1c79-4638-990c-939bae0cffa8): created successfully Sep 17 21:54:09 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-df9d9f1e-c5c9-4c43-8db1-a176d5890b9c tempest-ServerRescueNegativeTestJSON-1246269230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08ffa912-d92e-4dfa-9522-bca4dd1bb977) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:54:09 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-df9d9f1e-c5c9-4c43-8db1-a176d5890b9c tempest-ServerRescueNegativeTestJSON-1246269230 None] Flow 'volume_create_manager' (f0b857e5-74df-43eb-a2ed-3876f485b396) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 21:54:09 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-df9d9f1e-c5c9-4c43-8db1-a176d5890b9c tempest-ServerRescueNegativeTestJSON-1246269230 None] Created volume successfully. Sep 17 21:54:10 devstack sudo[89564]: pam_unix(sudo:session): session closed for user root Sep 17 21:54:10 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-17cf504d-0f08-457c-8ceb-dca910be32f5 tempest-ServerActionsTestOtherA-1688039033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-5c0d7f76-65e3-4200-bc1f-07932b86fdb6 1G" returned: 0 in 1.116s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:54:10 devstack cinder-volume[85458]: DEBUG cinder.volume.volume_utils [None req-17cf504d-0f08-457c-8ceb-dca910be32f5 tempest-ServerActionsTestOtherA-1688039033 None] Downloaded image 764e44ff-49f7-469a-925c-23f254888b59 ((None, [{'url': 'file:///opt/stack/data/glance/images/764e44ff-49f7-469a-925c-23f254888b59', 'metadata': {}}])) to volume 5c0d7f76-65e3-4200-bc1f-07932b86fdb6 successfully. {{(pid=85458) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 17 21:54:10 devstack cinder-volume[85458]: DEBUG cinder.image.image_utils [None req-17cf504d-0f08-457c-8ceb-dca910be32f5 tempest-ServerActionsTestOtherA-1688039033 None] Temporary image 764e44ff-49f7-469a-925c-23f254888b59 for user f31e43d29968410d8e7f006bc35a6824 is deleted. {{(pid=85458) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 17 21:54:10 devstack cinder-volume[85458]: DEBUG cinder.volume.volume_utils [None req-17cf504d-0f08-457c-8ceb-dca910be32f5 tempest-ServerActionsTestOtherA-1688039033 None] Marking volume 5c0d7f76-65e3-4200-bc1f-07932b86fdb6 as bootable. {{(pid=85458) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 17 21:54:10 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-17cf504d-0f08-457c-8ceb-dca910be32f5 tempest-ServerActionsTestOtherA-1688039033 None] Copying metadata from image 764e44ff-49f7-469a-925c-23f254888b59 to 5c0d7f76-65e3-4200-bc1f-07932b86fdb6. {{(pid=85458) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 17 21:54:10 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-17cf504d-0f08-457c-8ceb-dca910be32f5 tempest-ServerActionsTestOtherA-1688039033 None] Creating volume glance metadata for volume 5c0d7f76-65e3-4200-bc1f-07932b86fdb6 backed by image 764e44ff-49f7-469a-925c-23f254888b59 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '764e44ff-49f7-469a-925c-23f254888b59', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=85458) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 17 21:54:10 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-17cf504d-0f08-457c-8ceb-dca910be32f5 tempest-ServerActionsTestOtherA-1688039033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10b140dd-5a35-4e41-8349-b1c3f78896a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c0d7f76-65e3-4200-bc1f-07932b86fdb6', 'volume_size': 1, 'image_id': '764e44ff-49f7-469a-925c-23f254888b59', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/764e44ff-49f7-469a-925c-23f254888b59', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '530062d71c924da39eff46373302dc71', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '764e44ff-49f7-469a-925c-23f254888b59', 'created_at': datetime.datetime(2026, 9, 17, 19, 45, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 19, 45, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/764e44ff-49f7-469a-925c-23f254888b59/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:54:10 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-17cf504d-0f08-457c-8ceb-dca910be32f5 tempest-ServerActionsTestOtherA-1688039033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f96081b5-524f-47dc-815a-200f7cf30c0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:54:10 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-17cf504d-0f08-457c-8ceb-dca910be32f5 tempest-ServerActionsTestOtherA-1688039033 None] Volume volume-5c0d7f76-65e3-4200-bc1f-07932b86fdb6 (5c0d7f76-65e3-4200-bc1f-07932b86fdb6): created successfully Sep 17 21:54:10 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-17cf504d-0f08-457c-8ceb-dca910be32f5 tempest-ServerActionsTestOtherA-1688039033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f96081b5-524f-47dc-815a-200f7cf30c0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:54:10 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-17cf504d-0f08-457c-8ceb-dca910be32f5 tempest-ServerActionsTestOtherA-1688039033 None] Flow 'volume_create_manager' (a68ba63d-197d-4c00-8db0-bea1c3f796f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 21:54:10 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-17cf504d-0f08-457c-8ceb-dca910be32f5 tempest-ServerActionsTestOtherA-1688039033 None] Created volume successfully. Sep 17 21:54:16 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-2f469763-d4ca-4f2a-8f5b-cfe730badad5 tempest-AttachVolumeShelveTestJSON-1055753500 None] Acquiring lock "cinder-f23e84fb-af8b-4136-ae5f-e44dd6a27212-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 21:54:16 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-2f469763-d4ca-4f2a-8f5b-cfe730badad5 tempest-AttachVolumeShelveTestJSON-1055753500 None] Lock "cinder-f23e84fb-af8b-4136-ae5f-e44dd6a27212-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 21:54:16 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-2f469763-d4ca-4f2a-8f5b-cfe730badad5 tempest-AttachVolumeShelveTestJSON-1055753500 None] Acquiring lock "cinder-quobyte-f23e84fb-af8b-4136-ae5f-e44dd6a27212" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 21:54:16 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-2f469763-d4ca-4f2a-8f5b-cfe730badad5 tempest-AttachVolumeShelveTestJSON-1055753500 None] Lock "cinder-quobyte-f23e84fb-af8b-4136-ae5f-e44dd6a27212" acquired by "delete_volume" :: waited 0.040s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 21:54:16 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[e98b88a2-30b2-4482-af8b-c2aa28d2380e]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 21:54:16 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-2f469763-d4ca-4f2a-8f5b-cfe730badad5 tempest-AttachVolumeShelveTestJSON-1055753500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f23e84fb-af8b-4136-ae5f-e44dd6a27212 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:54:16 devstack sudo[89620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f23e84fb-af8b-4136-ae5f-e44dd6a27212 Sep 17 21:54:16 devstack sudo[89620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:54:17 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [req-efb1f0e9-30db-44e1-a251-be0956a43b4b req-d0a6bce9-5459-4bc3-a8f5-a2773e4139ea tempest-ServerActionsTestOtherA-1688039033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:54:17 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [req-efb1f0e9-30db-44e1-a251-be0956a43b4b req-d0a6bce9-5459-4bc3-a8f5-a2773e4139ea tempest-ServerActionsTestOtherA-1688039033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.006s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:54:17 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [req-efb1f0e9-30db-44e1-a251-be0956a43b4b req-d0a6bce9-5459-4bc3-a8f5-a2773e4139ea tempest-ServerActionsTestOtherA-1688039033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.076s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:54:17 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [req-efb1f0e9-30db-44e1-a251-be0956a43b4b req-d0a6bce9-5459-4bc3-a8f5-a2773e4139ea tempest-ServerActionsTestOtherA-1688039033 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5', 'name': 'volume-5c0d7f76-65e3-4200-bc1f-07932b86fdb6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'aebacc4e-a2e6-4230-af82-a5fa4f36b562', 'enforce_multipath': True} {{(pid=85458) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 21:54:17 devstack sudo[89620]: pam_unix(sudo:session): session closed for user root Sep 17 21:54:17 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-2f469763-d4ca-4f2a-8f5b-cfe730badad5 tempest-AttachVolumeShelveTestJSON-1055753500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f23e84fb-af8b-4136-ae5f-e44dd6a27212" returned: 0 in 1.041s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:54:17 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-2f469763-d4ca-4f2a-8f5b-cfe730badad5 tempest-AttachVolumeShelveTestJSON-1055753500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f23e84fb-af8b-4136-ae5f-e44dd6a27212 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:54:17 devstack sudo[89634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f23e84fb-af8b-4136-ae5f-e44dd6a27212 Sep 17 21:54:17 devstack sudo[89634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:54:17 devstack cinder-volume[85458]: INFO cinder.volume.manager [req-efb1f0e9-30db-44e1-a251-be0956a43b4b req-d0a6bce9-5459-4bc3-a8f5-a2773e4139ea tempest-ServerActionsTestOtherA-1688039033 None] attachment_update completed successfully. Sep 17 21:54:18 devstack sudo[89634]: pam_unix(sudo:session): session closed for user root Sep 17 21:54:18 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-2f469763-d4ca-4f2a-8f5b-cfe730badad5 tempest-AttachVolumeShelveTestJSON-1055753500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f23e84fb-af8b-4136-ae5f-e44dd6a27212" returned: 0 in 0.884s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:54:18 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-2f469763-d4ca-4f2a-8f5b-cfe730badad5 tempest-AttachVolumeShelveTestJSON-1055753500 None] Lock "cinder-quobyte-f23e84fb-af8b-4136-ae5f-e44dd6a27212" released by "delete_volume" :: held 2.090s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 21:54:18 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-2f469763-d4ca-4f2a-8f5b-cfe730badad5 tempest-AttachVolumeShelveTestJSON-1055753500 None] Created reservations ['43dc5d60-e6bc-419f-a567-e0e4900e6984', '6369d78c-03c6-43f7-9ea8-fb4ed172eab2', '8c817bbf-b8f7-45bc-84d5-f1d248bfc04d', 'dfd627d4-dbbb-4b86-b5d1-f58e1735806c'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 21:54:18 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-2f469763-d4ca-4f2a-8f5b-cfe730badad5 tempest-AttachVolumeShelveTestJSON-1055753500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:54:18 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-2f469763-d4ca-4f2a-8f5b-cfe730badad5 tempest-AttachVolumeShelveTestJSON-1055753500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:54:18 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-2f469763-d4ca-4f2a-8f5b-cfe730badad5 tempest-AttachVolumeShelveTestJSON-1055753500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 21:54:18 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-2f469763-d4ca-4f2a-8f5b-cfe730badad5 tempest-AttachVolumeShelveTestJSON-1055753500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 21:54:18 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-2f469763-d4ca-4f2a-8f5b-cfe730badad5 tempest-AttachVolumeShelveTestJSON-1055753500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:54:18 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-2f469763-d4ca-4f2a-8f5b-cfe730badad5 tempest-AttachVolumeShelveTestJSON-1055753500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:54:18 devstack sudo[89637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 21:54:18 devstack sudo[89637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:54:19 devstack sudo[89637]: pam_unix(sudo:session): session closed for user root Sep 17 21:54:19 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-2f469763-d4ca-4f2a-8f5b-cfe730badad5 tempest-AttachVolumeShelveTestJSON-1055753500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.806s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:54:19 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-2f469763-d4ca-4f2a-8f5b-cfe730badad5 tempest-AttachVolumeShelveTestJSON-1055753500 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 21:54:19 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-2f469763-d4ca-4f2a-8f5b-cfe730badad5 tempest-AttachVolumeShelveTestJSON-1055753500 None] Deleted volume successfully. Sep 17 21:54:19 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-2f469763-d4ca-4f2a-8f5b-cfe730badad5 tempest-AttachVolumeShelveTestJSON-1055753500 None] Lock "cinder-f23e84fb-af8b-4136-ae5f-e44dd6a27212-delete_volume" released by "delete_volume" :: held 3.320s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 21:54:25 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-f0c35453-c6c7-4d09-9053-9b53c5ac40e3 tempest-ServerRescueNegativeTestJSON-1246269230 None] Acquiring lock "cinder-0e49ee08-1c79-4638-990c-939bae0cffa8-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 21:54:25 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-f0c35453-c6c7-4d09-9053-9b53c5ac40e3 tempest-ServerRescueNegativeTestJSON-1246269230 None] Lock "cinder-0e49ee08-1c79-4638-990c-939bae0cffa8-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 21:54:25 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-f0c35453-c6c7-4d09-9053-9b53c5ac40e3 tempest-ServerRescueNegativeTestJSON-1246269230 None] Acquiring lock "cinder-quobyte-0e49ee08-1c79-4638-990c-939bae0cffa8" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 21:54:25 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-f0c35453-c6c7-4d09-9053-9b53c5ac40e3 tempest-ServerRescueNegativeTestJSON-1246269230 None] Lock "cinder-quobyte-0e49ee08-1c79-4638-990c-939bae0cffa8" acquired by "delete_volume" :: waited 0.032s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 21:54:25 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[aedee2ff-626e-4bff-b622-3aee37b115a3]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 21:54:25 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-f0c35453-c6c7-4d09-9053-9b53c5ac40e3 tempest-ServerRescueNegativeTestJSON-1246269230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0e49ee08-1c79-4638-990c-939bae0cffa8 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:54:25 devstack sudo[90165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0e49ee08-1c79-4638-990c-939bae0cffa8 Sep 17 21:54:25 devstack sudo[90165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:54:26 devstack sudo[90165]: pam_unix(sudo:session): session closed for user root Sep 17 21:54:26 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-f0c35453-c6c7-4d09-9053-9b53c5ac40e3 tempest-ServerRescueNegativeTestJSON-1246269230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0e49ee08-1c79-4638-990c-939bae0cffa8" returned: 0 in 0.526s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:54:26 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-f0c35453-c6c7-4d09-9053-9b53c5ac40e3 tempest-ServerRescueNegativeTestJSON-1246269230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0e49ee08-1c79-4638-990c-939bae0cffa8 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:54:26 devstack sudo[90170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0e49ee08-1c79-4638-990c-939bae0cffa8 Sep 17 21:54:26 devstack sudo[90170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:54:26 devstack sudo[90170]: pam_unix(sudo:session): session closed for user root Sep 17 21:54:26 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-f0c35453-c6c7-4d09-9053-9b53c5ac40e3 tempest-ServerRescueNegativeTestJSON-1246269230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0e49ee08-1c79-4638-990c-939bae0cffa8" returned: 0 in 0.471s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:54:26 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-f0c35453-c6c7-4d09-9053-9b53c5ac40e3 tempest-ServerRescueNegativeTestJSON-1246269230 None] Lock "cinder-quobyte-0e49ee08-1c79-4638-990c-939bae0cffa8" released by "delete_volume" :: held 1.100s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 21:54:26 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-f0c35453-c6c7-4d09-9053-9b53c5ac40e3 tempest-ServerRescueNegativeTestJSON-1246269230 None] Created reservations ['ca5c67c1-df3b-4445-9c4f-f2967795ac47', '8f3bd93a-a734-41fa-a0b5-2edc6a60477d', '9a597804-7677-48f6-a899-58666060d800', 'efe7baa9-d2aa-48e5-8dce-6172c47af597'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 21:54:26 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-f0c35453-c6c7-4d09-9053-9b53c5ac40e3 tempest-ServerRescueNegativeTestJSON-1246269230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:54:26 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-f0c35453-c6c7-4d09-9053-9b53c5ac40e3 tempest-ServerRescueNegativeTestJSON-1246269230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:54:26 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-f0c35453-c6c7-4d09-9053-9b53c5ac40e3 tempest-ServerRescueNegativeTestJSON-1246269230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 21:54:26 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-f0c35453-c6c7-4d09-9053-9b53c5ac40e3 tempest-ServerRescueNegativeTestJSON-1246269230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 21:54:26 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-f0c35453-c6c7-4d09-9053-9b53c5ac40e3 tempest-ServerRescueNegativeTestJSON-1246269230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:54:26 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-f0c35453-c6c7-4d09-9053-9b53c5ac40e3 tempest-ServerRescueNegativeTestJSON-1246269230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:54:27 devstack sudo[90175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 21:54:27 devstack sudo[90175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:54:27 devstack sudo[90175]: pam_unix(sudo:session): session closed for user root Sep 17 21:54:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-f0c35453-c6c7-4d09-9053-9b53c5ac40e3 tempest-ServerRescueNegativeTestJSON-1246269230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.403s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:54:27 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-f0c35453-c6c7-4d09-9053-9b53c5ac40e3 tempest-ServerRescueNegativeTestJSON-1246269230 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 21:54:27 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-f0c35453-c6c7-4d09-9053-9b53c5ac40e3 tempest-ServerRescueNegativeTestJSON-1246269230 None] Deleted volume successfully. Sep 17 21:54:27 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-f0c35453-c6c7-4d09-9053-9b53c5ac40e3 tempest-ServerRescueNegativeTestJSON-1246269230 None] Lock "cinder-0e49ee08-1c79-4638-990c-939bae0cffa8-delete_volume" released by "delete_volume" :: held 1.939s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 21:54:27 devstack cinder-volume[85458]: DEBUG oslo_service.periodic_task [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85458) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 21:54:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:54:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:54:27 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 21:54:27 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 21:54:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:54:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:54:27 devstack sudo[90184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 21:54:27 devstack sudo[90184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:54:28 devstack sudo[90184]: pam_unix(sudo:session): session closed for user root Sep 17 21:54:28 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.920s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:54:28 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 21:54:28 devstack cinder-volume[85458]: DEBUG oslo_service.periodic_task [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Running periodic task VolumeManager._thread_info {{(pid=85458) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 21:54:28 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] thread count: 28 {{(pid=85458) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 21:54:28 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] thread info: [<_MainThread(MainThread, started 127546830999680)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85458) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 21:54:36 devstack cinder-volume[85458]: DEBUG dbcounter [-] [85458] Writing DB stats cinder:SELECT=28,cinder:UPDATE=29,cinder:INSERT=15,cinder:DELETE=1 {{(pid=85458) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 21:54:37 devstack cinder-volume[85458]: DEBUG dbcounter [-] [85458] Writing DB stats cinder:SELECT=29,cinder:INSERT=8,cinder:UPDATE=22,cinder:DELETE=3 {{(pid=85458) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 21:54:37 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-c67d6bd3-149b-4eaf-9d1d-993b9d36b6de tempest-AttachVolumeTestJSON-1856227952 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 21:54:37 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-c67d6bd3-149b-4eaf-9d1d-993b9d36b6de tempest-AttachVolumeTestJSON-1856227952 None] Flow 'volume_create_manager' (bde354f7-6270-4629-9cd0-42723168153f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 21:54:37 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-c67d6bd3-149b-4eaf-9d1d-993b9d36b6de tempest-AttachVolumeTestJSON-1856227952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (851edf88-b178-4a1e-811f-3e3b69194e72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:54:37 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-c67d6bd3-149b-4eaf-9d1d-993b9d36b6de tempest-AttachVolumeTestJSON-1856227952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (851edf88-b178-4a1e-811f-3e3b69194e72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T19:54:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1551697828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2191676c-a779-4ad0-8daa-de672f643aab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81918c7c6a5643b59650eebca8ab955a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T19:54:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T19:54:38Z,use_quota=True,user_id='c42559f054074fac9b7b532ae7d34658',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:54:37 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-c67d6bd3-149b-4eaf-9d1d-993b9d36b6de tempest-AttachVolumeTestJSON-1856227952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd6067d1-8a2a-45f9-b5e2-b04117c3f03e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:54:37 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-c67d6bd3-149b-4eaf-9d1d-993b9d36b6de tempest-AttachVolumeTestJSON-1856227952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd6067d1-8a2a-45f9-b5e2-b04117c3f03e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:54:37 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-c67d6bd3-149b-4eaf-9d1d-993b9d36b6de tempest-AttachVolumeTestJSON-1856227952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57a0c104-b505-4f18-b5be-9a392c7b0c0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:54:37 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-c67d6bd3-149b-4eaf-9d1d-993b9d36b6de tempest-AttachVolumeTestJSON-1856227952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57a0c104-b505-4f18-b5be-9a392c7b0c0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2191676c-a779-4ad0-8daa-de672f643aab', 'volume_name': 'volume-2191676c-a779-4ad0-8daa-de672f643aab', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:54:37 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-c67d6bd3-149b-4eaf-9d1d-993b9d36b6de tempest-AttachVolumeTestJSON-1856227952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d449828-10b0-47b2-8ac7-ae935a47073b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:54:37 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-c67d6bd3-149b-4eaf-9d1d-993b9d36b6de tempest-AttachVolumeTestJSON-1856227952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d449828-10b0-47b2-8ac7-ae935a47073b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:54:37 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-c67d6bd3-149b-4eaf-9d1d-993b9d36b6de tempest-AttachVolumeTestJSON-1856227952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b0cdcb6-d54e-4cda-8ba1-d1b8455fa9cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:54:37 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-c67d6bd3-149b-4eaf-9d1d-993b9d36b6de tempest-AttachVolumeTestJSON-1856227952 None] Volume 2191676c-a779-4ad0-8daa-de672f643aab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2191676c-a779-4ad0-8daa-de672f643aab', 'volume_size': 1} Sep 17 21:54:37 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-c67d6bd3-149b-4eaf-9d1d-993b9d36b6de tempest-AttachVolumeTestJSON-1856227952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:54:37 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-c67d6bd3-149b-4eaf-9d1d-993b9d36b6de tempest-AttachVolumeTestJSON-1856227952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:54:37 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-c67d6bd3-149b-4eaf-9d1d-993b9d36b6de tempest-AttachVolumeTestJSON-1856227952 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T19:54:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1551697828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2191676c-a779-4ad0-8daa-de672f643aab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81918c7c6a5643b59650eebca8ab955a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T19:54:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T19:54:38Z,use_quota=True,user_id='c42559f054074fac9b7b532ae7d34658',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 21:54:37 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-c67d6bd3-149b-4eaf-9d1d-993b9d36b6de tempest-AttachVolumeTestJSON-1856227952 None] Creating volume 2191676c-a779-4ad0-8daa-de672f643aab {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 21:54:37 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-c67d6bd3-149b-4eaf-9d1d-993b9d36b6de tempest-AttachVolumeTestJSON-1856227952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:54:37 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-c67d6bd3-149b-4eaf-9d1d-993b9d36b6de tempest-AttachVolumeTestJSON-1856227952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:54:37 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-c67d6bd3-149b-4eaf-9d1d-993b9d36b6de tempest-AttachVolumeTestJSON-1856227952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 21:54:37 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-c67d6bd3-149b-4eaf-9d1d-993b9d36b6de tempest-AttachVolumeTestJSON-1856227952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 21:54:37 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-c67d6bd3-149b-4eaf-9d1d-993b9d36b6de tempest-AttachVolumeTestJSON-1856227952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:54:37 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-c67d6bd3-149b-4eaf-9d1d-993b9d36b6de tempest-AttachVolumeTestJSON-1856227952 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 21:54:37 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-c67d6bd3-149b-4eaf-9d1d-993b9d36b6de tempest-AttachVolumeTestJSON-1856227952 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 21:54:37 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-c67d6bd3-149b-4eaf-9d1d-993b9d36b6de tempest-AttachVolumeTestJSON-1856227952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-2191676c-a779-4ad0-8daa-de672f643aab 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:54:37 devstack sudo[90295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-2191676c-a779-4ad0-8daa-de672f643aab 1073741824 Sep 17 21:54:37 devstack sudo[90295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:54:38 devstack sudo[90295]: pam_unix(sudo:session): session closed for user root Sep 17 21:54:38 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-c67d6bd3-149b-4eaf-9d1d-993b9d36b6de tempest-AttachVolumeTestJSON-1856227952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-2191676c-a779-4ad0-8daa-de672f643aab 1073741824" returned: 0 in 0.901s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:54:38 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-c67d6bd3-149b-4eaf-9d1d-993b9d36b6de tempest-AttachVolumeTestJSON-1856227952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-2191676c-a779-4ad0-8daa-de672f643aab {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:54:38 devstack sudo[90306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-2191676c-a779-4ad0-8daa-de672f643aab Sep 17 21:54:38 devstack sudo[90306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:54:39 devstack sudo[90306]: pam_unix(sudo:session): session closed for user root Sep 17 21:54:39 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-c67d6bd3-149b-4eaf-9d1d-993b9d36b6de tempest-AttachVolumeTestJSON-1856227952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-2191676c-a779-4ad0-8daa-de672f643aab" returned: 0 in 0.480s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:54:39 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-c67d6bd3-149b-4eaf-9d1d-993b9d36b6de tempest-AttachVolumeTestJSON-1856227952 None] <== create_volume: return (1502ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 21:54:39 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-c67d6bd3-149b-4eaf-9d1d-993b9d36b6de tempest-AttachVolumeTestJSON-1856227952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.509s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:54:39 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-c67d6bd3-149b-4eaf-9d1d-993b9d36b6de tempest-AttachVolumeTestJSON-1856227952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b0cdcb6-d54e-4cda-8ba1-d1b8455fa9cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2191676c-a779-4ad0-8daa-de672f643aab', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:54:39 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-c67d6bd3-149b-4eaf-9d1d-993b9d36b6de tempest-AttachVolumeTestJSON-1856227952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ca7a28e-a0ae-4495-9015-63abf17baa94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:54:39 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-c67d6bd3-149b-4eaf-9d1d-993b9d36b6de tempest-AttachVolumeTestJSON-1856227952 None] Volume volume-2191676c-a779-4ad0-8daa-de672f643aab (2191676c-a779-4ad0-8daa-de672f643aab): created successfully Sep 17 21:54:39 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-c67d6bd3-149b-4eaf-9d1d-993b9d36b6de tempest-AttachVolumeTestJSON-1856227952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ca7a28e-a0ae-4495-9015-63abf17baa94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:54:39 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-c67d6bd3-149b-4eaf-9d1d-993b9d36b6de tempest-AttachVolumeTestJSON-1856227952 None] Flow 'volume_create_manager' (bde354f7-6270-4629-9cd0-42723168153f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 21:54:39 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-c67d6bd3-149b-4eaf-9d1d-993b9d36b6de tempest-AttachVolumeTestJSON-1856227952 None] Created volume successfully. Sep 17 21:54:41 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [req-640b8f67-3262-4a25-bd61-db9b56b1dee0 req-32ef2282-d938-434a-97d3-db76a1962b8b tempest-AttachVolumeTestJSON-1856227952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:54:41 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [req-640b8f67-3262-4a25-bd61-db9b56b1dee0 req-32ef2282-d938-434a-97d3-db76a1962b8b tempest-AttachVolumeTestJSON-1856227952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:54:41 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [req-640b8f67-3262-4a25-bd61-db9b56b1dee0 req-32ef2282-d938-434a-97d3-db76a1962b8b tempest-AttachVolumeTestJSON-1856227952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:54:41 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [req-640b8f67-3262-4a25-bd61-db9b56b1dee0 req-32ef2282-d938-434a-97d3-db76a1962b8b tempest-AttachVolumeTestJSON-1856227952 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5', 'name': 'volume-2191676c-a779-4ad0-8daa-de672f643aab', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1d41010c-78fb-4de9-8ec0-6d0c3013a185', 'enforce_multipath': True} {{(pid=85458) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 21:54:42 devstack cinder-volume[85458]: INFO cinder.volume.manager [req-640b8f67-3262-4a25-bd61-db9b56b1dee0 req-32ef2282-d938-434a-97d3-db76a1962b8b tempest-AttachVolumeTestJSON-1856227952 None] attachment_update completed successfully. Sep 17 21:54:48 devstack cinder-volume[85458]: INFO cinder.volume.manager [req-ab094bde-4539-430b-ae94-d3d4e6ae1714 req-344bafb0-ca88-4bb0-a4c7-a4fd9dc9d7fb tempest-ServerActionsTestOtherA-1688039033 None] Terminate volume connection completed successfully. Sep 17 21:54:48 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [req-ab094bde-4539-430b-ae94-d3d4e6ae1714 req-344bafb0-ca88-4bb0-a4c7-a4fd9dc9d7fb tempest-ServerActionsTestOtherA-1688039033 None] Deleting attachment aebacc4e-a2e6-4230-af82-a5fa4f36b562. {{(pid=85458) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 21:54:52 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [req-ab094bde-4539-430b-ae94-d3d4e6ae1714 req-323710f1-1e23-4f73-bc07-daadd8a8c438 tempest-ServerActionsTestOtherA-1688039033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:54:52 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [req-ab094bde-4539-430b-ae94-d3d4e6ae1714 req-323710f1-1e23-4f73-bc07-daadd8a8c438 tempest-ServerActionsTestOtherA-1688039033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:54:52 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [req-ab094bde-4539-430b-ae94-d3d4e6ae1714 req-323710f1-1e23-4f73-bc07-daadd8a8c438 tempest-ServerActionsTestOtherA-1688039033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:54:53 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [req-ab094bde-4539-430b-ae94-d3d4e6ae1714 req-323710f1-1e23-4f73-bc07-daadd8a8c438 tempest-ServerActionsTestOtherA-1688039033 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5', 'name': 'volume-5c0d7f76-65e3-4200-bc1f-07932b86fdb6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '939ca208-d69f-4d17-97fa-9d8c8013dc1f', 'enforce_multipath': True} {{(pid=85458) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 21:54:53 devstack cinder-volume[85458]: INFO cinder.volume.manager [req-ab094bde-4539-430b-ae94-d3d4e6ae1714 req-323710f1-1e23-4f73-bc07-daadd8a8c438 tempest-ServerActionsTestOtherA-1688039033 None] attachment_update completed successfully. Sep 17 21:55:03 devstack cinder-volume[85458]: DEBUG dbcounter [-] [85458] Writing DB stats cinder:UPDATE=7,cinder:SELECT=11,cinder:DELETE=1 {{(pid=85458) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 21:55:03 devstack cinder-volume[85458]: DEBUG dbcounter [-] [85458] Writing DB stats cinder:SELECT=21,cinder:INSERT=1,cinder:UPDATE=5 {{(pid=85458) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 21:55:27 devstack cinder-volume[85458]: DEBUG oslo_service.periodic_task [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85458) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 21:55:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:55:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:55:27 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 21:55:27 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 21:55:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:55:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:55:27 devstack sudo[91719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 21:55:27 devstack sudo[91719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:55:28 devstack sudo[91719]: pam_unix(sudo:session): session closed for user root Sep 17 21:55:28 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.825s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:55:28 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 21:55:30 devstack cinder-volume[85458]: INFO cinder.volume.manager [req-3b126336-28fb-4693-91e1-4de84dde9a02 req-e0494ace-8b24-4d66-989a-0bfa5f17713b tempest-ServerActionsTestOtherA-1688039033 None] Terminate volume connection completed successfully. Sep 17 21:55:30 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [req-3b126336-28fb-4693-91e1-4de84dde9a02 req-e0494ace-8b24-4d66-989a-0bfa5f17713b tempest-ServerActionsTestOtherA-1688039033 None] Deleting attachment 939ca208-d69f-4d17-97fa-9d8c8013dc1f. {{(pid=85458) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 21:55:30 devstack cinder-volume[85458]: DEBUG cinder.coordination [req-3b126336-28fb-4693-91e1-4de84dde9a02 req-17c99b77-e9ff-43df-9772-9cab50dd22b4 tempest-ServerActionsTestOtherA-1688039033 None] Acquiring lock "cinder-5c0d7f76-65e3-4200-bc1f-07932b86fdb6-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 21:55:30 devstack cinder-volume[85458]: DEBUG cinder.coordination [req-3b126336-28fb-4693-91e1-4de84dde9a02 req-17c99b77-e9ff-43df-9772-9cab50dd22b4 tempest-ServerActionsTestOtherA-1688039033 None] Lock "cinder-5c0d7f76-65e3-4200-bc1f-07932b86fdb6-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 21:55:30 devstack cinder-volume[85458]: DEBUG cinder.coordination [req-3b126336-28fb-4693-91e1-4de84dde9a02 req-17c99b77-e9ff-43df-9772-9cab50dd22b4 tempest-ServerActionsTestOtherA-1688039033 None] Acquiring lock "cinder-quobyte-5c0d7f76-65e3-4200-bc1f-07932b86fdb6" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 21:55:30 devstack cinder-volume[85458]: DEBUG cinder.coordination [req-3b126336-28fb-4693-91e1-4de84dde9a02 req-17c99b77-e9ff-43df-9772-9cab50dd22b4 tempest-ServerActionsTestOtherA-1688039033 None] Lock "cinder-quobyte-5c0d7f76-65e3-4200-bc1f-07932b86fdb6" acquired by "delete_volume" :: waited 0.014s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 21:55:30 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[8595f341-bd6b-4006-9c72-179226feb887]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 21:55:30 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [req-3b126336-28fb-4693-91e1-4de84dde9a02 req-17c99b77-e9ff-43df-9772-9cab50dd22b4 tempest-ServerActionsTestOtherA-1688039033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-5c0d7f76-65e3-4200-bc1f-07932b86fdb6 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:55:31 devstack sudo[91787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-5c0d7f76-65e3-4200-bc1f-07932b86fdb6 Sep 17 21:55:31 devstack sudo[91787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:55:31 devstack sudo[91787]: pam_unix(sudo:session): session closed for user root Sep 17 21:55:31 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [req-3b126336-28fb-4693-91e1-4de84dde9a02 req-17c99b77-e9ff-43df-9772-9cab50dd22b4 tempest-ServerActionsTestOtherA-1688039033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-5c0d7f76-65e3-4200-bc1f-07932b86fdb6" returned: 0 in 0.468s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:55:31 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [req-3b126336-28fb-4693-91e1-4de84dde9a02 req-17c99b77-e9ff-43df-9772-9cab50dd22b4 tempest-ServerActionsTestOtherA-1688039033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-5c0d7f76-65e3-4200-bc1f-07932b86fdb6 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:55:31 devstack sudo[91792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-5c0d7f76-65e3-4200-bc1f-07932b86fdb6 Sep 17 21:55:31 devstack sudo[91792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:55:32 devstack sudo[91792]: pam_unix(sudo:session): session closed for user root Sep 17 21:55:32 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [req-3b126336-28fb-4693-91e1-4de84dde9a02 req-17c99b77-e9ff-43df-9772-9cab50dd22b4 tempest-ServerActionsTestOtherA-1688039033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-5c0d7f76-65e3-4200-bc1f-07932b86fdb6" returned: 0 in 0.912s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:55:32 devstack cinder-volume[85458]: DEBUG cinder.coordination [req-3b126336-28fb-4693-91e1-4de84dde9a02 req-17c99b77-e9ff-43df-9772-9cab50dd22b4 tempest-ServerActionsTestOtherA-1688039033 None] Lock "cinder-quobyte-5c0d7f76-65e3-4200-bc1f-07932b86fdb6" released by "delete_volume" :: held 1.461s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 21:55:32 devstack cinder-volume[85458]: DEBUG cinder.quota [req-3b126336-28fb-4693-91e1-4de84dde9a02 req-17c99b77-e9ff-43df-9772-9cab50dd22b4 tempest-ServerActionsTestOtherA-1688039033 None] Created reservations ['123c08bc-5dcf-41d0-8a46-47d424886200', 'a4b5340a-c48f-4ba3-afe5-54ea23d6af8b', '498055b4-b339-46da-8e24-e687cfe97538', 'ab17c679-be27-4395-9e14-164b98218ed7'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 21:55:32 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [req-3b126336-28fb-4693-91e1-4de84dde9a02 req-17c99b77-e9ff-43df-9772-9cab50dd22b4 tempest-ServerActionsTestOtherA-1688039033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:55:32 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [req-3b126336-28fb-4693-91e1-4de84dde9a02 req-17c99b77-e9ff-43df-9772-9cab50dd22b4 tempest-ServerActionsTestOtherA-1688039033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:55:32 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [req-3b126336-28fb-4693-91e1-4de84dde9a02 req-17c99b77-e9ff-43df-9772-9cab50dd22b4 tempest-ServerActionsTestOtherA-1688039033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 21:55:32 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [req-3b126336-28fb-4693-91e1-4de84dde9a02 req-17c99b77-e9ff-43df-9772-9cab50dd22b4 tempest-ServerActionsTestOtherA-1688039033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 21:55:32 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [req-3b126336-28fb-4693-91e1-4de84dde9a02 req-17c99b77-e9ff-43df-9772-9cab50dd22b4 tempest-ServerActionsTestOtherA-1688039033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:55:32 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [req-3b126336-28fb-4693-91e1-4de84dde9a02 req-17c99b77-e9ff-43df-9772-9cab50dd22b4 tempest-ServerActionsTestOtherA-1688039033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:55:32 devstack sudo[91833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 21:55:32 devstack sudo[91833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:55:33 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-aa5a4ffb-7a09-463a-bdbb-9a47f3f2af32 tempest-ServerActionsTestOtherA-1688039033 None] Acquiring lock "cinder-fb79f981-6a5d-45a5-960c-ded53c10cb48-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 21:55:33 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-aa5a4ffb-7a09-463a-bdbb-9a47f3f2af32 tempest-ServerActionsTestOtherA-1688039033 None] Lock "cinder-fb79f981-6a5d-45a5-960c-ded53c10cb48-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 21:55:33 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-aa5a4ffb-7a09-463a-bdbb-9a47f3f2af32 tempest-ServerActionsTestOtherA-1688039033 None] Acquiring lock "cinder-quobyte-fb79f981-6a5d-45a5-960c-ded53c10cb48" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 21:55:33 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-aa5a4ffb-7a09-463a-bdbb-9a47f3f2af32 tempest-ServerActionsTestOtherA-1688039033 None] Lock "cinder-quobyte-fb79f981-6a5d-45a5-960c-ded53c10cb48" acquired by "delete_volume" :: waited 0.048s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 21:55:33 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[1abd377a-4073-4180-aec6-37a50913ca86]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 21:55:33 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-aa5a4ffb-7a09-463a-bdbb-9a47f3f2af32 tempest-ServerActionsTestOtherA-1688039033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-fb79f981-6a5d-45a5-960c-ded53c10cb48 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:55:33 devstack sudo[91833]: pam_unix(sudo:session): session closed for user root Sep 17 21:55:33 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [req-3b126336-28fb-4693-91e1-4de84dde9a02 req-17c99b77-e9ff-43df-9772-9cab50dd22b4 tempest-ServerActionsTestOtherA-1688039033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.756s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:55:33 devstack cinder-volume[85458]: DEBUG cinder.manager [req-3b126336-28fb-4693-91e1-4de84dde9a02 req-17c99b77-e9ff-43df-9772-9cab50dd22b4 tempest-ServerActionsTestOtherA-1688039033 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 21:55:33 devstack cinder-volume[85458]: INFO cinder.volume.manager [req-3b126336-28fb-4693-91e1-4de84dde9a02 req-17c99b77-e9ff-43df-9772-9cab50dd22b4 tempest-ServerActionsTestOtherA-1688039033 None] Deleted volume successfully. Sep 17 21:55:33 devstack cinder-volume[85458]: DEBUG cinder.coordination [req-3b126336-28fb-4693-91e1-4de84dde9a02 req-17c99b77-e9ff-43df-9772-9cab50dd22b4 tempest-ServerActionsTestOtherA-1688039033 None] Lock "cinder-5c0d7f76-65e3-4200-bc1f-07932b86fdb6-delete_volume" released by "delete_volume" :: held 2.776s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 21:55:33 devstack sudo[91837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-fb79f981-6a5d-45a5-960c-ded53c10cb48 Sep 17 21:55:33 devstack sudo[91837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:55:34 devstack sudo[91837]: pam_unix(sudo:session): session closed for user root Sep 17 21:55:34 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-aa5a4ffb-7a09-463a-bdbb-9a47f3f2af32 tempest-ServerActionsTestOtherA-1688039033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-fb79f981-6a5d-45a5-960c-ded53c10cb48" returned: 0 in 1.044s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:55:34 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-aa5a4ffb-7a09-463a-bdbb-9a47f3f2af32 tempest-ServerActionsTestOtherA-1688039033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-fb79f981-6a5d-45a5-960c-ded53c10cb48 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:55:34 devstack sudo[91845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-fb79f981-6a5d-45a5-960c-ded53c10cb48 Sep 17 21:55:34 devstack sudo[91845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:55:35 devstack sudo[91845]: pam_unix(sudo:session): session closed for user root Sep 17 21:55:35 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-aa5a4ffb-7a09-463a-bdbb-9a47f3f2af32 tempest-ServerActionsTestOtherA-1688039033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-fb79f981-6a5d-45a5-960c-ded53c10cb48" returned: 0 in 0.636s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:55:35 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-aa5a4ffb-7a09-463a-bdbb-9a47f3f2af32 tempest-ServerActionsTestOtherA-1688039033 None] Lock "cinder-quobyte-fb79f981-6a5d-45a5-960c-ded53c10cb48" released by "delete_volume" :: held 1.786s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 21:55:35 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-aa5a4ffb-7a09-463a-bdbb-9a47f3f2af32 tempest-ServerActionsTestOtherA-1688039033 None] Created reservations ['5c607a1f-57c8-4464-888f-fec4548eb5e7', '93aa514c-c958-437e-9382-8256efa7b0c4', '1082c15c-44b7-4ddb-bc99-086b994dbc12', '7137c222-abc1-4bca-90a1-e626486864a5'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 21:55:35 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-aa5a4ffb-7a09-463a-bdbb-9a47f3f2af32 tempest-ServerActionsTestOtherA-1688039033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:55:35 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-aa5a4ffb-7a09-463a-bdbb-9a47f3f2af32 tempest-ServerActionsTestOtherA-1688039033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:55:35 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-aa5a4ffb-7a09-463a-bdbb-9a47f3f2af32 tempest-ServerActionsTestOtherA-1688039033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 21:55:35 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-aa5a4ffb-7a09-463a-bdbb-9a47f3f2af32 tempest-ServerActionsTestOtherA-1688039033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 21:55:35 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-aa5a4ffb-7a09-463a-bdbb-9a47f3f2af32 tempest-ServerActionsTestOtherA-1688039033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:55:35 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-aa5a4ffb-7a09-463a-bdbb-9a47f3f2af32 tempest-ServerActionsTestOtherA-1688039033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:55:35 devstack sudo[91850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 21:55:35 devstack sudo[91850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:55:36 devstack sudo[91850]: pam_unix(sudo:session): session closed for user root Sep 17 21:55:36 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-aa5a4ffb-7a09-463a-bdbb-9a47f3f2af32 tempest-ServerActionsTestOtherA-1688039033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.724s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:55:36 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-aa5a4ffb-7a09-463a-bdbb-9a47f3f2af32 tempest-ServerActionsTestOtherA-1688039033 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 21:55:36 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-aa5a4ffb-7a09-463a-bdbb-9a47f3f2af32 tempest-ServerActionsTestOtherA-1688039033 None] Deleted volume successfully. Sep 17 21:55:36 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-aa5a4ffb-7a09-463a-bdbb-9a47f3f2af32 tempest-ServerActionsTestOtherA-1688039033 None] Lock "cinder-fb79f981-6a5d-45a5-960c-ded53c10cb48-delete_volume" released by "delete_volume" :: held 2.915s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 21:55:36 devstack cinder-volume[85458]: INFO cinder.volume.manager [req-1ec1c3c2-f3f6-4877-9285-3cf5ce81e51a req-735aabcf-9926-4a40-805a-366447224996 tempest-AttachVolumeTestJSON-1856227952 None] Terminate volume connection completed successfully. Sep 17 21:55:36 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [req-1ec1c3c2-f3f6-4877-9285-3cf5ce81e51a req-735aabcf-9926-4a40-805a-366447224996 tempest-AttachVolumeTestJSON-1856227952 None] Deleting attachment 1d41010c-78fb-4de9-8ec0-6d0c3013a185. {{(pid=85458) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 21:55:38 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-60cd0c31-7736-41ad-9cbe-cf09463538ea tempest-AttachVolumeNegativeTest-28309225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 21:55:38 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-60cd0c31-7736-41ad-9cbe-cf09463538ea tempest-AttachVolumeNegativeTest-28309225 None] Flow 'volume_create_manager' (dfcbe078-31ef-4b3a-b195-efa1c738f160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 21:55:38 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-60cd0c31-7736-41ad-9cbe-cf09463538ea tempest-AttachVolumeNegativeTest-28309225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89eda3b9-9d22-43d4-942f-a870a7b7d171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:55:38 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-60cd0c31-7736-41ad-9cbe-cf09463538ea tempest-AttachVolumeNegativeTest-28309225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89eda3b9-9d22-43d4-942f-a870a7b7d171) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T19:55:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-754210081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59d6d975-33c3-4693-affa-fadb162f9f7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec04416ff169406d84ffb9bc4ca1646e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T19:55:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T19:55:38Z,use_quota=True,user_id='fd944f203df44249aaf302f096d6a77d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:55:38 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-60cd0c31-7736-41ad-9cbe-cf09463538ea tempest-AttachVolumeNegativeTest-28309225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (043a79e9-9592-4238-993d-39e98ea563fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:55:38 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-60cd0c31-7736-41ad-9cbe-cf09463538ea tempest-AttachVolumeNegativeTest-28309225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (043a79e9-9592-4238-993d-39e98ea563fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:55:38 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-60cd0c31-7736-41ad-9cbe-cf09463538ea tempest-AttachVolumeNegativeTest-28309225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea306b84-72a6-4e52-bddd-395b673c93e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:55:38 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-60cd0c31-7736-41ad-9cbe-cf09463538ea tempest-AttachVolumeNegativeTest-28309225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea306b84-72a6-4e52-bddd-395b673c93e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59d6d975-33c3-4693-affa-fadb162f9f7e', 'volume_name': 'volume-59d6d975-33c3-4693-affa-fadb162f9f7e', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:55:38 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-60cd0c31-7736-41ad-9cbe-cf09463538ea tempest-AttachVolumeNegativeTest-28309225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48d76acf-c4b2-43bb-b2ee-554834559721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:55:38 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-60cd0c31-7736-41ad-9cbe-cf09463538ea tempest-AttachVolumeNegativeTest-28309225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48d76acf-c4b2-43bb-b2ee-554834559721) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:55:38 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-60cd0c31-7736-41ad-9cbe-cf09463538ea tempest-AttachVolumeNegativeTest-28309225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52584112-af3a-40fa-8a3c-0a1b3058e655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:55:38 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-60cd0c31-7736-41ad-9cbe-cf09463538ea tempest-AttachVolumeNegativeTest-28309225 None] Volume 59d6d975-33c3-4693-affa-fadb162f9f7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59d6d975-33c3-4693-affa-fadb162f9f7e', 'volume_size': 1} Sep 17 21:55:38 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-60cd0c31-7736-41ad-9cbe-cf09463538ea tempest-AttachVolumeNegativeTest-28309225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:55:38 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-60cd0c31-7736-41ad-9cbe-cf09463538ea tempest-AttachVolumeNegativeTest-28309225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:55:38 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-60cd0c31-7736-41ad-9cbe-cf09463538ea tempest-AttachVolumeNegativeTest-28309225 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T19:55:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-754210081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59d6d975-33c3-4693-affa-fadb162f9f7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec04416ff169406d84ffb9bc4ca1646e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T19:55:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T19:55:38Z,use_quota=True,user_id='fd944f203df44249aaf302f096d6a77d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 21:55:38 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-60cd0c31-7736-41ad-9cbe-cf09463538ea tempest-AttachVolumeNegativeTest-28309225 None] Creating volume 59d6d975-33c3-4693-affa-fadb162f9f7e {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 21:55:38 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-60cd0c31-7736-41ad-9cbe-cf09463538ea tempest-AttachVolumeNegativeTest-28309225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:55:38 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-60cd0c31-7736-41ad-9cbe-cf09463538ea tempest-AttachVolumeNegativeTest-28309225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:55:38 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-60cd0c31-7736-41ad-9cbe-cf09463538ea tempest-AttachVolumeNegativeTest-28309225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 21:55:38 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-60cd0c31-7736-41ad-9cbe-cf09463538ea tempest-AttachVolumeNegativeTest-28309225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 21:55:38 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-60cd0c31-7736-41ad-9cbe-cf09463538ea tempest-AttachVolumeNegativeTest-28309225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:55:38 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-60cd0c31-7736-41ad-9cbe-cf09463538ea tempest-AttachVolumeNegativeTest-28309225 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 21:55:38 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-60cd0c31-7736-41ad-9cbe-cf09463538ea tempest-AttachVolumeNegativeTest-28309225 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 21:55:38 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-60cd0c31-7736-41ad-9cbe-cf09463538ea tempest-AttachVolumeNegativeTest-28309225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-59d6d975-33c3-4693-affa-fadb162f9f7e 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:55:38 devstack sudo[91946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-59d6d975-33c3-4693-affa-fadb162f9f7e 1073741824 Sep 17 21:55:38 devstack sudo[91946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:55:39 devstack sudo[91946]: pam_unix(sudo:session): session closed for user root Sep 17 21:55:39 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-60cd0c31-7736-41ad-9cbe-cf09463538ea tempest-AttachVolumeNegativeTest-28309225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-59d6d975-33c3-4693-affa-fadb162f9f7e 1073741824" returned: 0 in 0.565s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:55:39 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-60cd0c31-7736-41ad-9cbe-cf09463538ea tempest-AttachVolumeNegativeTest-28309225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-59d6d975-33c3-4693-affa-fadb162f9f7e {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:55:39 devstack sudo[91953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-59d6d975-33c3-4693-affa-fadb162f9f7e Sep 17 21:55:39 devstack sudo[91953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:55:39 devstack sudo[91953]: pam_unix(sudo:session): session closed for user root Sep 17 21:55:39 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-60cd0c31-7736-41ad-9cbe-cf09463538ea tempest-AttachVolumeNegativeTest-28309225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-59d6d975-33c3-4693-affa-fadb162f9f7e" returned: 0 in 0.307s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:55:39 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-60cd0c31-7736-41ad-9cbe-cf09463538ea tempest-AttachVolumeNegativeTest-28309225 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 21:55:39 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-60cd0c31-7736-41ad-9cbe-cf09463538ea tempest-AttachVolumeNegativeTest-28309225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:55:39 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-60cd0c31-7736-41ad-9cbe-cf09463538ea tempest-AttachVolumeNegativeTest-28309225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52584112-af3a-40fa-8a3c-0a1b3058e655) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59d6d975-33c3-4693-affa-fadb162f9f7e', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:55:39 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-60cd0c31-7736-41ad-9cbe-cf09463538ea tempest-AttachVolumeNegativeTest-28309225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02c0a327-aae6-45ff-b538-e57390eacdc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:55:39 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-60cd0c31-7736-41ad-9cbe-cf09463538ea tempest-AttachVolumeNegativeTest-28309225 None] Volume volume-59d6d975-33c3-4693-affa-fadb162f9f7e (59d6d975-33c3-4693-affa-fadb162f9f7e): created successfully Sep 17 21:55:39 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-60cd0c31-7736-41ad-9cbe-cf09463538ea tempest-AttachVolumeNegativeTest-28309225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02c0a327-aae6-45ff-b538-e57390eacdc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:55:39 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-60cd0c31-7736-41ad-9cbe-cf09463538ea tempest-AttachVolumeNegativeTest-28309225 None] Flow 'volume_create_manager' (dfcbe078-31ef-4b3a-b195-efa1c738f160) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 21:55:39 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-60cd0c31-7736-41ad-9cbe-cf09463538ea tempest-AttachVolumeNegativeTest-28309225 None] Created volume successfully. Sep 17 21:55:41 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-68e224ed-a286-4389-99ce-f555e1f64c14 tempest-ServersNegativeTestJSON-1272322022 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 21:55:41 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-68e224ed-a286-4389-99ce-f555e1f64c14 tempest-ServersNegativeTestJSON-1272322022 None] Flow 'volume_create_manager' (602247df-00d2-4bfb-af0d-5e19aacd06ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 21:55:41 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-68e224ed-a286-4389-99ce-f555e1f64c14 tempest-ServersNegativeTestJSON-1272322022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (854b8ea8-8610-4105-b38d-16668d6ff3a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:55:41 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-68e224ed-a286-4389-99ce-f555e1f64c14 tempest-ServersNegativeTestJSON-1272322022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (854b8ea8-8610-4105-b38d-16668d6ff3a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T19:55:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1577894158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a155706-0fe0-4915-b2b9-7b370a7874a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7722b6fe6f1e4bba9308cf33d0012110',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T19:55:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T19:55:41Z,use_quota=True,user_id='982db6dd70504969afd9c053a6f27650',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:55:41 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-68e224ed-a286-4389-99ce-f555e1f64c14 tempest-ServersNegativeTestJSON-1272322022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (314ea543-23d4-44d8-879d-58bbf6a038f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:55:41 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-68e224ed-a286-4389-99ce-f555e1f64c14 tempest-ServersNegativeTestJSON-1272322022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (314ea543-23d4-44d8-879d-58bbf6a038f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:55:41 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-68e224ed-a286-4389-99ce-f555e1f64c14 tempest-ServersNegativeTestJSON-1272322022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16e75ddb-48bb-4163-bfc6-65846036674c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:55:41 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-68e224ed-a286-4389-99ce-f555e1f64c14 tempest-ServersNegativeTestJSON-1272322022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16e75ddb-48bb-4163-bfc6-65846036674c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a155706-0fe0-4915-b2b9-7b370a7874a9', 'volume_name': 'volume-0a155706-0fe0-4915-b2b9-7b370a7874a9', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:55:41 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-68e224ed-a286-4389-99ce-f555e1f64c14 tempest-ServersNegativeTestJSON-1272322022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1c4f534-c309-40bc-b295-e5c9253658f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:55:41 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-68e224ed-a286-4389-99ce-f555e1f64c14 tempest-ServersNegativeTestJSON-1272322022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1c4f534-c309-40bc-b295-e5c9253658f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:55:41 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-68e224ed-a286-4389-99ce-f555e1f64c14 tempest-ServersNegativeTestJSON-1272322022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2edaeaeb-e02a-42a0-acbb-7b861faaaad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:55:41 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-68e224ed-a286-4389-99ce-f555e1f64c14 tempest-ServersNegativeTestJSON-1272322022 None] Volume 0a155706-0fe0-4915-b2b9-7b370a7874a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a155706-0fe0-4915-b2b9-7b370a7874a9', 'volume_size': 1} Sep 17 21:55:41 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-68e224ed-a286-4389-99ce-f555e1f64c14 tempest-ServersNegativeTestJSON-1272322022 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:55:41 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-68e224ed-a286-4389-99ce-f555e1f64c14 tempest-ServersNegativeTestJSON-1272322022 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:55:41 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-68e224ed-a286-4389-99ce-f555e1f64c14 tempest-ServersNegativeTestJSON-1272322022 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T19:55:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1577894158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a155706-0fe0-4915-b2b9-7b370a7874a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7722b6fe6f1e4bba9308cf33d0012110',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T19:55:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T19:55:41Z,use_quota=True,user_id='982db6dd70504969afd9c053a6f27650',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 21:55:41 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-68e224ed-a286-4389-99ce-f555e1f64c14 tempest-ServersNegativeTestJSON-1272322022 None] Creating volume 0a155706-0fe0-4915-b2b9-7b370a7874a9 {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 21:55:41 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-68e224ed-a286-4389-99ce-f555e1f64c14 tempest-ServersNegativeTestJSON-1272322022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:55:41 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-68e224ed-a286-4389-99ce-f555e1f64c14 tempest-ServersNegativeTestJSON-1272322022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:55:41 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-68e224ed-a286-4389-99ce-f555e1f64c14 tempest-ServersNegativeTestJSON-1272322022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 21:55:41 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-68e224ed-a286-4389-99ce-f555e1f64c14 tempest-ServersNegativeTestJSON-1272322022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 21:55:41 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-68e224ed-a286-4389-99ce-f555e1f64c14 tempest-ServersNegativeTestJSON-1272322022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:55:41 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-68e224ed-a286-4389-99ce-f555e1f64c14 tempest-ServersNegativeTestJSON-1272322022 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 21:55:41 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-68e224ed-a286-4389-99ce-f555e1f64c14 tempest-ServersNegativeTestJSON-1272322022 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 21:55:41 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-68e224ed-a286-4389-99ce-f555e1f64c14 tempest-ServersNegativeTestJSON-1272322022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0a155706-0fe0-4915-b2b9-7b370a7874a9 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:55:41 devstack sudo[91961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0a155706-0fe0-4915-b2b9-7b370a7874a9 1073741824 Sep 17 21:55:41 devstack sudo[91961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:55:41 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [req-767c7324-cc05-49c9-9683-37f2700d6296 req-37994f21-347c-4933-aef3-1444f791017a tempest-AttachVolumeNegativeTest-28309225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:55:41 devstack sudo[91961]: pam_unix(sudo:session): session closed for user root Sep 17 21:55:41 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-68e224ed-a286-4389-99ce-f555e1f64c14 tempest-ServersNegativeTestJSON-1272322022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0a155706-0fe0-4915-b2b9-7b370a7874a9 1073741824" returned: 0 in 0.780s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:55:42 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-68e224ed-a286-4389-99ce-f555e1f64c14 tempest-ServersNegativeTestJSON-1272322022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0a155706-0fe0-4915-b2b9-7b370a7874a9 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:55:42 devstack sudo[91994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0a155706-0fe0-4915-b2b9-7b370a7874a9 Sep 17 21:55:42 devstack sudo[91994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:55:42 devstack sudo[91994]: pam_unix(sudo:session): session closed for user root Sep 17 21:55:42 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-68e224ed-a286-4389-99ce-f555e1f64c14 tempest-ServersNegativeTestJSON-1272322022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0a155706-0fe0-4915-b2b9-7b370a7874a9" returned: 0 in 0.395s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:55:42 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-68e224ed-a286-4389-99ce-f555e1f64c14 tempest-ServersNegativeTestJSON-1272322022 None] <== create_volume: return (1249ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 21:55:42 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-68e224ed-a286-4389-99ce-f555e1f64c14 tempest-ServersNegativeTestJSON-1272322022 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.257s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:55:42 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [req-767c7324-cc05-49c9-9683-37f2700d6296 req-37994f21-347c-4933-aef3-1444f791017a tempest-AttachVolumeNegativeTest-28309225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.776s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:55:42 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-68e224ed-a286-4389-99ce-f555e1f64c14 tempest-ServersNegativeTestJSON-1272322022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2edaeaeb-e02a-42a0-acbb-7b861faaaad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a155706-0fe0-4915-b2b9-7b370a7874a9', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:55:42 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-68e224ed-a286-4389-99ce-f555e1f64c14 tempest-ServersNegativeTestJSON-1272322022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c5b54fb-1742-4ae2-96cb-3af7c44e907a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:55:42 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [req-767c7324-cc05-49c9-9683-37f2700d6296 req-37994f21-347c-4933-aef3-1444f791017a tempest-AttachVolumeNegativeTest-28309225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.049s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:55:42 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-68e224ed-a286-4389-99ce-f555e1f64c14 tempest-ServersNegativeTestJSON-1272322022 None] Volume volume-0a155706-0fe0-4915-b2b9-7b370a7874a9 (0a155706-0fe0-4915-b2b9-7b370a7874a9): created successfully Sep 17 21:55:42 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-68e224ed-a286-4389-99ce-f555e1f64c14 tempest-ServersNegativeTestJSON-1272322022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c5b54fb-1742-4ae2-96cb-3af7c44e907a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:55:42 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-68e224ed-a286-4389-99ce-f555e1f64c14 tempest-ServersNegativeTestJSON-1272322022 None] Flow 'volume_create_manager' (602247df-00d2-4bfb-af0d-5e19aacd06ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 21:55:42 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [req-767c7324-cc05-49c9-9683-37f2700d6296 req-37994f21-347c-4933-aef3-1444f791017a tempest-AttachVolumeNegativeTest-28309225 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5', 'name': 'volume-59d6d975-33c3-4693-affa-fadb162f9f7e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3379f260-fa16-4b07-afcc-5ad6a46f0187', 'enforce_multipath': True} {{(pid=85458) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 21:55:42 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-68e224ed-a286-4389-99ce-f555e1f64c14 tempest-ServersNegativeTestJSON-1272322022 None] Created volume successfully. Sep 17 21:55:42 devstack cinder-volume[85458]: INFO cinder.volume.manager [req-767c7324-cc05-49c9-9683-37f2700d6296 req-37994f21-347c-4933-aef3-1444f791017a tempest-AttachVolumeNegativeTest-28309225 None] attachment_update completed successfully. Sep 17 21:55:46 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-65e513d8-8da9-4e4b-b98f-79d682e16296 tempest-ServersNegativeTestJSON-1272322022 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 21:55:46 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-65e513d8-8da9-4e4b-b98f-79d682e16296 tempest-ServersNegativeTestJSON-1272322022 None] Flow 'volume_create_manager' (f255e39c-b24d-4184-9449-1607a08e61d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 21:55:46 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-65e513d8-8da9-4e4b-b98f-79d682e16296 tempest-ServersNegativeTestJSON-1272322022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc1e9da0-c695-4260-9bce-20661bc9d777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:55:46 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-65e513d8-8da9-4e4b-b98f-79d682e16296 tempest-ServersNegativeTestJSON-1272322022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc1e9da0-c695-4260-9bce-20661bc9d777) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T19:55:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1435758135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=128f9d7e-a8ec-43b2-833c-78796d2fbe1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7722b6fe6f1e4bba9308cf33d0012110',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T19:55:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T19:55:46Z,use_quota=True,user_id='982db6dd70504969afd9c053a6f27650',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:55:46 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-65e513d8-8da9-4e4b-b98f-79d682e16296 tempest-ServersNegativeTestJSON-1272322022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4baef11-3ee4-4900-ba42-7e6a8fe25efe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:55:46 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-65e513d8-8da9-4e4b-b98f-79d682e16296 tempest-ServersNegativeTestJSON-1272322022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4baef11-3ee4-4900-ba42-7e6a8fe25efe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:55:46 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-65e513d8-8da9-4e4b-b98f-79d682e16296 tempest-ServersNegativeTestJSON-1272322022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4e82451-4945-4f36-97b6-0699e0ce0d38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:55:46 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-65e513d8-8da9-4e4b-b98f-79d682e16296 tempest-ServersNegativeTestJSON-1272322022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4e82451-4945-4f36-97b6-0699e0ce0d38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '128f9d7e-a8ec-43b2-833c-78796d2fbe1b', 'volume_name': 'volume-128f9d7e-a8ec-43b2-833c-78796d2fbe1b', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:55:46 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-65e513d8-8da9-4e4b-b98f-79d682e16296 tempest-ServersNegativeTestJSON-1272322022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5c9f5e9-701f-4c8c-8538-0ceead676e7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:55:46 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-65e513d8-8da9-4e4b-b98f-79d682e16296 tempest-ServersNegativeTestJSON-1272322022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5c9f5e9-701f-4c8c-8538-0ceead676e7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:55:46 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-65e513d8-8da9-4e4b-b98f-79d682e16296 tempest-ServersNegativeTestJSON-1272322022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84ff0f18-93aa-4699-99ab-02980b26b895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:55:46 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-65e513d8-8da9-4e4b-b98f-79d682e16296 tempest-ServersNegativeTestJSON-1272322022 None] Volume 128f9d7e-a8ec-43b2-833c-78796d2fbe1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-128f9d7e-a8ec-43b2-833c-78796d2fbe1b', 'volume_size': 1} Sep 17 21:55:46 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-65e513d8-8da9-4e4b-b98f-79d682e16296 tempest-ServersNegativeTestJSON-1272322022 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:55:46 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-65e513d8-8da9-4e4b-b98f-79d682e16296 tempest-ServersNegativeTestJSON-1272322022 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:55:46 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-65e513d8-8da9-4e4b-b98f-79d682e16296 tempest-ServersNegativeTestJSON-1272322022 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T19:55:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1435758135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=128f9d7e-a8ec-43b2-833c-78796d2fbe1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7722b6fe6f1e4bba9308cf33d0012110',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T19:55:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T19:55:46Z,use_quota=True,user_id='982db6dd70504969afd9c053a6f27650',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 21:55:46 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-65e513d8-8da9-4e4b-b98f-79d682e16296 tempest-ServersNegativeTestJSON-1272322022 None] Creating volume 128f9d7e-a8ec-43b2-833c-78796d2fbe1b {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 21:55:46 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-65e513d8-8da9-4e4b-b98f-79d682e16296 tempest-ServersNegativeTestJSON-1272322022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:55:46 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-65e513d8-8da9-4e4b-b98f-79d682e16296 tempest-ServersNegativeTestJSON-1272322022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:55:46 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-65e513d8-8da9-4e4b-b98f-79d682e16296 tempest-ServersNegativeTestJSON-1272322022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 21:55:46 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-65e513d8-8da9-4e4b-b98f-79d682e16296 tempest-ServersNegativeTestJSON-1272322022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 21:55:46 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-65e513d8-8da9-4e4b-b98f-79d682e16296 tempest-ServersNegativeTestJSON-1272322022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:55:46 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-65e513d8-8da9-4e4b-b98f-79d682e16296 tempest-ServersNegativeTestJSON-1272322022 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 21:55:46 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-65e513d8-8da9-4e4b-b98f-79d682e16296 tempest-ServersNegativeTestJSON-1272322022 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 21:55:46 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-65e513d8-8da9-4e4b-b98f-79d682e16296 tempest-ServersNegativeTestJSON-1272322022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-128f9d7e-a8ec-43b2-833c-78796d2fbe1b 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:55:46 devstack sudo[92490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-128f9d7e-a8ec-43b2-833c-78796d2fbe1b 1073741824 Sep 17 21:55:46 devstack sudo[92490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:55:47 devstack sudo[92490]: pam_unix(sudo:session): session closed for user root Sep 17 21:55:47 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-65e513d8-8da9-4e4b-b98f-79d682e16296 tempest-ServersNegativeTestJSON-1272322022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-128f9d7e-a8ec-43b2-833c-78796d2fbe1b 1073741824" returned: 0 in 0.762s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:55:47 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-65e513d8-8da9-4e4b-b98f-79d682e16296 tempest-ServersNegativeTestJSON-1272322022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-128f9d7e-a8ec-43b2-833c-78796d2fbe1b {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:55:47 devstack sudo[92496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-128f9d7e-a8ec-43b2-833c-78796d2fbe1b Sep 17 21:55:47 devstack sudo[92496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:55:47 devstack sudo[92496]: pam_unix(sudo:session): session closed for user root Sep 17 21:55:47 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-65e513d8-8da9-4e4b-b98f-79d682e16296 tempest-ServersNegativeTestJSON-1272322022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-128f9d7e-a8ec-43b2-833c-78796d2fbe1b" returned: 0 in 0.472s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:55:47 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-65e513d8-8da9-4e4b-b98f-79d682e16296 tempest-ServersNegativeTestJSON-1272322022 None] <== create_volume: return (1288ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 21:55:47 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-65e513d8-8da9-4e4b-b98f-79d682e16296 tempest-ServersNegativeTestJSON-1272322022 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.292s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:55:47 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-65e513d8-8da9-4e4b-b98f-79d682e16296 tempest-ServersNegativeTestJSON-1272322022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84ff0f18-93aa-4699-99ab-02980b26b895) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-128f9d7e-a8ec-43b2-833c-78796d2fbe1b', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:55:47 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-65e513d8-8da9-4e4b-b98f-79d682e16296 tempest-ServersNegativeTestJSON-1272322022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bbe7287-e998-42ef-b01d-5e9b6a6f7846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:55:47 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-65e513d8-8da9-4e4b-b98f-79d682e16296 tempest-ServersNegativeTestJSON-1272322022 None] Volume volume-128f9d7e-a8ec-43b2-833c-78796d2fbe1b (128f9d7e-a8ec-43b2-833c-78796d2fbe1b): created successfully Sep 17 21:55:47 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-65e513d8-8da9-4e4b-b98f-79d682e16296 tempest-ServersNegativeTestJSON-1272322022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bbe7287-e998-42ef-b01d-5e9b6a6f7846) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:55:47 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-65e513d8-8da9-4e4b-b98f-79d682e16296 tempest-ServersNegativeTestJSON-1272322022 None] Flow 'volume_create_manager' (f255e39c-b24d-4184-9449-1607a08e61d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 21:55:47 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-65e513d8-8da9-4e4b-b98f-79d682e16296 tempest-ServersNegativeTestJSON-1272322022 None] Created volume successfully. Sep 17 21:55:48 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-746a8c6b-3f34-4f27-8181-238035b9ebfe tempest-ServersNegativeTestJSON-1272322022 None] Acquiring lock "cinder-128f9d7e-a8ec-43b2-833c-78796d2fbe1b-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 21:55:48 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-746a8c6b-3f34-4f27-8181-238035b9ebfe tempest-ServersNegativeTestJSON-1272322022 None] Lock "cinder-128f9d7e-a8ec-43b2-833c-78796d2fbe1b-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 21:55:48 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-746a8c6b-3f34-4f27-8181-238035b9ebfe tempest-ServersNegativeTestJSON-1272322022 None] Acquiring lock "cinder-quobyte-128f9d7e-a8ec-43b2-833c-78796d2fbe1b" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 21:55:48 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-746a8c6b-3f34-4f27-8181-238035b9ebfe tempest-ServersNegativeTestJSON-1272322022 None] Lock "cinder-quobyte-128f9d7e-a8ec-43b2-833c-78796d2fbe1b" acquired by "delete_volume" :: waited 0.024s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 21:55:48 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d9bccd6-ab89-4e66-9611-eed2b98fe4b6]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 21:55:48 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-746a8c6b-3f34-4f27-8181-238035b9ebfe tempest-ServersNegativeTestJSON-1272322022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-128f9d7e-a8ec-43b2-833c-78796d2fbe1b {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:55:49 devstack sudo[92502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-128f9d7e-a8ec-43b2-833c-78796d2fbe1b Sep 17 21:55:49 devstack sudo[92502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:55:49 devstack sudo[92502]: pam_unix(sudo:session): session closed for user root Sep 17 21:55:49 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-746a8c6b-3f34-4f27-8181-238035b9ebfe tempest-ServersNegativeTestJSON-1272322022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-128f9d7e-a8ec-43b2-833c-78796d2fbe1b" returned: 0 in 0.446s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:55:49 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-746a8c6b-3f34-4f27-8181-238035b9ebfe tempest-ServersNegativeTestJSON-1272322022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-128f9d7e-a8ec-43b2-833c-78796d2fbe1b {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:55:49 devstack sudo[92507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-128f9d7e-a8ec-43b2-833c-78796d2fbe1b Sep 17 21:55:49 devstack sudo[92507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:55:49 devstack sudo[92507]: pam_unix(sudo:session): session closed for user root Sep 17 21:55:49 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-746a8c6b-3f34-4f27-8181-238035b9ebfe tempest-ServersNegativeTestJSON-1272322022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-128f9d7e-a8ec-43b2-833c-78796d2fbe1b" returned: 0 in 0.436s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:55:49 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-746a8c6b-3f34-4f27-8181-238035b9ebfe tempest-ServersNegativeTestJSON-1272322022 None] Lock "cinder-quobyte-128f9d7e-a8ec-43b2-833c-78796d2fbe1b" released by "delete_volume" :: held 0.972s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 21:55:49 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-746a8c6b-3f34-4f27-8181-238035b9ebfe tempest-ServersNegativeTestJSON-1272322022 None] Created reservations ['09a442c3-2178-47b4-a73d-6e838aad6857', '6ae1d041-93cd-4417-8aae-2a4983887fba', 'f7e74af8-0c0a-4f88-b88f-5e25bc3aa567', 'b908d30a-4259-43b3-8273-e0d207b5fb5d'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 21:55:49 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-746a8c6b-3f34-4f27-8181-238035b9ebfe tempest-ServersNegativeTestJSON-1272322022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:55:49 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-746a8c6b-3f34-4f27-8181-238035b9ebfe tempest-ServersNegativeTestJSON-1272322022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:55:49 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-746a8c6b-3f34-4f27-8181-238035b9ebfe tempest-ServersNegativeTestJSON-1272322022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 21:55:50 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-746a8c6b-3f34-4f27-8181-238035b9ebfe tempest-ServersNegativeTestJSON-1272322022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 21:55:50 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-746a8c6b-3f34-4f27-8181-238035b9ebfe tempest-ServersNegativeTestJSON-1272322022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:55:50 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-746a8c6b-3f34-4f27-8181-238035b9ebfe tempest-ServersNegativeTestJSON-1272322022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:55:50 devstack sudo[92513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 21:55:50 devstack sudo[92513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:55:50 devstack sudo[92513]: pam_unix(sudo:session): session closed for user root Sep 17 21:55:50 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-746a8c6b-3f34-4f27-8181-238035b9ebfe tempest-ServersNegativeTestJSON-1272322022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.381s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:55:50 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-746a8c6b-3f34-4f27-8181-238035b9ebfe tempest-ServersNegativeTestJSON-1272322022 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 21:55:50 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-746a8c6b-3f34-4f27-8181-238035b9ebfe tempest-ServersNegativeTestJSON-1272322022 None] Deleted volume successfully. Sep 17 21:55:50 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-746a8c6b-3f34-4f27-8181-238035b9ebfe tempest-ServersNegativeTestJSON-1272322022 None] Lock "cinder-128f9d7e-a8ec-43b2-833c-78796d2fbe1b-delete_volume" released by "delete_volume" :: held 1.676s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 21:55:51 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-cac74cc6-0248-41f5-84b8-9d33a5582bf6 tempest-ServersNegativeTestJSON-1272322022 None] Acquiring lock "cinder-0a155706-0fe0-4915-b2b9-7b370a7874a9-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 21:55:51 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-cac74cc6-0248-41f5-84b8-9d33a5582bf6 tempest-ServersNegativeTestJSON-1272322022 None] Lock "cinder-0a155706-0fe0-4915-b2b9-7b370a7874a9-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 21:55:51 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-cac74cc6-0248-41f5-84b8-9d33a5582bf6 tempest-ServersNegativeTestJSON-1272322022 None] Acquiring lock "cinder-quobyte-0a155706-0fe0-4915-b2b9-7b370a7874a9" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 21:55:51 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-cac74cc6-0248-41f5-84b8-9d33a5582bf6 tempest-ServersNegativeTestJSON-1272322022 None] Lock "cinder-quobyte-0a155706-0fe0-4915-b2b9-7b370a7874a9" acquired by "delete_volume" :: waited 0.031s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 21:55:51 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c6e0cca-e8fb-47d1-a648-7c654a4e9a1c]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 21:55:51 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-cac74cc6-0248-41f5-84b8-9d33a5582bf6 tempest-ServersNegativeTestJSON-1272322022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0a155706-0fe0-4915-b2b9-7b370a7874a9 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:55:51 devstack sudo[92517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0a155706-0fe0-4915-b2b9-7b370a7874a9 Sep 17 21:55:51 devstack sudo[92517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:55:51 devstack sudo[92517]: pam_unix(sudo:session): session closed for user root Sep 17 21:55:51 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-cac74cc6-0248-41f5-84b8-9d33a5582bf6 tempest-ServersNegativeTestJSON-1272322022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0a155706-0fe0-4915-b2b9-7b370a7874a9" returned: 0 in 0.603s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:55:51 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-cac74cc6-0248-41f5-84b8-9d33a5582bf6 tempest-ServersNegativeTestJSON-1272322022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0a155706-0fe0-4915-b2b9-7b370a7874a9 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:55:51 devstack sudo[92523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0a155706-0fe0-4915-b2b9-7b370a7874a9 Sep 17 21:55:51 devstack sudo[92523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:55:52 devstack sudo[92523]: pam_unix(sudo:session): session closed for user root Sep 17 21:55:52 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-cac74cc6-0248-41f5-84b8-9d33a5582bf6 tempest-ServersNegativeTestJSON-1272322022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0a155706-0fe0-4915-b2b9-7b370a7874a9" returned: 0 in 0.435s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:55:52 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-cac74cc6-0248-41f5-84b8-9d33a5582bf6 tempest-ServersNegativeTestJSON-1272322022 None] Lock "cinder-quobyte-0a155706-0fe0-4915-b2b9-7b370a7874a9" released by "delete_volume" :: held 1.127s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 21:55:52 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-cac74cc6-0248-41f5-84b8-9d33a5582bf6 tempest-ServersNegativeTestJSON-1272322022 None] Created reservations ['41db736e-0ac6-4f39-a0bc-13dd495629e6', '45105de9-8773-4a7d-a328-26500742c5d2', '6d6cd94b-eae1-46f7-b2bd-4fccdeb3d3c1', '9d54469e-a7bb-49b2-a27e-8b3ad3633954'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 21:55:52 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-cac74cc6-0248-41f5-84b8-9d33a5582bf6 tempest-ServersNegativeTestJSON-1272322022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:55:52 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-cac74cc6-0248-41f5-84b8-9d33a5582bf6 tempest-ServersNegativeTestJSON-1272322022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:55:52 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-cac74cc6-0248-41f5-84b8-9d33a5582bf6 tempest-ServersNegativeTestJSON-1272322022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 21:55:52 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-cac74cc6-0248-41f5-84b8-9d33a5582bf6 tempest-ServersNegativeTestJSON-1272322022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 21:55:52 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-cac74cc6-0248-41f5-84b8-9d33a5582bf6 tempest-ServersNegativeTestJSON-1272322022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:55:52 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-cac74cc6-0248-41f5-84b8-9d33a5582bf6 tempest-ServersNegativeTestJSON-1272322022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:55:52 devstack sudo[92537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 21:55:52 devstack sudo[92537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:55:53 devstack sudo[92537]: pam_unix(sudo:session): session closed for user root Sep 17 21:55:53 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-cac74cc6-0248-41f5-84b8-9d33a5582bf6 tempest-ServersNegativeTestJSON-1272322022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.447s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:55:53 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-cac74cc6-0248-41f5-84b8-9d33a5582bf6 tempest-ServersNegativeTestJSON-1272322022 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 21:55:53 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-cac74cc6-0248-41f5-84b8-9d33a5582bf6 tempest-ServersNegativeTestJSON-1272322022 None] Deleted volume successfully. Sep 17 21:55:53 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-cac74cc6-0248-41f5-84b8-9d33a5582bf6 tempest-ServersNegativeTestJSON-1272322022 None] Lock "cinder-0a155706-0fe0-4915-b2b9-7b370a7874a9-delete_volume" released by "delete_volume" :: held 1.966s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 21:55:54 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [req-1d984713-505f-4a85-9965-dc27283b755f req-89125caa-f076-470d-9d65-a0032a398dfb tempest-VolumesGetTestJSON-1161408715 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 21:55:54 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [req-1d984713-505f-4a85-9965-dc27283b755f req-89125caa-f076-470d-9d65-a0032a398dfb tempest-VolumesGetTestJSON-1161408715 None] Flow 'volume_create_manager' (6a1e29b1-8a8d-4c19-afff-00ea18aa864a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 21:55:54 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [req-1d984713-505f-4a85-9965-dc27283b755f req-89125caa-f076-470d-9d65-a0032a398dfb tempest-VolumesGetTestJSON-1161408715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d18c7775-e695-4098-b295-5b816911c87b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:55:54 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [req-1d984713-505f-4a85-9965-dc27283b755f req-89125caa-f076-470d-9d65-a0032a398dfb tempest-VolumesGetTestJSON-1161408715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d18c7775-e695-4098-b295-5b816911c87b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T19:55:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-865702006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=454cda76-6443-4756-8496-89a0b5f15bc2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b8fc91246a8f44769b7e15b34ac1aaf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T19:55:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T19:55:54Z,use_quota=True,user_id='8188da971ef84a309dcd24aef5899c25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:55:54 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [req-1d984713-505f-4a85-9965-dc27283b755f req-89125caa-f076-470d-9d65-a0032a398dfb tempest-VolumesGetTestJSON-1161408715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cea0fbe-d788-473e-bb6e-14c186af5f26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:55:54 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [req-1d984713-505f-4a85-9965-dc27283b755f req-89125caa-f076-470d-9d65-a0032a398dfb tempest-VolumesGetTestJSON-1161408715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cea0fbe-d788-473e-bb6e-14c186af5f26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:55:54 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [req-1d984713-505f-4a85-9965-dc27283b755f req-89125caa-f076-470d-9d65-a0032a398dfb tempest-VolumesGetTestJSON-1161408715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70c1cbaf-cb04-456a-a614-970db2c0c671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:55:54 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [req-1d984713-505f-4a85-9965-dc27283b755f req-89125caa-f076-470d-9d65-a0032a398dfb tempest-VolumesGetTestJSON-1161408715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70c1cbaf-cb04-456a-a614-970db2c0c671) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '454cda76-6443-4756-8496-89a0b5f15bc2', 'volume_name': 'volume-454cda76-6443-4756-8496-89a0b5f15bc2', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:55:54 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [req-1d984713-505f-4a85-9965-dc27283b755f req-89125caa-f076-470d-9d65-a0032a398dfb tempest-VolumesGetTestJSON-1161408715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cab7d621-7dcf-4291-8852-d4eb820ebc82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:55:54 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [req-1d984713-505f-4a85-9965-dc27283b755f req-89125caa-f076-470d-9d65-a0032a398dfb tempest-VolumesGetTestJSON-1161408715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cab7d621-7dcf-4291-8852-d4eb820ebc82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:55:54 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [req-1d984713-505f-4a85-9965-dc27283b755f req-89125caa-f076-470d-9d65-a0032a398dfb tempest-VolumesGetTestJSON-1161408715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b76bb167-3653-4bc9-b70b-9b2690ba6611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:55:54 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [req-1d984713-505f-4a85-9965-dc27283b755f req-89125caa-f076-470d-9d65-a0032a398dfb tempest-VolumesGetTestJSON-1161408715 None] Volume 454cda76-6443-4756-8496-89a0b5f15bc2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-454cda76-6443-4756-8496-89a0b5f15bc2', 'volume_size': 1} Sep 17 21:55:54 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [req-1d984713-505f-4a85-9965-dc27283b755f req-89125caa-f076-470d-9d65-a0032a398dfb tempest-VolumesGetTestJSON-1161408715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:55:54 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [req-1d984713-505f-4a85-9965-dc27283b755f req-89125caa-f076-470d-9d65-a0032a398dfb tempest-VolumesGetTestJSON-1161408715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:55:54 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [req-1d984713-505f-4a85-9965-dc27283b755f req-89125caa-f076-470d-9d65-a0032a398dfb tempest-VolumesGetTestJSON-1161408715 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T19:55:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-865702006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=454cda76-6443-4756-8496-89a0b5f15bc2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b8fc91246a8f44769b7e15b34ac1aaf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T19:55:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T19:55:54Z,use_quota=True,user_id='8188da971ef84a309dcd24aef5899c25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 21:55:54 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [req-1d984713-505f-4a85-9965-dc27283b755f req-89125caa-f076-470d-9d65-a0032a398dfb tempest-VolumesGetTestJSON-1161408715 None] Creating volume 454cda76-6443-4756-8496-89a0b5f15bc2 {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 21:55:54 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [req-1d984713-505f-4a85-9965-dc27283b755f req-89125caa-f076-470d-9d65-a0032a398dfb tempest-VolumesGetTestJSON-1161408715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:55:54 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [req-1d984713-505f-4a85-9965-dc27283b755f req-89125caa-f076-470d-9d65-a0032a398dfb tempest-VolumesGetTestJSON-1161408715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:55:54 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [req-1d984713-505f-4a85-9965-dc27283b755f req-89125caa-f076-470d-9d65-a0032a398dfb tempest-VolumesGetTestJSON-1161408715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 21:55:54 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [req-1d984713-505f-4a85-9965-dc27283b755f req-89125caa-f076-470d-9d65-a0032a398dfb tempest-VolumesGetTestJSON-1161408715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 21:55:54 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [req-1d984713-505f-4a85-9965-dc27283b755f req-89125caa-f076-470d-9d65-a0032a398dfb tempest-VolumesGetTestJSON-1161408715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:55:54 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [req-1d984713-505f-4a85-9965-dc27283b755f req-89125caa-f076-470d-9d65-a0032a398dfb tempest-VolumesGetTestJSON-1161408715 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 21:55:54 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [req-1d984713-505f-4a85-9965-dc27283b755f req-89125caa-f076-470d-9d65-a0032a398dfb tempest-VolumesGetTestJSON-1161408715 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 21:55:54 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [req-1d984713-505f-4a85-9965-dc27283b755f req-89125caa-f076-470d-9d65-a0032a398dfb tempest-VolumesGetTestJSON-1161408715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-454cda76-6443-4756-8496-89a0b5f15bc2 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:55:54 devstack sudo[92546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-454cda76-6443-4756-8496-89a0b5f15bc2 1073741824 Sep 17 21:55:54 devstack sudo[92546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:55:55 devstack sudo[92546]: pam_unix(sudo:session): session closed for user root Sep 17 21:55:55 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [req-1d984713-505f-4a85-9965-dc27283b755f req-89125caa-f076-470d-9d65-a0032a398dfb tempest-VolumesGetTestJSON-1161408715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-454cda76-6443-4756-8496-89a0b5f15bc2 1073741824" returned: 0 in 0.880s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:55:55 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [req-1d984713-505f-4a85-9965-dc27283b755f req-89125caa-f076-470d-9d65-a0032a398dfb tempest-VolumesGetTestJSON-1161408715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-454cda76-6443-4756-8496-89a0b5f15bc2 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:55:55 devstack sudo[92571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-454cda76-6443-4756-8496-89a0b5f15bc2 Sep 17 21:55:55 devstack sudo[92571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:55:55 devstack sudo[92571]: pam_unix(sudo:session): session closed for user root Sep 17 21:55:55 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [req-1d984713-505f-4a85-9965-dc27283b755f req-89125caa-f076-470d-9d65-a0032a398dfb tempest-VolumesGetTestJSON-1161408715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-454cda76-6443-4756-8496-89a0b5f15bc2" returned: 0 in 0.438s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:55:55 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [req-1d984713-505f-4a85-9965-dc27283b755f req-89125caa-f076-470d-9d65-a0032a398dfb tempest-VolumesGetTestJSON-1161408715 None] <== create_volume: return (1401ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 21:55:55 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [req-1d984713-505f-4a85-9965-dc27283b755f req-89125caa-f076-470d-9d65-a0032a398dfb tempest-VolumesGetTestJSON-1161408715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.404s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:55:55 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [req-1d984713-505f-4a85-9965-dc27283b755f req-89125caa-f076-470d-9d65-a0032a398dfb tempest-VolumesGetTestJSON-1161408715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b76bb167-3653-4bc9-b70b-9b2690ba6611) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-454cda76-6443-4756-8496-89a0b5f15bc2', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:55:55 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [req-1d984713-505f-4a85-9965-dc27283b755f req-89125caa-f076-470d-9d65-a0032a398dfb tempest-VolumesGetTestJSON-1161408715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f0b1aac-28e2-40a4-862c-7b2c5af59113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:55:55 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [req-1d984713-505f-4a85-9965-dc27283b755f req-89125caa-f076-470d-9d65-a0032a398dfb tempest-VolumesGetTestJSON-1161408715 None] Volume volume-454cda76-6443-4756-8496-89a0b5f15bc2 (454cda76-6443-4756-8496-89a0b5f15bc2): created successfully Sep 17 21:55:55 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [req-1d984713-505f-4a85-9965-dc27283b755f req-89125caa-f076-470d-9d65-a0032a398dfb tempest-VolumesGetTestJSON-1161408715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f0b1aac-28e2-40a4-862c-7b2c5af59113) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:55:55 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [req-1d984713-505f-4a85-9965-dc27283b755f req-89125caa-f076-470d-9d65-a0032a398dfb tempest-VolumesGetTestJSON-1161408715 None] Flow 'volume_create_manager' (6a1e29b1-8a8d-4c19-afff-00ea18aa864a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 21:55:55 devstack cinder-volume[85458]: INFO cinder.volume.manager [req-1d984713-505f-4a85-9965-dc27283b755f req-89125caa-f076-470d-9d65-a0032a398dfb tempest-VolumesGetTestJSON-1161408715 None] Created volume successfully. Sep 17 21:55:56 devstack cinder-volume[85458]: DEBUG cinder.coordination [req-ad869359-0d5e-4108-a84f-d3cbf5bef4ce req-04b40f8c-4e4f-4c1c-9454-861b0c3318b4 tempest-VolumesGetTestJSON-1161408715 None] Acquiring lock "cinder-454cda76-6443-4756-8496-89a0b5f15bc2-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 21:55:56 devstack cinder-volume[85458]: DEBUG cinder.coordination [req-ad869359-0d5e-4108-a84f-d3cbf5bef4ce req-04b40f8c-4e4f-4c1c-9454-861b0c3318b4 tempest-VolumesGetTestJSON-1161408715 None] Lock "cinder-454cda76-6443-4756-8496-89a0b5f15bc2-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 21:55:56 devstack cinder-volume[85458]: DEBUG cinder.coordination [req-ad869359-0d5e-4108-a84f-d3cbf5bef4ce req-04b40f8c-4e4f-4c1c-9454-861b0c3318b4 tempest-VolumesGetTestJSON-1161408715 None] Acquiring lock "cinder-quobyte-454cda76-6443-4756-8496-89a0b5f15bc2" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 21:55:56 devstack cinder-volume[85458]: DEBUG cinder.coordination [req-ad869359-0d5e-4108-a84f-d3cbf5bef4ce req-04b40f8c-4e4f-4c1c-9454-861b0c3318b4 tempest-VolumesGetTestJSON-1161408715 None] Lock "cinder-quobyte-454cda76-6443-4756-8496-89a0b5f15bc2" acquired by "delete_volume" :: waited 0.040s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 21:55:56 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[d760b308-27b7-4505-a1ca-c1db29303f61]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 21:55:56 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [req-ad869359-0d5e-4108-a84f-d3cbf5bef4ce req-04b40f8c-4e4f-4c1c-9454-861b0c3318b4 tempest-VolumesGetTestJSON-1161408715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-454cda76-6443-4756-8496-89a0b5f15bc2 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:55:56 devstack sudo[92578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-454cda76-6443-4756-8496-89a0b5f15bc2 Sep 17 21:55:56 devstack sudo[92578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:55:57 devstack sudo[92578]: pam_unix(sudo:session): session closed for user root Sep 17 21:55:57 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [req-ad869359-0d5e-4108-a84f-d3cbf5bef4ce req-04b40f8c-4e4f-4c1c-9454-861b0c3318b4 tempest-VolumesGetTestJSON-1161408715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-454cda76-6443-4756-8496-89a0b5f15bc2" returned: 0 in 1.013s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:55:57 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [req-ad869359-0d5e-4108-a84f-d3cbf5bef4ce req-04b40f8c-4e4f-4c1c-9454-861b0c3318b4 tempest-VolumesGetTestJSON-1161408715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-454cda76-6443-4756-8496-89a0b5f15bc2 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:55:57 devstack sudo[92614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-454cda76-6443-4756-8496-89a0b5f15bc2 Sep 17 21:55:57 devstack sudo[92614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:55:58 devstack sudo[92614]: pam_unix(sudo:session): session closed for user root Sep 17 21:55:58 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [req-ad869359-0d5e-4108-a84f-d3cbf5bef4ce req-04b40f8c-4e4f-4c1c-9454-861b0c3318b4 tempest-VolumesGetTestJSON-1161408715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-454cda76-6443-4756-8496-89a0b5f15bc2" returned: 0 in 0.617s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:55:58 devstack cinder-volume[85458]: DEBUG cinder.coordination [req-ad869359-0d5e-4108-a84f-d3cbf5bef4ce req-04b40f8c-4e4f-4c1c-9454-861b0c3318b4 tempest-VolumesGetTestJSON-1161408715 None] Lock "cinder-quobyte-454cda76-6443-4756-8496-89a0b5f15bc2" released by "delete_volume" :: held 1.739s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 21:55:58 devstack cinder-volume[85458]: DEBUG cinder.quota [req-ad869359-0d5e-4108-a84f-d3cbf5bef4ce req-04b40f8c-4e4f-4c1c-9454-861b0c3318b4 tempest-VolumesGetTestJSON-1161408715 None] Created reservations ['737f01dd-d114-4f32-9164-97ea71a99557', '193ba3d7-221c-434a-851d-e5724f1783b1', 'd2509e89-84ef-4848-bde1-75f4a339af1e', '91790007-5fd9-4b5e-b6e3-29c8ce70d7b2'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 21:55:58 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [req-ad869359-0d5e-4108-a84f-d3cbf5bef4ce req-04b40f8c-4e4f-4c1c-9454-861b0c3318b4 tempest-VolumesGetTestJSON-1161408715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:55:58 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [req-ad869359-0d5e-4108-a84f-d3cbf5bef4ce req-04b40f8c-4e4f-4c1c-9454-861b0c3318b4 tempest-VolumesGetTestJSON-1161408715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:55:58 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [req-ad869359-0d5e-4108-a84f-d3cbf5bef4ce req-04b40f8c-4e4f-4c1c-9454-861b0c3318b4 tempest-VolumesGetTestJSON-1161408715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 21:55:58 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [req-ad869359-0d5e-4108-a84f-d3cbf5bef4ce req-04b40f8c-4e4f-4c1c-9454-861b0c3318b4 tempest-VolumesGetTestJSON-1161408715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 21:55:58 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [req-ad869359-0d5e-4108-a84f-d3cbf5bef4ce req-04b40f8c-4e4f-4c1c-9454-861b0c3318b4 tempest-VolumesGetTestJSON-1161408715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:55:58 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [req-ad869359-0d5e-4108-a84f-d3cbf5bef4ce req-04b40f8c-4e4f-4c1c-9454-861b0c3318b4 tempest-VolumesGetTestJSON-1161408715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:55:58 devstack sudo[92625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 21:55:58 devstack sudo[92625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:55:58 devstack sudo[92625]: pam_unix(sudo:session): session closed for user root Sep 17 21:55:58 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [req-ad869359-0d5e-4108-a84f-d3cbf5bef4ce req-04b40f8c-4e4f-4c1c-9454-861b0c3318b4 tempest-VolumesGetTestJSON-1161408715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.335s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:55:58 devstack cinder-volume[85458]: DEBUG cinder.manager [req-ad869359-0d5e-4108-a84f-d3cbf5bef4ce req-04b40f8c-4e4f-4c1c-9454-861b0c3318b4 tempest-VolumesGetTestJSON-1161408715 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 21:55:58 devstack cinder-volume[85458]: INFO cinder.volume.manager [req-ad869359-0d5e-4108-a84f-d3cbf5bef4ce req-04b40f8c-4e4f-4c1c-9454-861b0c3318b4 tempest-VolumesGetTestJSON-1161408715 None] Deleted volume successfully. Sep 17 21:55:58 devstack cinder-volume[85458]: DEBUG cinder.coordination [req-ad869359-0d5e-4108-a84f-d3cbf5bef4ce req-04b40f8c-4e4f-4c1c-9454-861b0c3318b4 tempest-VolumesGetTestJSON-1161408715 None] Lock "cinder-454cda76-6443-4756-8496-89a0b5f15bc2-delete_volume" released by "delete_volume" :: held 2.443s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 21:56:08 devstack cinder-volume[85458]: DEBUG dbcounter [-] [85458] Writing DB stats cinder:SELECT=45,cinder:UPDATE=57,cinder:INSERT=8,cinder:DELETE=4 {{(pid=85458) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 21:56:08 devstack cinder-volume[85458]: DEBUG dbcounter [-] [85458] Writing DB stats cinder:SELECT=38,cinder:INSERT=16,cinder:UPDATE=50,cinder:DELETE=5 {{(pid=85458) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 21:56:12 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-4b8ee5be-7935-42ab-82b0-cd42ef976611 tempest-GroupsTest-709256577 None] Group tempest-Group1-5712908: creating Sep 17 21:56:12 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-4b8ee5be-7935-42ab-82b0-cd42ef976611 tempest-GroupsTest-709256577 None] Group tempest-Group1-5712908: created successfully Sep 17 21:56:12 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-4b8ee5be-7935-42ab-82b0-cd42ef976611 tempest-GroupsTest-709256577 None] Create group completed successfully. Sep 17 21:56:13 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-b038701e-26f3-434f-aaac-5ae599879336 tempest-GroupsTest-709256577 None] Group tempest-Group2-368592266: creating Sep 17 21:56:13 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-b038701e-26f3-434f-aaac-5ae599879336 tempest-GroupsTest-709256577 None] Group tempest-Group2-368592266: created successfully Sep 17 21:56:13 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-b038701e-26f3-434f-aaac-5ae599879336 tempest-GroupsTest-709256577 None] Create group completed successfully. Sep 17 21:56:15 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-590617a5-3995-448e-b946-2df439a40b8d tempest-GroupsV314Test-1340436811 None] Group tempest-GroupsV314Test-Group-1240785991: creating Sep 17 21:56:15 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f5b83e0-6b3b-4789-929d-753f8bc793e6 tempest-GroupsTest-709256577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 21:56:15 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-7f5b83e0-6b3b-4789-929d-753f8bc793e6 tempest-GroupsTest-709256577 None] Flow 'volume_create_manager' (69d778fc-c218-4c25-b47f-84ee27cc52fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 21:56:15 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-7f5b83e0-6b3b-4789-929d-753f8bc793e6 tempest-GroupsTest-709256577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2484fe6f-9edc-4b3b-bf70-267d26221f7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:56:15 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-7f5b83e0-6b3b-4789-929d-753f8bc793e6 tempest-GroupsTest-709256577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2484fe6f-9edc-4b3b-bf70-267d26221f7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T19:56:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1336606031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d59ee7dc-6e3c-46c9-911b-0a973f8f6b78,host='devstack@QuobyteHD#QuobyteHD',id=772d234a-ea74-4c4c-a75f-215b85155f72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8a1c6d477ff4f058a524c5810918941',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T19:56:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T19:56:15Z,use_quota=True,user_id='f8279790f9174d519997466b0029e6db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ef7dd30-27f1-4df0-af0a-055515243585),volume_type_id=4ef7dd30-27f1-4df0-af0a-055515243585)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:56:15 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-7f5b83e0-6b3b-4789-929d-753f8bc793e6 tempest-GroupsTest-709256577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be1c7d93-a01a-4d82-a345-d883a1e4c34a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:56:15 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-7f5b83e0-6b3b-4789-929d-753f8bc793e6 tempest-GroupsTest-709256577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be1c7d93-a01a-4d82-a345-d883a1e4c34a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:56:15 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-7f5b83e0-6b3b-4789-929d-753f8bc793e6 tempest-GroupsTest-709256577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6c38261-7135-42db-8b4d-4ec4c2ddc902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:56:15 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-7f5b83e0-6b3b-4789-929d-753f8bc793e6 tempest-GroupsTest-709256577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6c38261-7135-42db-8b4d-4ec4c2ddc902) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '772d234a-ea74-4c4c-a75f-215b85155f72', 'volume_name': 'volume-772d234a-ea74-4c4c-a75f-215b85155f72', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:56:15 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-7f5b83e0-6b3b-4789-929d-753f8bc793e6 tempest-GroupsTest-709256577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d0f08f9-aa42-4941-8a5f-db14341c0ebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:56:15 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-7f5b83e0-6b3b-4789-929d-753f8bc793e6 tempest-GroupsTest-709256577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d0f08f9-aa42-4941-8a5f-db14341c0ebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:56:15 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-7f5b83e0-6b3b-4789-929d-753f8bc793e6 tempest-GroupsTest-709256577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bef5faa-440d-4010-bed1-e531cd28d645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:56:15 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-7f5b83e0-6b3b-4789-929d-753f8bc793e6 tempest-GroupsTest-709256577 None] Volume 772d234a-ea74-4c4c-a75f-215b85155f72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-772d234a-ea74-4c4c-a75f-215b85155f72', 'volume_size': 1} Sep 17 21:56:15 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-7f5b83e0-6b3b-4789-929d-753f8bc793e6 tempest-GroupsTest-709256577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:56:15 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-7f5b83e0-6b3b-4789-929d-753f8bc793e6 tempest-GroupsTest-709256577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:56:15 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-7f5b83e0-6b3b-4789-929d-753f8bc793e6 tempest-GroupsTest-709256577 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d59ee7dc-6e3c-46c9-911b-0a973f8f6b78,created_at=2026-09-17T19:56:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1336606031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d59ee7dc-6e3c-46c9-911b-0a973f8f6b78,host='devstack@QuobyteHD#QuobyteHD',id=772d234a-ea74-4c4c-a75f-215b85155f72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8a1c6d477ff4f058a524c5810918941',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T19:56:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T19:56:15Z,use_quota=True,user_id='f8279790f9174d519997466b0029e6db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ef7dd30-27f1-4df0-af0a-055515243585),volume_type_id=4ef7dd30-27f1-4df0-af0a-055515243585)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 21:56:15 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-7f5b83e0-6b3b-4789-929d-753f8bc793e6 tempest-GroupsTest-709256577 None] Creating volume 772d234a-ea74-4c4c-a75f-215b85155f72 {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 21:56:15 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-7f5b83e0-6b3b-4789-929d-753f8bc793e6 tempest-GroupsTest-709256577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:56:15 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-7f5b83e0-6b3b-4789-929d-753f8bc793e6 tempest-GroupsTest-709256577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:56:15 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-7f5b83e0-6b3b-4789-929d-753f8bc793e6 tempest-GroupsTest-709256577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 21:56:15 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-7f5b83e0-6b3b-4789-929d-753f8bc793e6 tempest-GroupsTest-709256577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 21:56:15 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-7f5b83e0-6b3b-4789-929d-753f8bc793e6 tempest-GroupsTest-709256577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:56:15 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-7f5b83e0-6b3b-4789-929d-753f8bc793e6 tempest-GroupsTest-709256577 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 21:56:15 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-7f5b83e0-6b3b-4789-929d-753f8bc793e6 tempest-GroupsTest-709256577 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 21:56:15 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-7f5b83e0-6b3b-4789-929d-753f8bc793e6 tempest-GroupsTest-709256577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-772d234a-ea74-4c4c-a75f-215b85155f72 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:56:15 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-590617a5-3995-448e-b946-2df439a40b8d tempest-GroupsV314Test-1340436811 None] Group tempest-GroupsV314Test-Group-1240785991: created successfully Sep 17 21:56:15 devstack sudo[92753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-772d234a-ea74-4c4c-a75f-215b85155f72 1073741824 Sep 17 21:56:15 devstack sudo[92753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:56:15 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-590617a5-3995-448e-b946-2df439a40b8d tempest-GroupsV314Test-1340436811 None] Create group completed successfully. Sep 17 21:56:15 devstack sudo[92753]: pam_unix(sudo:session): session closed for user root Sep 17 21:56:15 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-7f5b83e0-6b3b-4789-929d-753f8bc793e6 tempest-GroupsTest-709256577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-772d234a-ea74-4c4c-a75f-215b85155f72 1073741824" returned: 0 in 0.517s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:56:15 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-7f5b83e0-6b3b-4789-929d-753f8bc793e6 tempest-GroupsTest-709256577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-772d234a-ea74-4c4c-a75f-215b85155f72 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:56:15 devstack sudo[92762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-772d234a-ea74-4c4c-a75f-215b85155f72 Sep 17 21:56:15 devstack sudo[92762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:56:16 devstack sudo[92762]: pam_unix(sudo:session): session closed for user root Sep 17 21:56:16 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-7f5b83e0-6b3b-4789-929d-753f8bc793e6 tempest-GroupsTest-709256577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-772d234a-ea74-4c4c-a75f-215b85155f72" returned: 0 in 0.259s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:56:16 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-7f5b83e0-6b3b-4789-929d-753f8bc793e6 tempest-GroupsTest-709256577 None] <== create_volume: return (822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 21:56:16 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-7f5b83e0-6b3b-4789-929d-753f8bc793e6 tempest-GroupsTest-709256577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.825s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:56:16 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-7f5b83e0-6b3b-4789-929d-753f8bc793e6 tempest-GroupsTest-709256577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bef5faa-440d-4010-bed1-e531cd28d645) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-772d234a-ea74-4c4c-a75f-215b85155f72', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:56:16 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-7f5b83e0-6b3b-4789-929d-753f8bc793e6 tempest-GroupsTest-709256577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95470886-4bcb-4139-b235-26a7a870f43e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:56:16 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-7f5b83e0-6b3b-4789-929d-753f8bc793e6 tempest-GroupsTest-709256577 None] Volume volume-772d234a-ea74-4c4c-a75f-215b85155f72 (772d234a-ea74-4c4c-a75f-215b85155f72): created successfully Sep 17 21:56:16 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-7f5b83e0-6b3b-4789-929d-753f8bc793e6 tempest-GroupsTest-709256577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95470886-4bcb-4139-b235-26a7a870f43e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:56:16 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-7f5b83e0-6b3b-4789-929d-753f8bc793e6 tempest-GroupsTest-709256577 None] Flow 'volume_create_manager' (69d778fc-c218-4c25-b47f-84ee27cc52fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 21:56:16 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-7f5b83e0-6b3b-4789-929d-753f8bc793e6 tempest-GroupsTest-709256577 None] Created volume successfully. Sep 17 21:56:16 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-33bfe38c-b5de-4351-a06c-18f6a532e0d2 tempest-GroupsV314Test-1340436811 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 21:56:17 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-33bfe38c-b5de-4351-a06c-18f6a532e0d2 tempest-GroupsV314Test-1340436811 None] Flow 'volume_create_manager' (01a8751f-c793-407f-a6df-b3c4fbd729b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 21:56:17 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-33bfe38c-b5de-4351-a06c-18f6a532e0d2 tempest-GroupsV314Test-1340436811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b21f8d0a-45ac-4e71-9686-89eb9de1498e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:56:17 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-33bfe38c-b5de-4351-a06c-18f6a532e0d2 tempest-GroupsV314Test-1340436811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b21f8d0a-45ac-4e71-9686-89eb9de1498e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T19:56:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-752751738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5798fd0f-10f5-499a-809e-bd79770a6f3f,host='devstack@QuobyteHD#QuobyteHD',id=f39f8f65-668e-4ca9-b2b8-f399366f621f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='633dd078a6024f9691504b6670f7bfbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T19:56:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T19:56:17Z,use_quota=True,user_id='f092a5722d7247eea49f6a42585f26d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(836f6be2-ffa0-40bc-9641-67897ef07175),volume_type_id=836f6be2-ffa0-40bc-9641-67897ef07175)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:56:17 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-33bfe38c-b5de-4351-a06c-18f6a532e0d2 tempest-GroupsV314Test-1340436811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfd31b71-2ddc-4750-b339-82946ebfcaaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:56:17 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-33bfe38c-b5de-4351-a06c-18f6a532e0d2 tempest-GroupsV314Test-1340436811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfd31b71-2ddc-4750-b339-82946ebfcaaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:56:17 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-33bfe38c-b5de-4351-a06c-18f6a532e0d2 tempest-GroupsV314Test-1340436811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e26086eb-0233-4fef-9bc8-00cce89d8269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:56:17 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-33bfe38c-b5de-4351-a06c-18f6a532e0d2 tempest-GroupsV314Test-1340436811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e26086eb-0233-4fef-9bc8-00cce89d8269) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f39f8f65-668e-4ca9-b2b8-f399366f621f', 'volume_name': 'volume-f39f8f65-668e-4ca9-b2b8-f399366f621f', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:56:17 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-33bfe38c-b5de-4351-a06c-18f6a532e0d2 tempest-GroupsV314Test-1340436811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e77490af-d729-4515-8acb-31693a646469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:56:17 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-33bfe38c-b5de-4351-a06c-18f6a532e0d2 tempest-GroupsV314Test-1340436811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e77490af-d729-4515-8acb-31693a646469) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:56:17 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-33bfe38c-b5de-4351-a06c-18f6a532e0d2 tempest-GroupsV314Test-1340436811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f70bd58-9b83-45d0-8892-c3909106b933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:56:17 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-33bfe38c-b5de-4351-a06c-18f6a532e0d2 tempest-GroupsV314Test-1340436811 None] Volume f39f8f65-668e-4ca9-b2b8-f399366f621f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f39f8f65-668e-4ca9-b2b8-f399366f621f', 'volume_size': 1} Sep 17 21:56:17 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-33bfe38c-b5de-4351-a06c-18f6a532e0d2 tempest-GroupsV314Test-1340436811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:56:17 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-33bfe38c-b5de-4351-a06c-18f6a532e0d2 tempest-GroupsV314Test-1340436811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:56:17 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-33bfe38c-b5de-4351-a06c-18f6a532e0d2 tempest-GroupsV314Test-1340436811 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5798fd0f-10f5-499a-809e-bd79770a6f3f,created_at=2026-09-17T19:56:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-752751738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5798fd0f-10f5-499a-809e-bd79770a6f3f,host='devstack@QuobyteHD#QuobyteHD',id=f39f8f65-668e-4ca9-b2b8-f399366f621f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='633dd078a6024f9691504b6670f7bfbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T19:56:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T19:56:17Z,use_quota=True,user_id='f092a5722d7247eea49f6a42585f26d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(836f6be2-ffa0-40bc-9641-67897ef07175),volume_type_id=836f6be2-ffa0-40bc-9641-67897ef07175)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 21:56:17 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-33bfe38c-b5de-4351-a06c-18f6a532e0d2 tempest-GroupsV314Test-1340436811 None] Creating volume f39f8f65-668e-4ca9-b2b8-f399366f621f {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 21:56:17 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-33bfe38c-b5de-4351-a06c-18f6a532e0d2 tempest-GroupsV314Test-1340436811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:56:17 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-33bfe38c-b5de-4351-a06c-18f6a532e0d2 tempest-GroupsV314Test-1340436811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:56:17 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-33bfe38c-b5de-4351-a06c-18f6a532e0d2 tempest-GroupsV314Test-1340436811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 21:56:17 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-33bfe38c-b5de-4351-a06c-18f6a532e0d2 tempest-GroupsV314Test-1340436811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 21:56:17 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-33bfe38c-b5de-4351-a06c-18f6a532e0d2 tempest-GroupsV314Test-1340436811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:56:17 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-33bfe38c-b5de-4351-a06c-18f6a532e0d2 tempest-GroupsV314Test-1340436811 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 21:56:17 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-33bfe38c-b5de-4351-a06c-18f6a532e0d2 tempest-GroupsV314Test-1340436811 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 21:56:17 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-33bfe38c-b5de-4351-a06c-18f6a532e0d2 tempest-GroupsV314Test-1340436811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f39f8f65-668e-4ca9-b2b8-f399366f621f 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:56:17 devstack sudo[92766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f39f8f65-668e-4ca9-b2b8-f399366f621f 1073741824 Sep 17 21:56:17 devstack sudo[92766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:56:17 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-06d324ea-86c5-4f34-90b9-276fd63c7eb4 tempest-GroupsTest-709256577 None] Acquiring lock "cinder-quobyte-772d234a-ea74-4c4c-a75f-215b85155f72" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 21:56:17 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-06d324ea-86c5-4f34-90b9-276fd63c7eb4 tempest-GroupsTest-709256577 None] Lock "cinder-quobyte-772d234a-ea74-4c4c-a75f-215b85155f72" acquired by "delete_volume" :: waited 0.024s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 21:56:17 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[7175afe5-f080-4b4e-8f26-e6699f7a40f1]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 21:56:17 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-06d324ea-86c5-4f34-90b9-276fd63c7eb4 tempest-GroupsTest-709256577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-772d234a-ea74-4c4c-a75f-215b85155f72 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:56:17 devstack sudo[92773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-772d234a-ea74-4c4c-a75f-215b85155f72 Sep 17 21:56:17 devstack sudo[92773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:56:17 devstack sudo[92766]: pam_unix(sudo:session): session closed for user root Sep 17 21:56:17 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-33bfe38c-b5de-4351-a06c-18f6a532e0d2 tempest-GroupsV314Test-1340436811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f39f8f65-668e-4ca9-b2b8-f399366f621f 1073741824" returned: 0 in 0.623s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:56:17 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-33bfe38c-b5de-4351-a06c-18f6a532e0d2 tempest-GroupsV314Test-1340436811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f39f8f65-668e-4ca9-b2b8-f399366f621f {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:56:17 devstack sudo[92784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f39f8f65-668e-4ca9-b2b8-f399366f621f Sep 17 21:56:17 devstack sudo[92784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:56:17 devstack sudo[92773]: pam_unix(sudo:session): session closed for user root Sep 17 21:56:17 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-06d324ea-86c5-4f34-90b9-276fd63c7eb4 tempest-GroupsTest-709256577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-772d234a-ea74-4c4c-a75f-215b85155f72" returned: 0 in 0.505s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:56:17 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-06d324ea-86c5-4f34-90b9-276fd63c7eb4 tempest-GroupsTest-709256577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-772d234a-ea74-4c4c-a75f-215b85155f72 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:56:17 devstack sudo[92793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-772d234a-ea74-4c4c-a75f-215b85155f72 Sep 17 21:56:17 devstack sudo[92793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:56:18 devstack sudo[92784]: pam_unix(sudo:session): session closed for user root Sep 17 21:56:18 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-33bfe38c-b5de-4351-a06c-18f6a532e0d2 tempest-GroupsV314Test-1340436811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f39f8f65-668e-4ca9-b2b8-f399366f621f" returned: 0 in 0.342s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:56:18 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-33bfe38c-b5de-4351-a06c-18f6a532e0d2 tempest-GroupsV314Test-1340436811 None] <== create_volume: return (1030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 21:56:18 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-33bfe38c-b5de-4351-a06c-18f6a532e0d2 tempest-GroupsV314Test-1340436811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.033s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:56:18 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-33bfe38c-b5de-4351-a06c-18f6a532e0d2 tempest-GroupsV314Test-1340436811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f70bd58-9b83-45d0-8892-c3909106b933) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f39f8f65-668e-4ca9-b2b8-f399366f621f', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:56:18 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-33bfe38c-b5de-4351-a06c-18f6a532e0d2 tempest-GroupsV314Test-1340436811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4b42f5c-6650-45be-9eb2-657952b4ec3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:56:18 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-33bfe38c-b5de-4351-a06c-18f6a532e0d2 tempest-GroupsV314Test-1340436811 None] Volume volume-f39f8f65-668e-4ca9-b2b8-f399366f621f (f39f8f65-668e-4ca9-b2b8-f399366f621f): created successfully Sep 17 21:56:18 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-33bfe38c-b5de-4351-a06c-18f6a532e0d2 tempest-GroupsV314Test-1340436811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4b42f5c-6650-45be-9eb2-657952b4ec3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:56:18 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-33bfe38c-b5de-4351-a06c-18f6a532e0d2 tempest-GroupsV314Test-1340436811 None] Flow 'volume_create_manager' (01a8751f-c793-407f-a6df-b3c4fbd729b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 21:56:18 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-33bfe38c-b5de-4351-a06c-18f6a532e0d2 tempest-GroupsV314Test-1340436811 None] Created volume successfully. Sep 17 21:56:18 devstack sudo[92793]: pam_unix(sudo:session): session closed for user root Sep 17 21:56:18 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-06d324ea-86c5-4f34-90b9-276fd63c7eb4 tempest-GroupsTest-709256577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-772d234a-ea74-4c4c-a75f-215b85155f72" returned: 0 in 0.426s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:56:18 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-06d324ea-86c5-4f34-90b9-276fd63c7eb4 tempest-GroupsTest-709256577 None] Lock "cinder-quobyte-772d234a-ea74-4c4c-a75f-215b85155f72" released by "delete_volume" :: held 1.016s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 21:56:18 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-06d324ea-86c5-4f34-90b9-276fd63c7eb4 tempest-GroupsTest-709256577 None] Created reservations ['e5ab771f-f58a-4d30-8c03-6712407ceff0'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 21:56:18 devstack cinder-volume[85458]: WARNING cinder.quota [None req-06d324ea-86c5-4f34-90b9-276fd63c7eb4 tempest-GroupsTest-709256577 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1617458432 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1617458432, it is now deprecated. Please use the default quota class for default quota. Sep 17 21:56:18 devstack cinder-volume[85458]: WARNING cinder.quota [None req-06d324ea-86c5-4f34-90b9-276fd63c7eb4 tempest-GroupsTest-709256577 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1617458432 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1617458432, it is now deprecated. Please use the default quota class for default quota. Sep 17 21:56:18 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-06d324ea-86c5-4f34-90b9-276fd63c7eb4 tempest-GroupsTest-709256577 None] Created reservations ['e66d895a-385b-411f-a6fd-45335697071f', 'f380fdcd-0c14-40f5-9f20-76f793618b7b', '95d5743f-fa29-49d1-b9d7-47a17ec84d6a', '45a7caa5-0aa0-4895-97c4-a15e889742fc'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 21:56:18 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-06d324ea-86c5-4f34-90b9-276fd63c7eb4 tempest-GroupsTest-709256577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:56:18 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-06d324ea-86c5-4f34-90b9-276fd63c7eb4 tempest-GroupsTest-709256577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:56:18 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-06d324ea-86c5-4f34-90b9-276fd63c7eb4 tempest-GroupsTest-709256577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 21:56:18 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-06d324ea-86c5-4f34-90b9-276fd63c7eb4 tempest-GroupsTest-709256577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 21:56:18 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-06d324ea-86c5-4f34-90b9-276fd63c7eb4 tempest-GroupsTest-709256577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:56:18 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-06d324ea-86c5-4f34-90b9-276fd63c7eb4 tempest-GroupsTest-709256577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:56:18 devstack sudo[92801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 21:56:18 devstack sudo[92801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:56:19 devstack sudo[92801]: pam_unix(sudo:session): session closed for user root Sep 17 21:56:19 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-06d324ea-86c5-4f34-90b9-276fd63c7eb4 tempest-GroupsTest-709256577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.281s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:56:19 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-06d324ea-86c5-4f34-90b9-276fd63c7eb4 tempest-GroupsTest-709256577 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 21:56:19 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-06d324ea-86c5-4f34-90b9-276fd63c7eb4 tempest-GroupsTest-709256577 None] Delete group completed successfully. Sep 17 21:56:19 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-912fb66b-02ea-497c-a611-0335026e6564 tempest-GroupsV314Test-1340436811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:56:19 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-912fb66b-02ea-497c-a611-0335026e6564 tempest-GroupsV314Test-1340436811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:56:19 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-912fb66b-02ea-497c-a611-0335026e6564 tempest-GroupsV314Test-1340436811 None] Cloning volume f39f8f65-668e-4ca9-b2b8-f399366f621f to volume 2b2ead49-9948-400d-9938-eb63c19faf85 Sep 17 21:56:19 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-912fb66b-02ea-497c-a611-0335026e6564 tempest-GroupsV314Test-1340436811 None] Creating offline snapshot de9c340c-7ae5-4b6d-b874-8618c17199c9 of volume f39f8f65-668e-4ca9-b2b8-f399366f621f {{(pid=85458) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 21:56:19 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[179a5a70-1ca4-41fe-8b61-698966242943]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 21:56:19 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-912fb66b-02ea-497c-a611-0335026e6564 tempest-GroupsV314Test-1340436811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f39f8f65-668e-4ca9-b2b8-f399366f621f {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:56:19 devstack sudo[92804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f39f8f65-668e-4ca9-b2b8-f399366f621f Sep 17 21:56:19 devstack sudo[92804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:56:19 devstack sudo[92804]: pam_unix(sudo:session): session closed for user root Sep 17 21:56:19 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-912fb66b-02ea-497c-a611-0335026e6564 tempest-GroupsV314Test-1340436811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f39f8f65-668e-4ca9-b2b8-f399366f621f" returned: 0 in 0.428s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:56:19 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-912fb66b-02ea-497c-a611-0335026e6564 tempest-GroupsV314Test-1340436811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f39f8f65-668e-4ca9-b2b8-f399366f621f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f39f8f65-668e-4ca9-b2b8-f399366f621f.de9c340c-7ae5-4b6d-b874-8618c17199c9 1G {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:56:19 devstack sudo[92810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f39f8f65-668e-4ca9-b2b8-f399366f621f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f39f8f65-668e-4ca9-b2b8-f399366f621f.de9c340c-7ae5-4b6d-b874-8618c17199c9 1G Sep 17 21:56:19 devstack sudo[92810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:56:20 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-ddb0f099-2f6c-4b07-a1f0-5187878a4446 tempest-GroupsTest-709256577 None] Created reservations ['3584fe10-811b-4a5f-9518-b5bd3d7ad03d'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 21:56:20 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-ddb0f099-2f6c-4b07-a1f0-5187878a4446 tempest-GroupsTest-709256577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:56:20 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-ddb0f099-2f6c-4b07-a1f0-5187878a4446 tempest-GroupsTest-709256577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:56:20 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-ddb0f099-2f6c-4b07-a1f0-5187878a4446 tempest-GroupsTest-709256577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 21:56:20 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-ddb0f099-2f6c-4b07-a1f0-5187878a4446 tempest-GroupsTest-709256577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 21:56:20 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-ddb0f099-2f6c-4b07-a1f0-5187878a4446 tempest-GroupsTest-709256577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:56:20 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-ddb0f099-2f6c-4b07-a1f0-5187878a4446 tempest-GroupsTest-709256577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:56:20 devstack sudo[92815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 21:56:20 devstack sudo[92815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:56:20 devstack sudo[92810]: pam_unix(sudo:session): session closed for user root Sep 17 21:56:20 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-912fb66b-02ea-497c-a611-0335026e6564 tempest-GroupsV314Test-1340436811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f39f8f65-668e-4ca9-b2b8-f399366f621f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f39f8f65-668e-4ca9-b2b8-f399366f621f.de9c340c-7ae5-4b6d-b874-8618c17199c9 1G" returned: 0 in 0.640s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:56:20 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-912fb66b-02ea-497c-a611-0335026e6564 tempest-GroupsV314Test-1340436811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f39f8f65-668e-4ca9-b2b8-f399366f621f -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f39f8f65-668e-4ca9-b2b8-f399366f621f.de9c340c-7ae5-4b6d-b874-8618c17199c9 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:56:20 devstack sudo[92817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f39f8f65-668e-4ca9-b2b8-f399366f621f -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f39f8f65-668e-4ca9-b2b8-f399366f621f.de9c340c-7ae5-4b6d-b874-8618c17199c9 Sep 17 21:56:20 devstack sudo[92817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:56:20 devstack sudo[92815]: pam_unix(sudo:session): session closed for user root Sep 17 21:56:20 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-ddb0f099-2f6c-4b07-a1f0-5187878a4446 tempest-GroupsTest-709256577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.306s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:56:20 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-ddb0f099-2f6c-4b07-a1f0-5187878a4446 tempest-GroupsTest-709256577 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 21:56:20 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-ddb0f099-2f6c-4b07-a1f0-5187878a4446 tempest-GroupsTest-709256577 None] Delete group completed successfully. Sep 17 21:56:20 devstack sudo[92817]: pam_unix(sudo:session): session closed for user root Sep 17 21:56:20 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-912fb66b-02ea-497c-a611-0335026e6564 tempest-GroupsV314Test-1340436811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f39f8f65-668e-4ca9-b2b8-f399366f621f -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f39f8f65-668e-4ca9-b2b8-f399366f621f.de9c340c-7ae5-4b6d-b874-8618c17199c9" returned: 0 in 0.433s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:56:20 devstack cinder-volume[85458]: WARNING cinder.volume.drivers.remotefs [None req-912fb66b-02ea-497c-a611-0335026e6564 tempest-GroupsV314Test-1340436811 None] /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f39f8f65-668e-4ca9-b2b8-f399366f621f.de9c340c-7ae5-4b6d-b874-8618c17199c9 is being set with open permissions: ugo+rw: NotImplementedError Sep 17 21:56:20 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-912fb66b-02ea-497c-a611-0335026e6564 tempest-GroupsV314Test-1340436811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f39f8f65-668e-4ca9-b2b8-f399366f621f.de9c340c-7ae5-4b6d-b874-8618c17199c9 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:56:20 devstack sudo[92832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f39f8f65-668e-4ca9-b2b8-f399366f621f.de9c340c-7ae5-4b6d-b874-8618c17199c9 Sep 17 21:56:20 devstack sudo[92832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:56:21 devstack sudo[92832]: pam_unix(sudo:session): session closed for user root Sep 17 21:56:21 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-912fb66b-02ea-497c-a611-0335026e6564 tempest-GroupsV314Test-1340436811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f39f8f65-668e-4ca9-b2b8-f399366f621f.de9c340c-7ae5-4b6d-b874-8618c17199c9" returned: 0 in 0.615s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:56:21 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-912fb66b-02ea-497c-a611-0335026e6564 tempest-GroupsV314Test-1340436811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f39f8f65-668e-4ca9-b2b8-f399366f621f.info {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:56:21 devstack sudo[92881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f39f8f65-668e-4ca9-b2b8-f399366f621f.info Sep 17 21:56:21 devstack sudo[92881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:56:21 devstack sudo[92881]: pam_unix(sudo:session): session closed for user root Sep 17 21:56:21 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-912fb66b-02ea-497c-a611-0335026e6564 tempest-GroupsV314Test-1340436811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f39f8f65-668e-4ca9-b2b8-f399366f621f.info" returned: 0 in 0.554s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:56:21 devstack cinder-volume[85458]: WARNING cinder.volume.drivers.remotefs [None req-912fb66b-02ea-497c-a611-0335026e6564 tempest-GroupsV314Test-1340436811 None] /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f39f8f65-668e-4ca9-b2b8-f399366f621f.info is being set with open permissions: ugo+rw: NotImplementedError Sep 17 21:56:21 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-912fb66b-02ea-497c-a611-0335026e6564 tempest-GroupsV314Test-1340436811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f39f8f65-668e-4ca9-b2b8-f399366f621f.info {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:56:22 devstack sudo[92892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f39f8f65-668e-4ca9-b2b8-f399366f621f.info Sep 17 21:56:22 devstack sudo[92892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:56:22 devstack sudo[92892]: pam_unix(sudo:session): session closed for user root Sep 17 21:56:22 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-912fb66b-02ea-497c-a611-0335026e6564 tempest-GroupsV314Test-1340436811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f39f8f65-668e-4ca9-b2b8-f399366f621f.info" returned: 0 in 0.470s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:56:22 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-912fb66b-02ea-497c-a611-0335026e6564 tempest-GroupsV314Test-1340436811 None] Acquiring lock "cinder-quobyte-2b2ead49-9948-400d-9938-eb63c19faf85" by "_copy_volume_from_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 21:56:22 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-912fb66b-02ea-497c-a611-0335026e6564 tempest-GroupsV314Test-1340436811 None] Lock "cinder-quobyte-2b2ead49-9948-400d-9938-eb63c19faf85" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 21:56:22 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-912fb66b-02ea-497c-a611-0335026e6564 tempest-GroupsV314Test-1340436811 None] snapshot: de9c340c-7ae5-4b6d-b874-8618c17199c9, volume: 2b2ead49-9948-400d-9938-eb63c19faf85, {{(pid=85458) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 17 21:56:22 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-912fb66b-02ea-497c-a611-0335026e6564 tempest-GroupsV314Test-1340436811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:56:22 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-912fb66b-02ea-497c-a611-0335026e6564 tempest-GroupsV314Test-1340436811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:56:22 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-912fb66b-02ea-497c-a611-0335026e6564 tempest-GroupsV314Test-1340436811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 21:56:22 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-912fb66b-02ea-497c-a611-0335026e6564 tempest-GroupsV314Test-1340436811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 21:56:22 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-912fb66b-02ea-497c-a611-0335026e6564 tempest-GroupsV314Test-1340436811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:56:22 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[17351954-d789-4e87-9561-ca34f37215c9]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 21:56:22 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-912fb66b-02ea-497c-a611-0335026e6564 tempest-GroupsV314Test-1340436811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f39f8f65-668e-4ca9-b2b8-f399366f621f.de9c340c-7ae5-4b6d-b874-8618c17199c9 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:56:22 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-00a7e92b-2dbb-4f88-9f0c-29285f0dfbc3 tempest-GroupsTest-709256577 None] Group tempest-GroupsTest-Group-1196603409: creating Sep 17 21:56:22 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-00a7e92b-2dbb-4f88-9f0c-29285f0dfbc3 tempest-GroupsTest-709256577 None] Group tempest-GroupsTest-Group-1196603409: created successfully Sep 17 21:56:22 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-00a7e92b-2dbb-4f88-9f0c-29285f0dfbc3 tempest-GroupsTest-709256577 None] Create group completed successfully. Sep 17 21:56:22 devstack sudo[92899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f39f8f65-668e-4ca9-b2b8-f399366f621f.de9c340c-7ae5-4b6d-b874-8618c17199c9 Sep 17 21:56:22 devstack sudo[92899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:56:22 devstack sudo[92899]: pam_unix(sudo:session): session closed for user root Sep 17 21:56:22 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-912fb66b-02ea-497c-a611-0335026e6564 tempest-GroupsV314Test-1340436811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f39f8f65-668e-4ca9-b2b8-f399366f621f.de9c340c-7ae5-4b6d-b874-8618c17199c9" returned: 0 in 0.443s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:56:22 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-912fb66b-02ea-497c-a611-0335026e6564 tempest-GroupsV314Test-1340436811 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f39f8f65-668e-4ca9-b2b8-f399366f621f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85458) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 21:56:23 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[92d26dfc-972d-4098-822d-b2d642c5b4d4]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 21:56:23 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-912fb66b-02ea-497c-a611-0335026e6564 tempest-GroupsV314Test-1340436811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f39f8f65-668e-4ca9-b2b8-f399366f621f {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:56:23 devstack sudo[92906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f39f8f65-668e-4ca9-b2b8-f399366f621f Sep 17 21:56:23 devstack sudo[92906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:56:23 devstack sudo[92906]: pam_unix(sudo:session): session closed for user root Sep 17 21:56:23 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-912fb66b-02ea-497c-a611-0335026e6564 tempest-GroupsV314Test-1340436811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f39f8f65-668e-4ca9-b2b8-f399366f621f" returned: 0 in 0.458s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:56:23 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-912fb66b-02ea-497c-a611-0335026e6564 tempest-GroupsV314Test-1340436811 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f39f8f65-668e-4ca9-b2b8-f399366f621f {{(pid=85458) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 17 21:56:23 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-912fb66b-02ea-497c-a611-0335026e6564 tempest-GroupsV314Test-1340436811 None] Creating direct copy from snapshot {{(pid=85458) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 17 21:56:23 devstack cinder-volume[85458]: DEBUG cinder.utils [None req-912fb66b-02ea-497c-a611-0335026e6564 tempest-GroupsV314Test-1340436811 None] Path /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-2b2ead49-9948-400d-9938-eb63c19faf85 not found in is_blk_device check {{(pid=85458) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 17 21:56:23 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-912fb66b-02ea-497c-a611-0335026e6564 tempest-GroupsV314Test-1340436811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f39f8f65-668e-4ca9-b2b8-f399366f621f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-2b2ead49-9948-400d-9938-eb63c19faf85 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:56:23 devstack sudo[92913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f39f8f65-668e-4ca9-b2b8-f399366f621f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-2b2ead49-9948-400d-9938-eb63c19faf85 Sep 17 21:56:23 devstack sudo[92913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:56:24 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3224cb8-ee82-47cb-bef2-276dfe9ce98c tempest-GroupsTest-709256577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 21:56:25 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b3224cb8-ee82-47cb-bef2-276dfe9ce98c tempest-GroupsTest-709256577 None] Flow 'volume_create_manager' (8cb5db71-d56a-4fbb-865f-4339081d91fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 21:56:25 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b3224cb8-ee82-47cb-bef2-276dfe9ce98c tempest-GroupsTest-709256577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bf5a743-05d0-4d13-bf47-76ceddb6a6a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:56:25 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b3224cb8-ee82-47cb-bef2-276dfe9ce98c tempest-GroupsTest-709256577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bf5a743-05d0-4d13-bf47-76ceddb6a6a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T19:56:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1944273881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=954e9158-3056-4bed-952f-95e220fb9ad1,host='devstack@QuobyteHD#QuobyteHD',id=73abdd3d-5b21-4fa2-bbda-14626e1307dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8a1c6d477ff4f058a524c5810918941',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T19:56:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T19:56:25Z,use_quota=True,user_id='f8279790f9174d519997466b0029e6db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b1f5a4-7eaf-4605-b39f-8051abe4ddd9),volume_type_id=d4b1f5a4-7eaf-4605-b39f-8051abe4ddd9)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:56:25 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b3224cb8-ee82-47cb-bef2-276dfe9ce98c tempest-GroupsTest-709256577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5674e063-5dbc-4a38-8418-bf7358daa1a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:56:25 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b3224cb8-ee82-47cb-bef2-276dfe9ce98c tempest-GroupsTest-709256577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5674e063-5dbc-4a38-8418-bf7358daa1a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:56:25 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b3224cb8-ee82-47cb-bef2-276dfe9ce98c tempest-GroupsTest-709256577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (979f6e9b-d065-431b-b3c0-3c3ebbb994a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:56:25 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b3224cb8-ee82-47cb-bef2-276dfe9ce98c tempest-GroupsTest-709256577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (979f6e9b-d065-431b-b3c0-3c3ebbb994a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73abdd3d-5b21-4fa2-bbda-14626e1307dc', 'volume_name': 'volume-73abdd3d-5b21-4fa2-bbda-14626e1307dc', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:56:25 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b3224cb8-ee82-47cb-bef2-276dfe9ce98c tempest-GroupsTest-709256577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4194fc28-b54d-4e75-9d3e-2d9f116ed477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:56:25 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b3224cb8-ee82-47cb-bef2-276dfe9ce98c tempest-GroupsTest-709256577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4194fc28-b54d-4e75-9d3e-2d9f116ed477) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:56:25 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b3224cb8-ee82-47cb-bef2-276dfe9ce98c tempest-GroupsTest-709256577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed4d8ba3-7f41-4c82-b0d1-1e8a0d18850f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:56:25 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-b3224cb8-ee82-47cb-bef2-276dfe9ce98c tempest-GroupsTest-709256577 None] Volume 73abdd3d-5b21-4fa2-bbda-14626e1307dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73abdd3d-5b21-4fa2-bbda-14626e1307dc', 'volume_size': 1} Sep 17 21:56:25 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-b3224cb8-ee82-47cb-bef2-276dfe9ce98c tempest-GroupsTest-709256577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:56:27 devstack cinder-volume[85458]: DEBUG oslo_service.periodic_task [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85458) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 21:56:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:56:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:56:27 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 21:56:27 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 21:56:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:56:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:56:27 devstack sudo[92966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 21:56:27 devstack sudo[92966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:56:28 devstack sudo[92966]: pam_unix(sudo:session): session closed for user root Sep 17 21:56:28 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.796s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:56:28 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 21:56:28 devstack cinder-volume[85458]: DEBUG oslo_service.periodic_task [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Running periodic task VolumeManager._thread_info {{(pid=85458) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 21:56:28 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] thread count: 28 {{(pid=85458) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 21:56:28 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] thread info: [<_MainThread(MainThread, started 127546830999680)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85458) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 21:56:34 devstack cinder-volume[85458]: INFO cinder.volume.manager [req-3f85b375-e02c-413d-b9a6-140b6470b4f9 req-c40866bd-9900-4a85-a5f4-0cc1181c2a95 tempest-AttachVolumeNegativeTest-28309225 None] Terminate volume connection completed successfully. Sep 17 21:56:34 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [req-3f85b375-e02c-413d-b9a6-140b6470b4f9 req-c40866bd-9900-4a85-a5f4-0cc1181c2a95 tempest-AttachVolumeNegativeTest-28309225 None] Deleting attachment 3379f260-fa16-4b07-afcc-5ad6a46f0187. {{(pid=85458) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 21:56:35 devstack sudo[92913]: pam_unix(sudo:session): session closed for user root Sep 17 21:56:35 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-912fb66b-02ea-497c-a611-0335026e6564 tempest-GroupsV314Test-1340436811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f39f8f65-668e-4ca9-b2b8-f399366f621f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-2b2ead49-9948-400d-9938-eb63c19faf85" returned: 0 in 12.410s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:56:35 devstack cinder-volume[85458]: DEBUG cinder.image.image_utils [None req-912fb66b-02ea-497c-a611-0335026e6564 tempest-GroupsV314Test-1340436811 None] Image conversion details: src /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f39f8f65-668e-4ca9-b2b8-f399366f621f, size 1024.00 MB, duration 12.41 sec, destination /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-2b2ead49-9948-400d-9938-eb63c19faf85 {{(pid=85458) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 17 21:56:35 devstack cinder-volume[85458]: INFO cinder.image.image_utils [None req-912fb66b-02ea-497c-a611-0335026e6564 tempest-GroupsV314Test-1340436811 None] Converted 1024.00 MB image at 82.51 MB/s Sep 17 21:56:35 devstack cinder-volume[85458]: WARNING cinder.volume.drivers.remotefs [None req-912fb66b-02ea-497c-a611-0335026e6564 tempest-GroupsV314Test-1340436811 None] /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-2b2ead49-9948-400d-9938-eb63c19faf85 is being set with open permissions: ugo+rw: NotImplementedError Sep 17 21:56:35 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-912fb66b-02ea-497c-a611-0335026e6564 tempest-GroupsV314Test-1340436811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-2b2ead49-9948-400d-9938-eb63c19faf85 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:56:35 devstack sudo[93017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-2b2ead49-9948-400d-9938-eb63c19faf85 Sep 17 21:56:35 devstack sudo[93017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:56:36 devstack sudo[93017]: pam_unix(sudo:session): session closed for user root Sep 17 21:56:36 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-912fb66b-02ea-497c-a611-0335026e6564 tempest-GroupsV314Test-1340436811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-2b2ead49-9948-400d-9938-eb63c19faf85" returned: 0 in 0.280s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:56:36 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-912fb66b-02ea-497c-a611-0335026e6564 tempest-GroupsV314Test-1340436811 None] Lock "cinder-quobyte-2b2ead49-9948-400d-9938-eb63c19faf85" released by "_copy_volume_from_snapshot" :: held 13.694s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 21:56:36 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-912fb66b-02ea-497c-a611-0335026e6564 tempest-GroupsV314Test-1340436811 None] Acquiring lock "cinder-quobyte-de9c340c-7ae5-4b6d-b874-8618c17199c9" by "_delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 21:56:36 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-912fb66b-02ea-497c-a611-0335026e6564 tempest-GroupsV314Test-1340436811 None] Lock "cinder-quobyte-de9c340c-7ae5-4b6d-b874-8618c17199c9" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 21:56:36 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-912fb66b-02ea-497c-a611-0335026e6564 tempest-GroupsV314Test-1340436811 None] Deleting offline snapshot de9c340c-7ae5-4b6d-b874-8618c17199c9 of volume f39f8f65-668e-4ca9-b2b8-f399366f621f {{(pid=85458) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 21:56:36 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-912fb66b-02ea-497c-a611-0335026e6564 tempest-GroupsV314Test-1340436811 None] snapshot_file for this snap is: volume-f39f8f65-668e-4ca9-b2b8-f399366f621f.de9c340c-7ae5-4b6d-b874-8618c17199c9 {{(pid=85458) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 21:56:36 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[83e62809-6afa-43ec-b828-23aa3f816684]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 21:56:36 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-912fb66b-02ea-497c-a611-0335026e6564 tempest-GroupsV314Test-1340436811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f39f8f65-668e-4ca9-b2b8-f399366f621f.de9c340c-7ae5-4b6d-b874-8618c17199c9 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:56:36 devstack sudo[93023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f39f8f65-668e-4ca9-b2b8-f399366f621f.de9c340c-7ae5-4b6d-b874-8618c17199c9 Sep 17 21:56:36 devstack sudo[93023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:56:36 devstack sudo[93023]: pam_unix(sudo:session): session closed for user root Sep 17 21:56:36 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-912fb66b-02ea-497c-a611-0335026e6564 tempest-GroupsV314Test-1340436811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f39f8f65-668e-4ca9-b2b8-f399366f621f.de9c340c-7ae5-4b6d-b874-8618c17199c9" returned: 0 in 0.487s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:56:36 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-912fb66b-02ea-497c-a611-0335026e6564 tempest-GroupsV314Test-1340436811 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f39f8f65-668e-4ca9-b2b8-f399366f621f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85458) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 21:56:36 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e305ce5-99d8-47f2-b3f6-3dc2859f8fef]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 21:56:36 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-912fb66b-02ea-497c-a611-0335026e6564 tempest-GroupsV314Test-1340436811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f39f8f65-668e-4ca9-b2b8-f399366f621f {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:56:36 devstack sudo[93047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f39f8f65-668e-4ca9-b2b8-f399366f621f Sep 17 21:56:36 devstack sudo[93047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:56:37 devstack sudo[93047]: pam_unix(sudo:session): session closed for user root Sep 17 21:56:37 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-912fb66b-02ea-497c-a611-0335026e6564 tempest-GroupsV314Test-1340436811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f39f8f65-668e-4ca9-b2b8-f399366f621f" returned: 0 in 0.645s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:56:37 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-912fb66b-02ea-497c-a611-0335026e6564 tempest-GroupsV314Test-1340436811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f39f8f65-668e-4ca9-b2b8-f399366f621f.de9c340c-7ae5-4b6d-b874-8618c17199c9 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:56:37 devstack sudo[93053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f39f8f65-668e-4ca9-b2b8-f399366f621f.de9c340c-7ae5-4b6d-b874-8618c17199c9 Sep 17 21:56:37 devstack sudo[93053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:56:37 devstack sudo[93053]: pam_unix(sudo:session): session closed for user root Sep 17 21:56:37 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-912fb66b-02ea-497c-a611-0335026e6564 tempest-GroupsV314Test-1340436811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f39f8f65-668e-4ca9-b2b8-f399366f621f.de9c340c-7ae5-4b6d-b874-8618c17199c9" returned: 0 in 0.391s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:56:37 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-912fb66b-02ea-497c-a611-0335026e6564 tempest-GroupsV314Test-1340436811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f39f8f65-668e-4ca9-b2b8-f399366f621f.de9c340c-7ae5-4b6d-b874-8618c17199c9 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:56:37 devstack sudo[93061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f39f8f65-668e-4ca9-b2b8-f399366f621f.de9c340c-7ae5-4b6d-b874-8618c17199c9 Sep 17 21:56:37 devstack sudo[93061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:56:38 devstack sudo[93061]: pam_unix(sudo:session): session closed for user root Sep 17 21:56:38 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-912fb66b-02ea-497c-a611-0335026e6564 tempest-GroupsV314Test-1340436811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f39f8f65-668e-4ca9-b2b8-f399366f621f.de9c340c-7ae5-4b6d-b874-8618c17199c9" returned: 0 in 0.280s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:56:38 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-912fb66b-02ea-497c-a611-0335026e6564 tempest-GroupsV314Test-1340436811 None] Lock "cinder-quobyte-de9c340c-7ae5-4b6d-b874-8618c17199c9" released by "_delete_snapshot" :: held 1.932s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 21:56:38 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-912fb66b-02ea-497c-a611-0335026e6564 tempest-GroupsV314Test-1340436811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 19.044s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:56:38 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-b3224cb8-ee82-47cb-bef2-276dfe9ce98c tempest-GroupsTest-709256577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.889s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:56:38 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-b3224cb8-ee82-47cb-bef2-276dfe9ce98c tempest-GroupsTest-709256577 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=954e9158-3056-4bed-952f-95e220fb9ad1,created_at=2026-09-17T19:56:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1944273881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=954e9158-3056-4bed-952f-95e220fb9ad1,host='devstack@QuobyteHD#QuobyteHD',id=73abdd3d-5b21-4fa2-bbda-14626e1307dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8a1c6d477ff4f058a524c5810918941',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T19:56:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T19:56:25Z,use_quota=True,user_id='f8279790f9174d519997466b0029e6db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b1f5a4-7eaf-4605-b39f-8051abe4ddd9),volume_type_id=d4b1f5a4-7eaf-4605-b39f-8051abe4ddd9)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 21:56:38 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-b3224cb8-ee82-47cb-bef2-276dfe9ce98c tempest-GroupsTest-709256577 None] Creating volume 73abdd3d-5b21-4fa2-bbda-14626e1307dc {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 21:56:38 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-b3224cb8-ee82-47cb-bef2-276dfe9ce98c tempest-GroupsTest-709256577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:56:38 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-b3224cb8-ee82-47cb-bef2-276dfe9ce98c tempest-GroupsTest-709256577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:56:38 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-b3224cb8-ee82-47cb-bef2-276dfe9ce98c tempest-GroupsTest-709256577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 21:56:38 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-b3224cb8-ee82-47cb-bef2-276dfe9ce98c tempest-GroupsTest-709256577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 21:56:38 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-b3224cb8-ee82-47cb-bef2-276dfe9ce98c tempest-GroupsTest-709256577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:56:38 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-b3224cb8-ee82-47cb-bef2-276dfe9ce98c tempest-GroupsTest-709256577 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 21:56:38 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-b3224cb8-ee82-47cb-bef2-276dfe9ce98c tempest-GroupsTest-709256577 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 21:56:38 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-b3224cb8-ee82-47cb-bef2-276dfe9ce98c tempest-GroupsTest-709256577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-73abdd3d-5b21-4fa2-bbda-14626e1307dc 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:56:38 devstack sudo[93065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-73abdd3d-5b21-4fa2-bbda-14626e1307dc 1073741824 Sep 17 21:56:38 devstack sudo[93065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:56:38 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-912fb66b-02ea-497c-a611-0335026e6564 tempest-GroupsV314Test-1340436811 None] Create group from source-group-5798fd0f-10f5-499a-809e-bd79770a6f3f completed successfully. Sep 17 21:56:38 devstack sudo[93065]: pam_unix(sudo:session): session closed for user root Sep 17 21:56:38 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-b3224cb8-ee82-47cb-bef2-276dfe9ce98c tempest-GroupsTest-709256577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-73abdd3d-5b21-4fa2-bbda-14626e1307dc 1073741824" returned: 0 in 0.484s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:56:38 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-b3224cb8-ee82-47cb-bef2-276dfe9ce98c tempest-GroupsTest-709256577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-73abdd3d-5b21-4fa2-bbda-14626e1307dc {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:56:38 devstack sudo[93071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-73abdd3d-5b21-4fa2-bbda-14626e1307dc Sep 17 21:56:38 devstack sudo[93071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:56:38 devstack sudo[93071]: pam_unix(sudo:session): session closed for user root Sep 17 21:56:38 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-b3224cb8-ee82-47cb-bef2-276dfe9ce98c tempest-GroupsTest-709256577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-73abdd3d-5b21-4fa2-bbda-14626e1307dc" returned: 0 in 0.272s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:56:38 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-b3224cb8-ee82-47cb-bef2-276dfe9ce98c tempest-GroupsTest-709256577 None] <== create_volume: return (812ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 21:56:39 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-b3224cb8-ee82-47cb-bef2-276dfe9ce98c tempest-GroupsTest-709256577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.818s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:56:39 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b3224cb8-ee82-47cb-bef2-276dfe9ce98c tempest-GroupsTest-709256577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed4d8ba3-7f41-4c82-b0d1-1e8a0d18850f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73abdd3d-5b21-4fa2-bbda-14626e1307dc', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:56:39 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b3224cb8-ee82-47cb-bef2-276dfe9ce98c tempest-GroupsTest-709256577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfc935c7-db9b-4d5d-8c4d-e992aef95637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:56:39 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-b3224cb8-ee82-47cb-bef2-276dfe9ce98c tempest-GroupsTest-709256577 None] Volume volume-73abdd3d-5b21-4fa2-bbda-14626e1307dc (73abdd3d-5b21-4fa2-bbda-14626e1307dc): created successfully Sep 17 21:56:39 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b3224cb8-ee82-47cb-bef2-276dfe9ce98c tempest-GroupsTest-709256577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfc935c7-db9b-4d5d-8c4d-e992aef95637) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:56:39 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b3224cb8-ee82-47cb-bef2-276dfe9ce98c tempest-GroupsTest-709256577 None] Flow 'volume_create_manager' (8cb5db71-d56a-4fbb-865f-4339081d91fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 21:56:39 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-b3224cb8-ee82-47cb-bef2-276dfe9ce98c tempest-GroupsTest-709256577 None] Created volume successfully. Sep 17 21:56:39 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-ddd0053a-1a30-4ae1-a5cd-71503232277b tempest-GroupsV314Test-1340436811 None] Acquiring lock "cinder-quobyte-2b2ead49-9948-400d-9938-eb63c19faf85" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 21:56:40 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-ddd0053a-1a30-4ae1-a5cd-71503232277b tempest-GroupsV314Test-1340436811 None] Lock "cinder-quobyte-2b2ead49-9948-400d-9938-eb63c19faf85" acquired by "delete_volume" :: waited 0.039s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 21:56:40 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-065bdbec-bc96-4d80-bc64-445fc77cdd81 tempest-GroupsTest-709256577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 21:56:40 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-065bdbec-bc96-4d80-bc64-445fc77cdd81 tempest-GroupsTest-709256577 None] Flow 'volume_create_manager' (10b318c9-db27-4585-9775-c30089e04b27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 21:56:40 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-065bdbec-bc96-4d80-bc64-445fc77cdd81 tempest-GroupsTest-709256577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f81cc16-eaa7-43ce-8bac-4960accec2e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:56:40 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[155bc529-570e-47d3-8d82-abe64974922c]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 21:56:40 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-ddd0053a-1a30-4ae1-a5cd-71503232277b tempest-GroupsV314Test-1340436811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-2b2ead49-9948-400d-9938-eb63c19faf85 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:56:40 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-065bdbec-bc96-4d80-bc64-445fc77cdd81 tempest-GroupsTest-709256577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f81cc16-eaa7-43ce-8bac-4960accec2e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T19:56:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-451310267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=954e9158-3056-4bed-952f-95e220fb9ad1,host='devstack@QuobyteHD#QuobyteHD',id=898ca0e6-387e-44ee-a79f-9739cda2bded,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8a1c6d477ff4f058a524c5810918941',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T19:56:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T19:56:40Z,use_quota=True,user_id='f8279790f9174d519997466b0029e6db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b1f5a4-7eaf-4605-b39f-8051abe4ddd9),volume_type_id=d4b1f5a4-7eaf-4605-b39f-8051abe4ddd9)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:56:40 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-065bdbec-bc96-4d80-bc64-445fc77cdd81 tempest-GroupsTest-709256577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46fd5ec5-a344-4672-922a-7e07adff64c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:56:40 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-065bdbec-bc96-4d80-bc64-445fc77cdd81 tempest-GroupsTest-709256577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46fd5ec5-a344-4672-922a-7e07adff64c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:56:40 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-065bdbec-bc96-4d80-bc64-445fc77cdd81 tempest-GroupsTest-709256577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc75a27a-c890-49ba-8fc7-7323ebcbdb0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:56:40 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-065bdbec-bc96-4d80-bc64-445fc77cdd81 tempest-GroupsTest-709256577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc75a27a-c890-49ba-8fc7-7323ebcbdb0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '898ca0e6-387e-44ee-a79f-9739cda2bded', 'volume_name': 'volume-898ca0e6-387e-44ee-a79f-9739cda2bded', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:56:40 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-065bdbec-bc96-4d80-bc64-445fc77cdd81 tempest-GroupsTest-709256577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (701edcf5-cc36-42b5-89ff-e03a50fcafea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:56:40 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-065bdbec-bc96-4d80-bc64-445fc77cdd81 tempest-GroupsTest-709256577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (701edcf5-cc36-42b5-89ff-e03a50fcafea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:56:40 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-065bdbec-bc96-4d80-bc64-445fc77cdd81 tempest-GroupsTest-709256577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1323da97-e0f5-4c86-965e-841be9810ecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:56:40 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-065bdbec-bc96-4d80-bc64-445fc77cdd81 tempest-GroupsTest-709256577 None] Volume 898ca0e6-387e-44ee-a79f-9739cda2bded: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-898ca0e6-387e-44ee-a79f-9739cda2bded', 'volume_size': 1} Sep 17 21:56:40 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-065bdbec-bc96-4d80-bc64-445fc77cdd81 tempest-GroupsTest-709256577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:56:40 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-065bdbec-bc96-4d80-bc64-445fc77cdd81 tempest-GroupsTest-709256577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:56:40 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-065bdbec-bc96-4d80-bc64-445fc77cdd81 tempest-GroupsTest-709256577 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=954e9158-3056-4bed-952f-95e220fb9ad1,created_at=2026-09-17T19:56:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-451310267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=954e9158-3056-4bed-952f-95e220fb9ad1,host='devstack@QuobyteHD#QuobyteHD',id=898ca0e6-387e-44ee-a79f-9739cda2bded,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8a1c6d477ff4f058a524c5810918941',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T19:56:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T19:56:40Z,use_quota=True,user_id='f8279790f9174d519997466b0029e6db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b1f5a4-7eaf-4605-b39f-8051abe4ddd9),volume_type_id=d4b1f5a4-7eaf-4605-b39f-8051abe4ddd9)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 21:56:40 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-065bdbec-bc96-4d80-bc64-445fc77cdd81 tempest-GroupsTest-709256577 None] Creating volume 898ca0e6-387e-44ee-a79f-9739cda2bded {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 21:56:40 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-065bdbec-bc96-4d80-bc64-445fc77cdd81 tempest-GroupsTest-709256577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:56:40 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-065bdbec-bc96-4d80-bc64-445fc77cdd81 tempest-GroupsTest-709256577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:56:40 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-065bdbec-bc96-4d80-bc64-445fc77cdd81 tempest-GroupsTest-709256577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 21:56:40 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-065bdbec-bc96-4d80-bc64-445fc77cdd81 tempest-GroupsTest-709256577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 21:56:40 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-065bdbec-bc96-4d80-bc64-445fc77cdd81 tempest-GroupsTest-709256577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:56:40 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-065bdbec-bc96-4d80-bc64-445fc77cdd81 tempest-GroupsTest-709256577 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 21:56:40 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-065bdbec-bc96-4d80-bc64-445fc77cdd81 tempest-GroupsTest-709256577 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 21:56:40 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-065bdbec-bc96-4d80-bc64-445fc77cdd81 tempest-GroupsTest-709256577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-898ca0e6-387e-44ee-a79f-9739cda2bded 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:56:40 devstack sudo[93076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-2b2ead49-9948-400d-9938-eb63c19faf85 Sep 17 21:56:40 devstack sudo[93077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-898ca0e6-387e-44ee-a79f-9739cda2bded 1073741824 Sep 17 21:56:40 devstack sudo[93076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:56:40 devstack sudo[93077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:56:40 devstack sudo[93076]: pam_unix(sudo:session): session closed for user root Sep 17 21:56:40 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-ddd0053a-1a30-4ae1-a5cd-71503232277b tempest-GroupsV314Test-1340436811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-2b2ead49-9948-400d-9938-eb63c19faf85" returned: 0 in 0.396s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:56:40 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-ddd0053a-1a30-4ae1-a5cd-71503232277b tempest-GroupsV314Test-1340436811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-2b2ead49-9948-400d-9938-eb63c19faf85 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:56:40 devstack sudo[93086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-2b2ead49-9948-400d-9938-eb63c19faf85 Sep 17 21:56:40 devstack sudo[93086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:56:40 devstack sudo[93077]: pam_unix(sudo:session): session closed for user root Sep 17 21:56:40 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-065bdbec-bc96-4d80-bc64-445fc77cdd81 tempest-GroupsTest-709256577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-898ca0e6-387e-44ee-a79f-9739cda2bded 1073741824" returned: 0 in 0.558s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:56:40 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-065bdbec-bc96-4d80-bc64-445fc77cdd81 tempest-GroupsTest-709256577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-898ca0e6-387e-44ee-a79f-9739cda2bded {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:56:40 devstack sudo[93086]: pam_unix(sudo:session): session closed for user root Sep 17 21:56:40 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-ddd0053a-1a30-4ae1-a5cd-71503232277b tempest-GroupsV314Test-1340436811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-2b2ead49-9948-400d-9938-eb63c19faf85" returned: 0 in 0.310s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:56:40 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-ddd0053a-1a30-4ae1-a5cd-71503232277b tempest-GroupsV314Test-1340436811 None] Lock "cinder-quobyte-2b2ead49-9948-400d-9938-eb63c19faf85" released by "delete_volume" :: held 0.824s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 21:56:40 devstack sudo[93090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-898ca0e6-387e-44ee-a79f-9739cda2bded Sep 17 21:56:40 devstack sudo[93090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:56:40 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-ddd0053a-1a30-4ae1-a5cd-71503232277b tempest-GroupsV314Test-1340436811 None] Created reservations ['abff283c-b07b-45e0-bb3d-2f81bbcbf4d1'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 21:56:40 devstack cinder-volume[85458]: WARNING cinder.quota [None req-ddd0053a-1a30-4ae1-a5cd-71503232277b tempest-GroupsV314Test-1340436811 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-783001239 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-783001239, it is now deprecated. Please use the default quota class for default quota. Sep 17 21:56:40 devstack cinder-volume[85458]: WARNING cinder.quota [None req-ddd0053a-1a30-4ae1-a5cd-71503232277b tempest-GroupsV314Test-1340436811 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-783001239 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-783001239, it is now deprecated. Please use the default quota class for default quota. Sep 17 21:56:40 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-ddd0053a-1a30-4ae1-a5cd-71503232277b tempest-GroupsV314Test-1340436811 None] Created reservations ['b4b2800d-a491-40be-a2cb-df72a7318f16', '9482d1a0-e2d9-4697-ad10-6a6e9ee66c4b', '1d3b6b2f-108d-40d3-97f4-7d980149b2fe', 'bce3c9db-d3eb-4979-9990-ab9c0a20463f'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 21:56:41 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-ddd0053a-1a30-4ae1-a5cd-71503232277b tempest-GroupsV314Test-1340436811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:56:41 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-ddd0053a-1a30-4ae1-a5cd-71503232277b tempest-GroupsV314Test-1340436811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:56:41 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-ddd0053a-1a30-4ae1-a5cd-71503232277b tempest-GroupsV314Test-1340436811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 21:56:41 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-ddd0053a-1a30-4ae1-a5cd-71503232277b tempest-GroupsV314Test-1340436811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 21:56:41 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-ddd0053a-1a30-4ae1-a5cd-71503232277b tempest-GroupsV314Test-1340436811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:56:41 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-ddd0053a-1a30-4ae1-a5cd-71503232277b tempest-GroupsV314Test-1340436811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:56:41 devstack sudo[93090]: pam_unix(sudo:session): session closed for user root Sep 17 21:56:41 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-065bdbec-bc96-4d80-bc64-445fc77cdd81 tempest-GroupsTest-709256577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-898ca0e6-387e-44ee-a79f-9739cda2bded" returned: 0 in 0.291s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:56:41 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-065bdbec-bc96-4d80-bc64-445fc77cdd81 tempest-GroupsTest-709256577 None] <== create_volume: return (904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 21:56:41 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-065bdbec-bc96-4d80-bc64-445fc77cdd81 tempest-GroupsTest-709256577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:56:41 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-065bdbec-bc96-4d80-bc64-445fc77cdd81 tempest-GroupsTest-709256577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1323da97-e0f5-4c86-965e-841be9810ecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-898ca0e6-387e-44ee-a79f-9739cda2bded', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:56:41 devstack sudo[93093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 21:56:41 devstack sudo[93093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:56:41 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-065bdbec-bc96-4d80-bc64-445fc77cdd81 tempest-GroupsTest-709256577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3df068d-2a62-4bf6-aac3-488796271817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:56:41 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-065bdbec-bc96-4d80-bc64-445fc77cdd81 tempest-GroupsTest-709256577 None] Volume volume-898ca0e6-387e-44ee-a79f-9739cda2bded (898ca0e6-387e-44ee-a79f-9739cda2bded): created successfully Sep 17 21:56:41 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-065bdbec-bc96-4d80-bc64-445fc77cdd81 tempest-GroupsTest-709256577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3df068d-2a62-4bf6-aac3-488796271817) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:56:41 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-065bdbec-bc96-4d80-bc64-445fc77cdd81 tempest-GroupsTest-709256577 None] Flow 'volume_create_manager' (10b318c9-db27-4585-9775-c30089e04b27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 21:56:41 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-065bdbec-bc96-4d80-bc64-445fc77cdd81 tempest-GroupsTest-709256577 None] Created volume successfully. Sep 17 21:56:41 devstack sudo[93093]: pam_unix(sudo:session): session closed for user root Sep 17 21:56:41 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-ddd0053a-1a30-4ae1-a5cd-71503232277b tempest-GroupsV314Test-1340436811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.313s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:56:41 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-ddd0053a-1a30-4ae1-a5cd-71503232277b tempest-GroupsV314Test-1340436811 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 21:56:41 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-ddd0053a-1a30-4ae1-a5cd-71503232277b tempest-GroupsV314Test-1340436811 None] Delete group completed successfully. Sep 17 21:56:41 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-980d2acf-1e2c-4160-a4ca-56bba9df8cce tempest-GroupsV314Test-1340436811 None] Acquiring lock "cinder-quobyte-f39f8f65-668e-4ca9-b2b8-f399366f621f" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 21:56:41 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-aa83d70b-d7c3-4845-b565-514bfec67976 tempest-GroupsTest-709256577 None] Update group completed successfully. Sep 17 21:56:41 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-980d2acf-1e2c-4160-a4ca-56bba9df8cce tempest-GroupsV314Test-1340436811 None] Lock "cinder-quobyte-f39f8f65-668e-4ca9-b2b8-f399366f621f" acquired by "delete_volume" :: waited 0.027s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 21:56:41 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ac5e51d-6754-43e7-a70c-a32df7b10808]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 21:56:41 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-980d2acf-1e2c-4160-a4ca-56bba9df8cce tempest-GroupsV314Test-1340436811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f39f8f65-668e-4ca9-b2b8-f399366f621f {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:56:41 devstack sudo[93096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f39f8f65-668e-4ca9-b2b8-f399366f621f Sep 17 21:56:41 devstack sudo[93096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:56:42 devstack sudo[93096]: pam_unix(sudo:session): session closed for user root Sep 17 21:56:42 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-980d2acf-1e2c-4160-a4ca-56bba9df8cce tempest-GroupsV314Test-1340436811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f39f8f65-668e-4ca9-b2b8-f399366f621f" returned: 0 in 0.400s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:56:42 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-980d2acf-1e2c-4160-a4ca-56bba9df8cce tempest-GroupsV314Test-1340436811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f39f8f65-668e-4ca9-b2b8-f399366f621f {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:56:42 devstack sudo[93101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f39f8f65-668e-4ca9-b2b8-f399366f621f Sep 17 21:56:42 devstack sudo[93101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:56:42 devstack sudo[93101]: pam_unix(sudo:session): session closed for user root Sep 17 21:56:42 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-980d2acf-1e2c-4160-a4ca-56bba9df8cce tempest-GroupsV314Test-1340436811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f39f8f65-668e-4ca9-b2b8-f399366f621f" returned: 0 in 0.259s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:56:42 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-980d2acf-1e2c-4160-a4ca-56bba9df8cce tempest-GroupsV314Test-1340436811 None] Lock "cinder-quobyte-f39f8f65-668e-4ca9-b2b8-f399366f621f" released by "delete_volume" :: held 0.726s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 21:56:42 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-980d2acf-1e2c-4160-a4ca-56bba9df8cce tempest-GroupsV314Test-1340436811 None] Created reservations ['f4c544da-b47e-4af6-b4e2-6de278f60a74'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 21:56:42 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-980d2acf-1e2c-4160-a4ca-56bba9df8cce tempest-GroupsV314Test-1340436811 None] Created reservations ['311eb93f-180f-4720-b8b9-b215595b1da6', '729a070a-b6de-485b-9eaa-db493e5e4ad7', '9371102d-93f7-49a1-bd4c-a06c6c58fcfb', '5c290870-2136-4ba4-8558-acc73744448c'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 21:56:42 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-980d2acf-1e2c-4160-a4ca-56bba9df8cce tempest-GroupsV314Test-1340436811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:56:42 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-980d2acf-1e2c-4160-a4ca-56bba9df8cce tempest-GroupsV314Test-1340436811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:56:42 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-980d2acf-1e2c-4160-a4ca-56bba9df8cce tempest-GroupsV314Test-1340436811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 21:56:42 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-980d2acf-1e2c-4160-a4ca-56bba9df8cce tempest-GroupsV314Test-1340436811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 21:56:42 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-980d2acf-1e2c-4160-a4ca-56bba9df8cce tempest-GroupsV314Test-1340436811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:56:42 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-980d2acf-1e2c-4160-a4ca-56bba9df8cce tempest-GroupsV314Test-1340436811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:56:42 devstack sudo[93104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 21:56:42 devstack sudo[93104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:56:42 devstack sudo[93104]: pam_unix(sudo:session): session closed for user root Sep 17 21:56:42 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-980d2acf-1e2c-4160-a4ca-56bba9df8cce tempest-GroupsV314Test-1340436811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.309s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:56:42 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-980d2acf-1e2c-4160-a4ca-56bba9df8cce tempest-GroupsV314Test-1340436811 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 21:56:42 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-980d2acf-1e2c-4160-a4ca-56bba9df8cce tempest-GroupsV314Test-1340436811 None] Delete group completed successfully. Sep 17 21:56:43 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-0cb148b4-f54d-4a8a-98aa-82251373dbd1 tempest-GroupsTest-709256577 None] Update group completed successfully. Sep 17 21:56:44 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-46b1e577-ab19-4240-94a0-1f6ff01b7097 tempest-GroupsTest-709256577 None] Acquiring lock "cinder-quobyte-73abdd3d-5b21-4fa2-bbda-14626e1307dc" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 21:56:44 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-46b1e577-ab19-4240-94a0-1f6ff01b7097 tempest-GroupsTest-709256577 None] Lock "cinder-quobyte-73abdd3d-5b21-4fa2-bbda-14626e1307dc" acquired by "delete_volume" :: waited 0.029s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 21:56:45 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[b69af8c3-faa4-4556-8803-ce06e8216853]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 21:56:45 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-46b1e577-ab19-4240-94a0-1f6ff01b7097 tempest-GroupsTest-709256577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-73abdd3d-5b21-4fa2-bbda-14626e1307dc {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:56:45 devstack sudo[93111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-73abdd3d-5b21-4fa2-bbda-14626e1307dc Sep 17 21:56:45 devstack sudo[93111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:56:45 devstack sudo[93111]: pam_unix(sudo:session): session closed for user root Sep 17 21:56:45 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-46b1e577-ab19-4240-94a0-1f6ff01b7097 tempest-GroupsTest-709256577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-73abdd3d-5b21-4fa2-bbda-14626e1307dc" returned: 0 in 0.467s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:56:45 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-46b1e577-ab19-4240-94a0-1f6ff01b7097 tempest-GroupsTest-709256577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-73abdd3d-5b21-4fa2-bbda-14626e1307dc {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:56:45 devstack sudo[93120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-73abdd3d-5b21-4fa2-bbda-14626e1307dc Sep 17 21:56:45 devstack sudo[93120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:56:45 devstack sudo[93120]: pam_unix(sudo:session): session closed for user root Sep 17 21:56:45 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-46b1e577-ab19-4240-94a0-1f6ff01b7097 tempest-GroupsTest-709256577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-73abdd3d-5b21-4fa2-bbda-14626e1307dc" returned: 0 in 0.374s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:56:45 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-46b1e577-ab19-4240-94a0-1f6ff01b7097 tempest-GroupsTest-709256577 None] Lock "cinder-quobyte-73abdd3d-5b21-4fa2-bbda-14626e1307dc" released by "delete_volume" :: held 0.935s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 21:56:45 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-46b1e577-ab19-4240-94a0-1f6ff01b7097 tempest-GroupsTest-709256577 None] Acquiring lock "cinder-quobyte-898ca0e6-387e-44ee-a79f-9739cda2bded" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 21:56:45 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-46b1e577-ab19-4240-94a0-1f6ff01b7097 tempest-GroupsTest-709256577 None] Lock "cinder-quobyte-898ca0e6-387e-44ee-a79f-9739cda2bded" acquired by "delete_volume" :: waited 0.037s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 21:56:45 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[c714bcea-2ebc-4dda-b611-fd857b50b737]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 21:56:45 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-46b1e577-ab19-4240-94a0-1f6ff01b7097 tempest-GroupsTest-709256577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-898ca0e6-387e-44ee-a79f-9739cda2bded {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:56:46 devstack sudo[93139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-898ca0e6-387e-44ee-a79f-9739cda2bded Sep 17 21:56:46 devstack sudo[93139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:56:46 devstack sudo[93139]: pam_unix(sudo:session): session closed for user root Sep 17 21:56:46 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-46b1e577-ab19-4240-94a0-1f6ff01b7097 tempest-GroupsTest-709256577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-898ca0e6-387e-44ee-a79f-9739cda2bded" returned: 0 in 0.517s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:56:46 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-46b1e577-ab19-4240-94a0-1f6ff01b7097 tempest-GroupsTest-709256577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-898ca0e6-387e-44ee-a79f-9739cda2bded {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:56:46 devstack sudo[93147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-898ca0e6-387e-44ee-a79f-9739cda2bded Sep 17 21:56:46 devstack sudo[93147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:56:46 devstack sudo[93147]: pam_unix(sudo:session): session closed for user root Sep 17 21:56:46 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-46b1e577-ab19-4240-94a0-1f6ff01b7097 tempest-GroupsTest-709256577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-898ca0e6-387e-44ee-a79f-9739cda2bded" returned: 0 in 0.303s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:56:46 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-46b1e577-ab19-4240-94a0-1f6ff01b7097 tempest-GroupsTest-709256577 None] Lock "cinder-quobyte-898ca0e6-387e-44ee-a79f-9739cda2bded" released by "delete_volume" :: held 0.890s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 21:56:46 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-46b1e577-ab19-4240-94a0-1f6ff01b7097 tempest-GroupsTest-709256577 None] Created reservations ['7712e9a9-4aa3-400e-9129-27088c0a7ad7'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 21:56:46 devstack cinder-volume[85458]: WARNING cinder.quota [None req-46b1e577-ab19-4240-94a0-1f6ff01b7097 tempest-GroupsTest-709256577 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1564894135 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1564894135, it is now deprecated. Please use the default quota class for default quota. Sep 17 21:56:46 devstack cinder-volume[85458]: WARNING cinder.quota [None req-46b1e577-ab19-4240-94a0-1f6ff01b7097 tempest-GroupsTest-709256577 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1564894135 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1564894135, it is now deprecated. Please use the default quota class for default quota. Sep 17 21:56:46 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-46b1e577-ab19-4240-94a0-1f6ff01b7097 tempest-GroupsTest-709256577 None] Created reservations ['32dd3018-4421-4f19-81c0-9962589c3017', 'f8d3eb79-9b47-4b43-befb-b2e228e24a71', '9dba68d5-3653-4502-ad2a-a2cf10b35025', 'f123d16c-7235-41f8-8b84-b5ba63078afe'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 21:56:47 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-46b1e577-ab19-4240-94a0-1f6ff01b7097 tempest-GroupsTest-709256577 None] Created reservations ['2d56cf67-78af-4b3e-83b4-c83097b6088f', 'cf865301-1ce0-482b-8ac5-2f7a549a16b8', 'acd4c2e5-ab2d-462e-8ffe-e96de80506ba', 'fcd1d5a7-1e91-47b9-8fc6-fa4d0dafa072'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 21:56:47 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-46b1e577-ab19-4240-94a0-1f6ff01b7097 tempest-GroupsTest-709256577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:56:47 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-46b1e577-ab19-4240-94a0-1f6ff01b7097 tempest-GroupsTest-709256577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:56:47 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-46b1e577-ab19-4240-94a0-1f6ff01b7097 tempest-GroupsTest-709256577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 21:56:47 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-46b1e577-ab19-4240-94a0-1f6ff01b7097 tempest-GroupsTest-709256577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 21:56:47 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-46b1e577-ab19-4240-94a0-1f6ff01b7097 tempest-GroupsTest-709256577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:56:47 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-46b1e577-ab19-4240-94a0-1f6ff01b7097 tempest-GroupsTest-709256577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:56:47 devstack sudo[93150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 21:56:47 devstack sudo[93150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:56:47 devstack sudo[93150]: pam_unix(sudo:session): session closed for user root Sep 17 21:56:47 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-46b1e577-ab19-4240-94a0-1f6ff01b7097 tempest-GroupsTest-709256577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.266s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:56:47 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-46b1e577-ab19-4240-94a0-1f6ff01b7097 tempest-GroupsTest-709256577 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 21:56:47 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-46b1e577-ab19-4240-94a0-1f6ff01b7097 tempest-GroupsTest-709256577 None] Delete group completed successfully. Sep 17 21:56:50 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-a78b97eb-dba2-4fad-810a-15ea5dd7f72b tempest-AttachVolumeTestJSON-1856227952 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 21:56:50 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-a78b97eb-dba2-4fad-810a-15ea5dd7f72b tempest-AttachVolumeTestJSON-1856227952 None] Flow 'volume_create_manager' (f335792d-308b-4f46-a573-5b691a4e2ed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 21:56:50 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-a78b97eb-dba2-4fad-810a-15ea5dd7f72b tempest-AttachVolumeTestJSON-1856227952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63c2c8e3-b6cb-4a5a-b6ae-7d37d8e6ee10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:56:50 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-a78b97eb-dba2-4fad-810a-15ea5dd7f72b tempest-AttachVolumeTestJSON-1856227952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63c2c8e3-b6cb-4a5a-b6ae-7d37d8e6ee10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T19:56:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-844114356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7500956-5139-489a-8c16-5d10a00c26ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81918c7c6a5643b59650eebca8ab955a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T19:56:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T19:56:51Z,use_quota=True,user_id='c42559f054074fac9b7b532ae7d34658',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:56:50 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-a78b97eb-dba2-4fad-810a-15ea5dd7f72b tempest-AttachVolumeTestJSON-1856227952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36010f71-9f1e-4404-8c17-3b5cf4c9d603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:56:50 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-a78b97eb-dba2-4fad-810a-15ea5dd7f72b tempest-AttachVolumeTestJSON-1856227952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36010f71-9f1e-4404-8c17-3b5cf4c9d603) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:56:50 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-a78b97eb-dba2-4fad-810a-15ea5dd7f72b tempest-AttachVolumeTestJSON-1856227952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4accfd1-d888-43d7-9d5d-f689520733fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:56:50 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-a78b97eb-dba2-4fad-810a-15ea5dd7f72b tempest-AttachVolumeTestJSON-1856227952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4accfd1-d888-43d7-9d5d-f689520733fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7500956-5139-489a-8c16-5d10a00c26ed', 'volume_name': 'volume-b7500956-5139-489a-8c16-5d10a00c26ed', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:56:50 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-a78b97eb-dba2-4fad-810a-15ea5dd7f72b tempest-AttachVolumeTestJSON-1856227952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81ad4863-3012-458e-9fa6-56e21dbbf543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:56:50 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-a78b97eb-dba2-4fad-810a-15ea5dd7f72b tempest-AttachVolumeTestJSON-1856227952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81ad4863-3012-458e-9fa6-56e21dbbf543) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:56:50 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-a78b97eb-dba2-4fad-810a-15ea5dd7f72b tempest-AttachVolumeTestJSON-1856227952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d54e288c-2699-45b7-b7e7-b3cb47ce2c78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:56:50 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-a78b97eb-dba2-4fad-810a-15ea5dd7f72b tempest-AttachVolumeTestJSON-1856227952 None] Volume b7500956-5139-489a-8c16-5d10a00c26ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7500956-5139-489a-8c16-5d10a00c26ed', 'volume_size': 1} Sep 17 21:56:50 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-a78b97eb-dba2-4fad-810a-15ea5dd7f72b tempest-AttachVolumeTestJSON-1856227952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:56:50 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-a78b97eb-dba2-4fad-810a-15ea5dd7f72b tempest-AttachVolumeTestJSON-1856227952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:56:50 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-a78b97eb-dba2-4fad-810a-15ea5dd7f72b tempest-AttachVolumeTestJSON-1856227952 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T19:56:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-844114356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7500956-5139-489a-8c16-5d10a00c26ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81918c7c6a5643b59650eebca8ab955a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T19:56:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T19:56:51Z,use_quota=True,user_id='c42559f054074fac9b7b532ae7d34658',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 21:56:50 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-a78b97eb-dba2-4fad-810a-15ea5dd7f72b tempest-AttachVolumeTestJSON-1856227952 None] Creating volume b7500956-5139-489a-8c16-5d10a00c26ed {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 21:56:50 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-a78b97eb-dba2-4fad-810a-15ea5dd7f72b tempest-AttachVolumeTestJSON-1856227952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:56:50 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-a78b97eb-dba2-4fad-810a-15ea5dd7f72b tempest-AttachVolumeTestJSON-1856227952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:56:50 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-a78b97eb-dba2-4fad-810a-15ea5dd7f72b tempest-AttachVolumeTestJSON-1856227952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 21:56:50 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-a78b97eb-dba2-4fad-810a-15ea5dd7f72b tempest-AttachVolumeTestJSON-1856227952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 21:56:50 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-a78b97eb-dba2-4fad-810a-15ea5dd7f72b tempest-AttachVolumeTestJSON-1856227952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:56:50 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-a78b97eb-dba2-4fad-810a-15ea5dd7f72b tempest-AttachVolumeTestJSON-1856227952 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 21:56:50 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-a78b97eb-dba2-4fad-810a-15ea5dd7f72b tempest-AttachVolumeTestJSON-1856227952 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 21:56:50 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a78b97eb-dba2-4fad-810a-15ea5dd7f72b tempest-AttachVolumeTestJSON-1856227952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b7500956-5139-489a-8c16-5d10a00c26ed 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:56:50 devstack sudo[93225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b7500956-5139-489a-8c16-5d10a00c26ed 1073741824 Sep 17 21:56:50 devstack sudo[93225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:56:51 devstack sudo[93225]: pam_unix(sudo:session): session closed for user root Sep 17 21:56:51 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a78b97eb-dba2-4fad-810a-15ea5dd7f72b tempest-AttachVolumeTestJSON-1856227952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b7500956-5139-489a-8c16-5d10a00c26ed 1073741824" returned: 0 in 0.770s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:56:51 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a78b97eb-dba2-4fad-810a-15ea5dd7f72b tempest-AttachVolumeTestJSON-1856227952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b7500956-5139-489a-8c16-5d10a00c26ed {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:56:51 devstack sudo[93232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b7500956-5139-489a-8c16-5d10a00c26ed Sep 17 21:56:51 devstack sudo[93232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:56:52 devstack sudo[93232]: pam_unix(sudo:session): session closed for user root Sep 17 21:56:52 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a78b97eb-dba2-4fad-810a-15ea5dd7f72b tempest-AttachVolumeTestJSON-1856227952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b7500956-5139-489a-8c16-5d10a00c26ed" returned: 0 in 0.327s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:56:52 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-a78b97eb-dba2-4fad-810a-15ea5dd7f72b tempest-AttachVolumeTestJSON-1856227952 None] <== create_volume: return (1219ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 21:56:52 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-a78b97eb-dba2-4fad-810a-15ea5dd7f72b tempest-AttachVolumeTestJSON-1856227952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.228s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:56:52 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-a78b97eb-dba2-4fad-810a-15ea5dd7f72b tempest-AttachVolumeTestJSON-1856227952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d54e288c-2699-45b7-b7e7-b3cb47ce2c78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7500956-5139-489a-8c16-5d10a00c26ed', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:56:52 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-a78b97eb-dba2-4fad-810a-15ea5dd7f72b tempest-AttachVolumeTestJSON-1856227952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d490fb7-a18b-4808-95c4-562aae8339a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:56:52 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-a78b97eb-dba2-4fad-810a-15ea5dd7f72b tempest-AttachVolumeTestJSON-1856227952 None] Volume volume-b7500956-5139-489a-8c16-5d10a00c26ed (b7500956-5139-489a-8c16-5d10a00c26ed): created successfully Sep 17 21:56:52 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-a78b97eb-dba2-4fad-810a-15ea5dd7f72b tempest-AttachVolumeTestJSON-1856227952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d490fb7-a18b-4808-95c4-562aae8339a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:56:52 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-a78b97eb-dba2-4fad-810a-15ea5dd7f72b tempest-AttachVolumeTestJSON-1856227952 None] Flow 'volume_create_manager' (f335792d-308b-4f46-a573-5b691a4e2ed5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 21:56:52 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-a78b97eb-dba2-4fad-810a-15ea5dd7f72b tempest-AttachVolumeTestJSON-1856227952 None] Created volume successfully. Sep 17 21:56:52 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-a23ad14f-58b3-4fb5-8ce7-35fc9662c003 tempest-SnapshotsActionsTest-405643259 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 21:56:52 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-a23ad14f-58b3-4fb5-8ce7-35fc9662c003 tempest-SnapshotsActionsTest-405643259 None] Flow 'volume_create_manager' (a250b76e-e6a2-402a-aeb1-a26c8c89b4f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 21:56:52 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-a23ad14f-58b3-4fb5-8ce7-35fc9662c003 tempest-SnapshotsActionsTest-405643259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25541428-a054-462b-b424-e2fe7410cf0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:56:52 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-a23ad14f-58b3-4fb5-8ce7-35fc9662c003 tempest-SnapshotsActionsTest-405643259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25541428-a054-462b-b424-e2fe7410cf0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T19:56:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-717702661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=031315b6-e4a1-49fb-9eca-70005ccac72f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8af25c7d01cc41e6b434fce321811a25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T19:56:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T19:56:52Z,use_quota=True,user_id='afeedd6eaf584b5fbd337409f841badf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:56:52 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-a23ad14f-58b3-4fb5-8ce7-35fc9662c003 tempest-SnapshotsActionsTest-405643259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2be426b9-66a5-40df-a1ab-f2a66f4e42cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:56:52 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-a23ad14f-58b3-4fb5-8ce7-35fc9662c003 tempest-SnapshotsActionsTest-405643259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2be426b9-66a5-40df-a1ab-f2a66f4e42cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:56:52 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-a23ad14f-58b3-4fb5-8ce7-35fc9662c003 tempest-SnapshotsActionsTest-405643259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b72bbaa7-b933-4fce-b3e8-e79b9735b30a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:56:52 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-a23ad14f-58b3-4fb5-8ce7-35fc9662c003 tempest-SnapshotsActionsTest-405643259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b72bbaa7-b933-4fce-b3e8-e79b9735b30a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '031315b6-e4a1-49fb-9eca-70005ccac72f', 'volume_name': 'volume-031315b6-e4a1-49fb-9eca-70005ccac72f', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:56:52 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-a23ad14f-58b3-4fb5-8ce7-35fc9662c003 tempest-SnapshotsActionsTest-405643259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87a6971e-6610-41c9-af84-b75493cb2d04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:56:52 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-a23ad14f-58b3-4fb5-8ce7-35fc9662c003 tempest-SnapshotsActionsTest-405643259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87a6971e-6610-41c9-af84-b75493cb2d04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:56:52 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-a23ad14f-58b3-4fb5-8ce7-35fc9662c003 tempest-SnapshotsActionsTest-405643259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55c43b7a-9894-4271-a400-7ca55213e929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:56:52 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-a23ad14f-58b3-4fb5-8ce7-35fc9662c003 tempest-SnapshotsActionsTest-405643259 None] Volume 031315b6-e4a1-49fb-9eca-70005ccac72f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-031315b6-e4a1-49fb-9eca-70005ccac72f', 'volume_size': 1} Sep 17 21:56:52 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-a23ad14f-58b3-4fb5-8ce7-35fc9662c003 tempest-SnapshotsActionsTest-405643259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:56:52 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-a23ad14f-58b3-4fb5-8ce7-35fc9662c003 tempest-SnapshotsActionsTest-405643259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:56:52 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-a23ad14f-58b3-4fb5-8ce7-35fc9662c003 tempest-SnapshotsActionsTest-405643259 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T19:56:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-717702661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=031315b6-e4a1-49fb-9eca-70005ccac72f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8af25c7d01cc41e6b434fce321811a25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T19:56:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T19:56:52Z,use_quota=True,user_id='afeedd6eaf584b5fbd337409f841badf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 21:56:52 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-a23ad14f-58b3-4fb5-8ce7-35fc9662c003 tempest-SnapshotsActionsTest-405643259 None] Creating volume 031315b6-e4a1-49fb-9eca-70005ccac72f {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 21:56:52 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-a23ad14f-58b3-4fb5-8ce7-35fc9662c003 tempest-SnapshotsActionsTest-405643259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:56:52 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-a23ad14f-58b3-4fb5-8ce7-35fc9662c003 tempest-SnapshotsActionsTest-405643259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:56:52 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-a23ad14f-58b3-4fb5-8ce7-35fc9662c003 tempest-SnapshotsActionsTest-405643259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 21:56:52 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-a23ad14f-58b3-4fb5-8ce7-35fc9662c003 tempest-SnapshotsActionsTest-405643259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 21:56:52 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-a23ad14f-58b3-4fb5-8ce7-35fc9662c003 tempest-SnapshotsActionsTest-405643259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:56:52 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-a23ad14f-58b3-4fb5-8ce7-35fc9662c003 tempest-SnapshotsActionsTest-405643259 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 21:56:52 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-a23ad14f-58b3-4fb5-8ce7-35fc9662c003 tempest-SnapshotsActionsTest-405643259 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 21:56:52 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a23ad14f-58b3-4fb5-8ce7-35fc9662c003 tempest-SnapshotsActionsTest-405643259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:56:52 devstack sudo[93235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f 1073741824 Sep 17 21:56:52 devstack sudo[93235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:56:53 devstack sudo[93235]: pam_unix(sudo:session): session closed for user root Sep 17 21:56:53 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a23ad14f-58b3-4fb5-8ce7-35fc9662c003 tempest-SnapshotsActionsTest-405643259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f 1073741824" returned: 0 in 0.894s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:56:53 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a23ad14f-58b3-4fb5-8ce7-35fc9662c003 tempest-SnapshotsActionsTest-405643259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:56:53 devstack sudo[93248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f Sep 17 21:56:53 devstack sudo[93248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:56:54 devstack sudo[93248]: pam_unix(sudo:session): session closed for user root Sep 17 21:56:54 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a23ad14f-58b3-4fb5-8ce7-35fc9662c003 tempest-SnapshotsActionsTest-405643259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f" returned: 0 in 0.494s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:56:54 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-a23ad14f-58b3-4fb5-8ce7-35fc9662c003 tempest-SnapshotsActionsTest-405643259 None] <== create_volume: return (1486ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 21:56:54 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-a23ad14f-58b3-4fb5-8ce7-35fc9662c003 tempest-SnapshotsActionsTest-405643259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.494s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:56:54 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-a23ad14f-58b3-4fb5-8ce7-35fc9662c003 tempest-SnapshotsActionsTest-405643259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55c43b7a-9894-4271-a400-7ca55213e929) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-031315b6-e4a1-49fb-9eca-70005ccac72f', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:56:54 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-a23ad14f-58b3-4fb5-8ce7-35fc9662c003 tempest-SnapshotsActionsTest-405643259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84c4a8b6-27b9-4086-ad21-05babfb2cd8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:56:54 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-a23ad14f-58b3-4fb5-8ce7-35fc9662c003 tempest-SnapshotsActionsTest-405643259 None] Volume volume-031315b6-e4a1-49fb-9eca-70005ccac72f (031315b6-e4a1-49fb-9eca-70005ccac72f): created successfully Sep 17 21:56:54 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-a23ad14f-58b3-4fb5-8ce7-35fc9662c003 tempest-SnapshotsActionsTest-405643259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84c4a8b6-27b9-4086-ad21-05babfb2cd8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:56:54 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-a23ad14f-58b3-4fb5-8ce7-35fc9662c003 tempest-SnapshotsActionsTest-405643259 None] Flow 'volume_create_manager' (a250b76e-e6a2-402a-aeb1-a26c8c89b4f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 21:56:54 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [req-17d1d58e-a204-4e46-9b0b-9c36436f5b21 req-421b64dc-8a3b-4b5d-9c90-931ee5224af0 tempest-AttachVolumeTestJSON-1856227952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:56:54 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [req-17d1d58e-a204-4e46-9b0b-9c36436f5b21 req-421b64dc-8a3b-4b5d-9c90-931ee5224af0 tempest-AttachVolumeTestJSON-1856227952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:56:54 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [req-17d1d58e-a204-4e46-9b0b-9c36436f5b21 req-421b64dc-8a3b-4b5d-9c90-931ee5224af0 tempest-AttachVolumeTestJSON-1856227952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:56:54 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-a23ad14f-58b3-4fb5-8ce7-35fc9662c003 tempest-SnapshotsActionsTest-405643259 None] Created volume successfully. Sep 17 21:56:54 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [req-17d1d58e-a204-4e46-9b0b-9c36436f5b21 req-421b64dc-8a3b-4b5d-9c90-931ee5224af0 tempest-AttachVolumeTestJSON-1856227952 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5', 'name': 'volume-b7500956-5139-489a-8c16-5d10a00c26ed', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5b6f1665-d381-46c1-bf02-f04596e9683c', 'enforce_multipath': True} {{(pid=85458) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 21:56:54 devstack cinder-volume[85458]: INFO cinder.volume.manager [req-17d1d58e-a204-4e46-9b0b-9c36436f5b21 req-421b64dc-8a3b-4b5d-9c90-931ee5224af0 tempest-AttachVolumeTestJSON-1856227952 None] attachment_update completed successfully. Sep 17 21:56:55 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-52b33481-eb24-4da5-8aea-4cb75a3ee25f tempest-SnapshotsActionsTest-405643259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:56:55 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-52b33481-eb24-4da5-8aea-4cb75a3ee25f tempest-SnapshotsActionsTest-405643259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:56:55 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-52b33481-eb24-4da5-8aea-4cb75a3ee25f tempest-SnapshotsActionsTest-405643259 None] Creating offline snapshot f0be6290-85f2-404a-b192-6f307aaddde6 of volume 031315b6-e4a1-49fb-9eca-70005ccac72f {{(pid=85458) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 21:56:55 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[98299fdb-fba0-4202-9cfe-3a2488b67e69]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 21:56:55 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-52b33481-eb24-4da5-8aea-4cb75a3ee25f tempest-SnapshotsActionsTest-405643259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:56:55 devstack sudo[93673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f Sep 17 21:56:55 devstack sudo[93673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:56:55 devstack sudo[93673]: pam_unix(sudo:session): session closed for user root Sep 17 21:56:55 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-52b33481-eb24-4da5-8aea-4cb75a3ee25f tempest-SnapshotsActionsTest-405643259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f" returned: 0 in 0.554s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:56:55 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-52b33481-eb24-4da5-8aea-4cb75a3ee25f tempest-SnapshotsActionsTest-405643259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.f0be6290-85f2-404a-b192-6f307aaddde6 1G {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:56:55 devstack sudo[93678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.f0be6290-85f2-404a-b192-6f307aaddde6 1G Sep 17 21:56:55 devstack sudo[93678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:56:56 devstack sudo[93678]: pam_unix(sudo:session): session closed for user root Sep 17 21:56:56 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-52b33481-eb24-4da5-8aea-4cb75a3ee25f tempest-SnapshotsActionsTest-405643259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.f0be6290-85f2-404a-b192-6f307aaddde6 1G" returned: 0 in 0.554s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:56:56 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-52b33481-eb24-4da5-8aea-4cb75a3ee25f tempest-SnapshotsActionsTest-405643259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-031315b6-e4a1-49fb-9eca-70005ccac72f -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.f0be6290-85f2-404a-b192-6f307aaddde6 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:56:56 devstack sudo[93685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-031315b6-e4a1-49fb-9eca-70005ccac72f -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.f0be6290-85f2-404a-b192-6f307aaddde6 Sep 17 21:56:56 devstack sudo[93685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:56:56 devstack sudo[93685]: pam_unix(sudo:session): session closed for user root Sep 17 21:56:56 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-52b33481-eb24-4da5-8aea-4cb75a3ee25f tempest-SnapshotsActionsTest-405643259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-031315b6-e4a1-49fb-9eca-70005ccac72f -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.f0be6290-85f2-404a-b192-6f307aaddde6" returned: 0 in 0.453s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:56:56 devstack cinder-volume[85458]: WARNING cinder.volume.drivers.remotefs [None req-52b33481-eb24-4da5-8aea-4cb75a3ee25f tempest-SnapshotsActionsTest-405643259 None] /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.f0be6290-85f2-404a-b192-6f307aaddde6 is being set with open permissions: ugo+rw Sep 17 21:56:56 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-52b33481-eb24-4da5-8aea-4cb75a3ee25f tempest-SnapshotsActionsTest-405643259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.f0be6290-85f2-404a-b192-6f307aaddde6 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:56:56 devstack sudo[93691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.f0be6290-85f2-404a-b192-6f307aaddde6 Sep 17 21:56:56 devstack sudo[93691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:56:57 devstack sudo[93691]: pam_unix(sudo:session): session closed for user root Sep 17 21:56:57 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-52b33481-eb24-4da5-8aea-4cb75a3ee25f tempest-SnapshotsActionsTest-405643259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.f0be6290-85f2-404a-b192-6f307aaddde6" returned: 0 in 0.339s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:56:57 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-52b33481-eb24-4da5-8aea-4cb75a3ee25f tempest-SnapshotsActionsTest-405643259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.info {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:56:57 devstack sudo[93694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.info Sep 17 21:56:57 devstack sudo[93694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:56:57 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-820fb829-c5fa-4fe8-92c2-21d831d75625 tempest-AttachVolumeTestJSON-1856227952 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 21:56:57 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-820fb829-c5fa-4fe8-92c2-21d831d75625 tempest-AttachVolumeTestJSON-1856227952 None] Flow 'volume_create_manager' (906eeec7-7d5e-433a-b787-d3fcce2e7624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 21:56:57 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-820fb829-c5fa-4fe8-92c2-21d831d75625 tempest-AttachVolumeTestJSON-1856227952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86d7961b-04d6-4fe3-ad7f-4160e359c937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:56:57 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-820fb829-c5fa-4fe8-92c2-21d831d75625 tempest-AttachVolumeTestJSON-1856227952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86d7961b-04d6-4fe3-ad7f-4160e359c937) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T19:56:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-493217817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cef6dd34-106b-42c0-8ae6-f7bc03bda472,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81918c7c6a5643b59650eebca8ab955a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T19:56:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T19:56:57Z,use_quota=True,user_id='c42559f054074fac9b7b532ae7d34658',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:56:57 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-820fb829-c5fa-4fe8-92c2-21d831d75625 tempest-AttachVolumeTestJSON-1856227952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e48a214e-98be-428e-834f-fc4dcb0dfce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:56:57 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-820fb829-c5fa-4fe8-92c2-21d831d75625 tempest-AttachVolumeTestJSON-1856227952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e48a214e-98be-428e-834f-fc4dcb0dfce5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:56:57 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-820fb829-c5fa-4fe8-92c2-21d831d75625 tempest-AttachVolumeTestJSON-1856227952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (227b120f-e6e0-4be3-a364-9385257f8f6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:56:57 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-820fb829-c5fa-4fe8-92c2-21d831d75625 tempest-AttachVolumeTestJSON-1856227952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (227b120f-e6e0-4be3-a364-9385257f8f6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cef6dd34-106b-42c0-8ae6-f7bc03bda472', 'volume_name': 'volume-cef6dd34-106b-42c0-8ae6-f7bc03bda472', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:56:57 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-820fb829-c5fa-4fe8-92c2-21d831d75625 tempest-AttachVolumeTestJSON-1856227952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f1cc07a-09d8-4c2a-9e3c-023226371c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:56:57 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-820fb829-c5fa-4fe8-92c2-21d831d75625 tempest-AttachVolumeTestJSON-1856227952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f1cc07a-09d8-4c2a-9e3c-023226371c6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:56:57 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-820fb829-c5fa-4fe8-92c2-21d831d75625 tempest-AttachVolumeTestJSON-1856227952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fb79222-2fcb-4852-a9db-cd322f00e13e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:56:57 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-820fb829-c5fa-4fe8-92c2-21d831d75625 tempest-AttachVolumeTestJSON-1856227952 None] Volume cef6dd34-106b-42c0-8ae6-f7bc03bda472: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cef6dd34-106b-42c0-8ae6-f7bc03bda472', 'volume_size': 1} Sep 17 21:56:57 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-820fb829-c5fa-4fe8-92c2-21d831d75625 tempest-AttachVolumeTestJSON-1856227952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:56:57 devstack sudo[93694]: pam_unix(sudo:session): session closed for user root Sep 17 21:56:57 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-52b33481-eb24-4da5-8aea-4cb75a3ee25f tempest-SnapshotsActionsTest-405643259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.info" returned: 0 in 0.322s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:56:57 devstack cinder-volume[85458]: WARNING cinder.volume.drivers.remotefs [None req-52b33481-eb24-4da5-8aea-4cb75a3ee25f tempest-SnapshotsActionsTest-405643259 None] /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.info is being set with open permissions: ugo+rw Sep 17 21:56:57 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-52b33481-eb24-4da5-8aea-4cb75a3ee25f tempest-SnapshotsActionsTest-405643259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.info {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:56:57 devstack sudo[93697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.info Sep 17 21:56:57 devstack sudo[93697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:56:57 devstack sudo[93697]: pam_unix(sudo:session): session closed for user root Sep 17 21:56:57 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-52b33481-eb24-4da5-8aea-4cb75a3ee25f tempest-SnapshotsActionsTest-405643259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.info" returned: 0 in 0.277s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:56:57 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-52b33481-eb24-4da5-8aea-4cb75a3ee25f tempest-SnapshotsActionsTest-405643259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.617s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:56:57 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-820fb829-c5fa-4fe8-92c2-21d831d75625 tempest-AttachVolumeTestJSON-1856227952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.377s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:56:57 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-820fb829-c5fa-4fe8-92c2-21d831d75625 tempest-AttachVolumeTestJSON-1856227952 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T19:56:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-493217817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cef6dd34-106b-42c0-8ae6-f7bc03bda472,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81918c7c6a5643b59650eebca8ab955a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T19:56:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T19:56:57Z,use_quota=True,user_id='c42559f054074fac9b7b532ae7d34658',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 21:56:57 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-820fb829-c5fa-4fe8-92c2-21d831d75625 tempest-AttachVolumeTestJSON-1856227952 None] Creating volume cef6dd34-106b-42c0-8ae6-f7bc03bda472 {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 21:56:57 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-820fb829-c5fa-4fe8-92c2-21d831d75625 tempest-AttachVolumeTestJSON-1856227952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:56:57 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-820fb829-c5fa-4fe8-92c2-21d831d75625 tempest-AttachVolumeTestJSON-1856227952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:56:57 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-820fb829-c5fa-4fe8-92c2-21d831d75625 tempest-AttachVolumeTestJSON-1856227952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 21:56:57 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-820fb829-c5fa-4fe8-92c2-21d831d75625 tempest-AttachVolumeTestJSON-1856227952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 21:56:57 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-820fb829-c5fa-4fe8-92c2-21d831d75625 tempest-AttachVolumeTestJSON-1856227952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:56:57 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-820fb829-c5fa-4fe8-92c2-21d831d75625 tempest-AttachVolumeTestJSON-1856227952 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 21:56:57 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-820fb829-c5fa-4fe8-92c2-21d831d75625 tempest-AttachVolumeTestJSON-1856227952 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 21:56:57 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-820fb829-c5fa-4fe8-92c2-21d831d75625 tempest-AttachVolumeTestJSON-1856227952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cef6dd34-106b-42c0-8ae6-f7bc03bda472 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:56:57 devstack sudo[93700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cef6dd34-106b-42c0-8ae6-f7bc03bda472 1073741824 Sep 17 21:56:57 devstack sudo[93700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:56:57 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-52b33481-eb24-4da5-8aea-4cb75a3ee25f tempest-SnapshotsActionsTest-405643259 None] Create snapshot completed successfully Sep 17 21:56:58 devstack sudo[93700]: pam_unix(sudo:session): session closed for user root Sep 17 21:56:58 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-820fb829-c5fa-4fe8-92c2-21d831d75625 tempest-AttachVolumeTestJSON-1856227952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cef6dd34-106b-42c0-8ae6-f7bc03bda472 1073741824" returned: 0 in 0.507s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:56:58 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-820fb829-c5fa-4fe8-92c2-21d831d75625 tempest-AttachVolumeTestJSON-1856227952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cef6dd34-106b-42c0-8ae6-f7bc03bda472 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:56:58 devstack sudo[93706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cef6dd34-106b-42c0-8ae6-f7bc03bda472 Sep 17 21:56:58 devstack sudo[93706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:56:58 devstack sudo[93706]: pam_unix(sudo:session): session closed for user root Sep 17 21:56:58 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-820fb829-c5fa-4fe8-92c2-21d831d75625 tempest-AttachVolumeTestJSON-1856227952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cef6dd34-106b-42c0-8ae6-f7bc03bda472" returned: 0 in 0.263s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:56:58 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-820fb829-c5fa-4fe8-92c2-21d831d75625 tempest-AttachVolumeTestJSON-1856227952 None] <== create_volume: return (823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 21:56:58 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-820fb829-c5fa-4fe8-92c2-21d831d75625 tempest-AttachVolumeTestJSON-1856227952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.826s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:56:58 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-820fb829-c5fa-4fe8-92c2-21d831d75625 tempest-AttachVolumeTestJSON-1856227952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fb79222-2fcb-4852-a9db-cd322f00e13e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cef6dd34-106b-42c0-8ae6-f7bc03bda472', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:56:58 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-820fb829-c5fa-4fe8-92c2-21d831d75625 tempest-AttachVolumeTestJSON-1856227952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (414f8913-043b-4d53-8aee-70598f3c6644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:56:58 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-820fb829-c5fa-4fe8-92c2-21d831d75625 tempest-AttachVolumeTestJSON-1856227952 None] Volume volume-cef6dd34-106b-42c0-8ae6-f7bc03bda472 (cef6dd34-106b-42c0-8ae6-f7bc03bda472): created successfully Sep 17 21:56:58 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-820fb829-c5fa-4fe8-92c2-21d831d75625 tempest-AttachVolumeTestJSON-1856227952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (414f8913-043b-4d53-8aee-70598f3c6644) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:56:58 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-820fb829-c5fa-4fe8-92c2-21d831d75625 tempest-AttachVolumeTestJSON-1856227952 None] Flow 'volume_create_manager' (906eeec7-7d5e-433a-b787-d3fcce2e7624) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 21:56:58 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-820fb829-c5fa-4fe8-92c2-21d831d75625 tempest-AttachVolumeTestJSON-1856227952 None] Created volume successfully. Sep 17 21:56:59 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-77659a24-08bd-4e5d-abbe-1e8353e1845d tempest-SnapshotsActionsTest-405643259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:56:59 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-77659a24-08bd-4e5d-abbe-1e8353e1845d tempest-SnapshotsActionsTest-405643259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:56:59 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-77659a24-08bd-4e5d-abbe-1e8353e1845d tempest-SnapshotsActionsTest-405643259 None] Creating offline snapshot 1ec33fb8-ad87-42fd-a50a-43f6c88c7fba of volume 031315b6-e4a1-49fb-9eca-70005ccac72f {{(pid=85458) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 21:56:59 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[98a5440a-12e4-4da3-90b7-fb3dc972ec7b]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 21:56:59 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-77659a24-08bd-4e5d-abbe-1e8353e1845d tempest-SnapshotsActionsTest-405643259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.f0be6290-85f2-404a-b192-6f307aaddde6 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:56:59 devstack sudo[93710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.f0be6290-85f2-404a-b192-6f307aaddde6 Sep 17 21:56:59 devstack sudo[93710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:56:59 devstack sudo[93710]: pam_unix(sudo:session): session closed for user root Sep 17 21:56:59 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-77659a24-08bd-4e5d-abbe-1e8353e1845d tempest-SnapshotsActionsTest-405643259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.f0be6290-85f2-404a-b192-6f307aaddde6" returned: 0 in 0.593s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:56:59 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-77659a24-08bd-4e5d-abbe-1e8353e1845d tempest-SnapshotsActionsTest-405643259 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-031315b6-e4a1-49fb-9eca-70005ccac72f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85458) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 21:56:59 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-77659a24-08bd-4e5d-abbe-1e8353e1845d tempest-SnapshotsActionsTest-405643259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.f0be6290-85f2-404a-b192-6f307aaddde6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.1ec33fb8-ad87-42fd-a50a-43f6c88c7fba 1G {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:57:00 devstack sudo[93721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.f0be6290-85f2-404a-b192-6f307aaddde6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.1ec33fb8-ad87-42fd-a50a-43f6c88c7fba 1G Sep 17 21:57:00 devstack sudo[93721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:57:00 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [req-5df8125a-ba46-4413-a98c-23d538982384 req-000c7e81-ef80-467d-94f6-a8c0450f2dba tempest-AttachVolumeTestJSON-1856227952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:57:00 devstack sudo[93721]: pam_unix(sudo:session): session closed for user root Sep 17 21:57:00 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-77659a24-08bd-4e5d-abbe-1e8353e1845d tempest-SnapshotsActionsTest-405643259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.f0be6290-85f2-404a-b192-6f307aaddde6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.1ec33fb8-ad87-42fd-a50a-43f6c88c7fba 1G" returned: 0 in 0.593s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:57:00 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-77659a24-08bd-4e5d-abbe-1e8353e1845d tempest-SnapshotsActionsTest-405643259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-031315b6-e4a1-49fb-9eca-70005ccac72f.f0be6290-85f2-404a-b192-6f307aaddde6 -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.1ec33fb8-ad87-42fd-a50a-43f6c88c7fba {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:57:00 devstack sudo[93735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-031315b6-e4a1-49fb-9eca-70005ccac72f.f0be6290-85f2-404a-b192-6f307aaddde6 -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.1ec33fb8-ad87-42fd-a50a-43f6c88c7fba Sep 17 21:57:00 devstack sudo[93735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:57:00 devstack sudo[93735]: pam_unix(sudo:session): session closed for user root Sep 17 21:57:00 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-77659a24-08bd-4e5d-abbe-1e8353e1845d tempest-SnapshotsActionsTest-405643259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-031315b6-e4a1-49fb-9eca-70005ccac72f.f0be6290-85f2-404a-b192-6f307aaddde6 -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.1ec33fb8-ad87-42fd-a50a-43f6c88c7fba" returned: 0 in 0.338s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:57:00 devstack cinder-volume[85458]: WARNING cinder.volume.drivers.remotefs [None req-77659a24-08bd-4e5d-abbe-1e8353e1845d tempest-SnapshotsActionsTest-405643259 None] /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.1ec33fb8-ad87-42fd-a50a-43f6c88c7fba is being set with open permissions: ugo+rw Sep 17 21:57:00 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-77659a24-08bd-4e5d-abbe-1e8353e1845d tempest-SnapshotsActionsTest-405643259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.1ec33fb8-ad87-42fd-a50a-43f6c88c7fba {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:57:00 devstack sudo[93740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.1ec33fb8-ad87-42fd-a50a-43f6c88c7fba Sep 17 21:57:00 devstack sudo[93740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:57:01 devstack sudo[93740]: pam_unix(sudo:session): session closed for user root Sep 17 21:57:01 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-77659a24-08bd-4e5d-abbe-1e8353e1845d tempest-SnapshotsActionsTest-405643259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.1ec33fb8-ad87-42fd-a50a-43f6c88c7fba" returned: 0 in 0.366s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:57:01 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-77659a24-08bd-4e5d-abbe-1e8353e1845d tempest-SnapshotsActionsTest-405643259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.082s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:57:01 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [req-5df8125a-ba46-4413-a98c-23d538982384 req-000c7e81-ef80-467d-94f6-a8c0450f2dba tempest-AttachVolumeTestJSON-1856227952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.032s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:57:01 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [req-5df8125a-ba46-4413-a98c-23d538982384 req-000c7e81-ef80-467d-94f6-a8c0450f2dba tempest-AttachVolumeTestJSON-1856227952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:57:01 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-77659a24-08bd-4e5d-abbe-1e8353e1845d tempest-SnapshotsActionsTest-405643259 None] Create snapshot completed successfully Sep 17 21:57:01 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [req-5df8125a-ba46-4413-a98c-23d538982384 req-000c7e81-ef80-467d-94f6-a8c0450f2dba tempest-AttachVolumeTestJSON-1856227952 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5', 'name': 'volume-cef6dd34-106b-42c0-8ae6-f7bc03bda472', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd6ae1978-1b85-4dea-a4ab-def7f6cdf83a', 'enforce_multipath': True} {{(pid=85458) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 21:57:01 devstack cinder-volume[85458]: INFO cinder.volume.manager [req-5df8125a-ba46-4413-a98c-23d538982384 req-000c7e81-ef80-467d-94f6-a8c0450f2dba tempest-AttachVolumeTestJSON-1856227952 None] attachment_update completed successfully. Sep 17 21:57:02 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-5e40a9e2-5c07-485b-8573-626c41580df9 tempest-SnapshotsActionsTest-733634761 None] Acquiring lock "cinder-1ec33fb8-ad87-42fd-a50a-43f6c88c7fba-delete_snapshot" by "delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 21:57:02 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-5e40a9e2-5c07-485b-8573-626c41580df9 tempest-SnapshotsActionsTest-733634761 None] Lock "cinder-1ec33fb8-ad87-42fd-a50a-43f6c88c7fba-delete_snapshot" acquired by "delete_snapshot" :: waited 0.050s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 21:57:02 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-5e40a9e2-5c07-485b-8573-626c41580df9 tempest-SnapshotsActionsTest-733634761 None] Acquiring lock "cinder-quobyte-031315b6-e4a1-49fb-9eca-70005ccac72f" by "delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 21:57:02 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-5e40a9e2-5c07-485b-8573-626c41580df9 tempest-SnapshotsActionsTest-733634761 None] Lock "cinder-quobyte-031315b6-e4a1-49fb-9eca-70005ccac72f" acquired by "delete_snapshot" :: waited 0.033s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 21:57:02 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-5e40a9e2-5c07-485b-8573-626c41580df9 tempest-SnapshotsActionsTest-733634761 None] Acquiring lock "cinder-quobyte-1ec33fb8-ad87-42fd-a50a-43f6c88c7fba" by "_delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 21:57:02 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-5e40a9e2-5c07-485b-8573-626c41580df9 tempest-SnapshotsActionsTest-733634761 None] Lock "cinder-quobyte-1ec33fb8-ad87-42fd-a50a-43f6c88c7fba" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 21:57:02 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-5e40a9e2-5c07-485b-8573-626c41580df9 tempest-SnapshotsActionsTest-733634761 None] Deleting offline snapshot 1ec33fb8-ad87-42fd-a50a-43f6c88c7fba of volume 031315b6-e4a1-49fb-9eca-70005ccac72f {{(pid=85458) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 21:57:02 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-5e40a9e2-5c07-485b-8573-626c41580df9 tempest-SnapshotsActionsTest-733634761 None] snapshot_file for this snap is: volume-031315b6-e4a1-49fb-9eca-70005ccac72f.1ec33fb8-ad87-42fd-a50a-43f6c88c7fba {{(pid=85458) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 21:57:02 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[efdf43a3-8f01-416a-a979-4db96b5a31a2]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 21:57:02 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-5e40a9e2-5c07-485b-8573-626c41580df9 tempest-SnapshotsActionsTest-733634761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.1ec33fb8-ad87-42fd-a50a-43f6c88c7fba {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:57:03 devstack sudo[93765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.1ec33fb8-ad87-42fd-a50a-43f6c88c7fba Sep 17 21:57:03 devstack sudo[93765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:57:03 devstack sudo[93765]: pam_unix(sudo:session): session closed for user root Sep 17 21:57:03 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-5e40a9e2-5c07-485b-8573-626c41580df9 tempest-SnapshotsActionsTest-733634761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.1ec33fb8-ad87-42fd-a50a-43f6c88c7fba" returned: 0 in 0.477s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:57:03 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-5e40a9e2-5c07-485b-8573-626c41580df9 tempest-SnapshotsActionsTest-733634761 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-031315b6-e4a1-49fb-9eca-70005ccac72f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85458) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 21:57:03 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[295f5816-e204-4bfd-813c-153711bce3f6]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 21:57:03 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-5e40a9e2-5c07-485b-8573-626c41580df9 tempest-SnapshotsActionsTest-733634761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.f0be6290-85f2-404a-b192-6f307aaddde6 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:57:03 devstack cinder-volume[85458]: INFO cinder.volume.manager [req-a6b60e85-8316-47cd-9169-492204583e91 req-ef6813da-1646-4363-a569-5f55795120d6 tempest-AttachVolumeTestJSON-1856227952 None] Terminate volume connection completed successfully. Sep 17 21:57:03 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [req-a6b60e85-8316-47cd-9169-492204583e91 req-ef6813da-1646-4363-a569-5f55795120d6 tempest-AttachVolumeTestJSON-1856227952 None] Deleting attachment 5b6f1665-d381-46c1-bf02-f04596e9683c. {{(pid=85458) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 21:57:03 devstack sudo[93772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.f0be6290-85f2-404a-b192-6f307aaddde6 Sep 17 21:57:03 devstack sudo[93772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:57:03 devstack sudo[93772]: pam_unix(sudo:session): session closed for user root Sep 17 21:57:03 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-5e40a9e2-5c07-485b-8573-626c41580df9 tempest-SnapshotsActionsTest-733634761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.f0be6290-85f2-404a-b192-6f307aaddde6" returned: 0 in 0.421s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:57:03 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-5e40a9e2-5c07-485b-8573-626c41580df9 tempest-SnapshotsActionsTest-733634761 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-031315b6-e4a1-49fb-9eca-70005ccac72f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85458) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 21:57:03 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-5e40a9e2-5c07-485b-8573-626c41580df9 tempest-SnapshotsActionsTest-733634761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.1ec33fb8-ad87-42fd-a50a-43f6c88c7fba {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:57:03 devstack sudo[93780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.1ec33fb8-ad87-42fd-a50a-43f6c88c7fba Sep 17 21:57:03 devstack sudo[93780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:57:04 devstack sudo[93780]: pam_unix(sudo:session): session closed for user root Sep 17 21:57:04 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-5e40a9e2-5c07-485b-8573-626c41580df9 tempest-SnapshotsActionsTest-733634761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.1ec33fb8-ad87-42fd-a50a-43f6c88c7fba" returned: 0 in 0.416s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:57:04 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-5e40a9e2-5c07-485b-8573-626c41580df9 tempest-SnapshotsActionsTest-733634761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.1ec33fb8-ad87-42fd-a50a-43f6c88c7fba {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:57:04 devstack sudo[93785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.1ec33fb8-ad87-42fd-a50a-43f6c88c7fba Sep 17 21:57:04 devstack sudo[93785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:57:04 devstack sudo[93785]: pam_unix(sudo:session): session closed for user root Sep 17 21:57:04 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-5e40a9e2-5c07-485b-8573-626c41580df9 tempest-SnapshotsActionsTest-733634761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.1ec33fb8-ad87-42fd-a50a-43f6c88c7fba" returned: 0 in 0.285s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:57:04 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-5e40a9e2-5c07-485b-8573-626c41580df9 tempest-SnapshotsActionsTest-733634761 None] Lock "cinder-quobyte-1ec33fb8-ad87-42fd-a50a-43f6c88c7fba" released by "_delete_snapshot" :: held 1.748s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 21:57:04 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-5e40a9e2-5c07-485b-8573-626c41580df9 tempest-SnapshotsActionsTest-733634761 None] Lock "cinder-quobyte-031315b6-e4a1-49fb-9eca-70005ccac72f" released by "delete_snapshot" :: held 1.780s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 21:57:04 devstack cinder-volume[85458]: WARNING cinder.quota [None req-5e40a9e2-5c07-485b-8573-626c41580df9 tempest-SnapshotsActionsTest-733634761 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 17 21:57:04 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-5e40a9e2-5c07-485b-8573-626c41580df9 tempest-SnapshotsActionsTest-733634761 None] Created reservations ['cd435bc1-22bb-47f8-bc05-c28e7da1ca4e', '470a542d-ed4e-4bfa-97f5-2dfc5f6d31ac', '43e45ec8-33e1-4f08-94b3-d3066f08ed99', 'fa155a3f-fb7b-4966-8158-0f1dd354e57d'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 21:57:04 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-5e40a9e2-5c07-485b-8573-626c41580df9 tempest-SnapshotsActionsTest-733634761 None] Delete snapshot completed successfully. Sep 17 21:57:04 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-5e40a9e2-5c07-485b-8573-626c41580df9 tempest-SnapshotsActionsTest-733634761 None] Lock "cinder-1ec33fb8-ad87-42fd-a50a-43f6c88c7fba-delete_snapshot" released by "delete_snapshot" :: held 2.033s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 21:57:05 devstack cinder-volume[85458]: INFO cinder.volume.manager [req-a6b4062c-b0ae-4db0-957e-1fdaabe097c0 req-20832c77-7b35-4264-8d19-bbb435ba1b09 tempest-AttachVolumeTestJSON-1856227952 None] Terminate volume connection completed successfully. Sep 17 21:57:05 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [req-a6b4062c-b0ae-4db0-957e-1fdaabe097c0 req-20832c77-7b35-4264-8d19-bbb435ba1b09 tempest-AttachVolumeTestJSON-1856227952 None] Deleting attachment d6ae1978-1b85-4dea-a4ab-def7f6cdf83a. {{(pid=85458) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 21:57:05 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-0ff0ca48-1a75-46c6-8ab3-28640ffb5b30 tempest-SnapshotsActionsTest-405643259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:57:05 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-0ff0ca48-1a75-46c6-8ab3-28640ffb5b30 tempest-SnapshotsActionsTest-405643259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:57:05 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-0ff0ca48-1a75-46c6-8ab3-28640ffb5b30 tempest-SnapshotsActionsTest-405643259 None] Creating offline snapshot 1514160b-0704-4e65-9076-6fa7acdabf94 of volume 031315b6-e4a1-49fb-9eca-70005ccac72f {{(pid=85458) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 21:57:05 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[7de7811e-ef76-4ae7-b8a9-85247fe5082d]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 21:57:05 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-0ff0ca48-1a75-46c6-8ab3-28640ffb5b30 tempest-SnapshotsActionsTest-405643259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.f0be6290-85f2-404a-b192-6f307aaddde6 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:57:05 devstack sudo[93816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.f0be6290-85f2-404a-b192-6f307aaddde6 Sep 17 21:57:05 devstack sudo[93816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:57:05 devstack sudo[93816]: pam_unix(sudo:session): session closed for user root Sep 17 21:57:05 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-0ff0ca48-1a75-46c6-8ab3-28640ffb5b30 tempest-SnapshotsActionsTest-405643259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.f0be6290-85f2-404a-b192-6f307aaddde6" returned: 0 in 0.419s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:57:05 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-0ff0ca48-1a75-46c6-8ab3-28640ffb5b30 tempest-SnapshotsActionsTest-405643259 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-031315b6-e4a1-49fb-9eca-70005ccac72f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85458) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 21:57:05 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-0ff0ca48-1a75-46c6-8ab3-28640ffb5b30 tempest-SnapshotsActionsTest-405643259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.f0be6290-85f2-404a-b192-6f307aaddde6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.1514160b-0704-4e65-9076-6fa7acdabf94 1G {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:57:05 devstack sudo[93821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.f0be6290-85f2-404a-b192-6f307aaddde6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.1514160b-0704-4e65-9076-6fa7acdabf94 1G Sep 17 21:57:05 devstack sudo[93821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:57:06 devstack sudo[93821]: pam_unix(sudo:session): session closed for user root Sep 17 21:57:06 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-0ff0ca48-1a75-46c6-8ab3-28640ffb5b30 tempest-SnapshotsActionsTest-405643259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.f0be6290-85f2-404a-b192-6f307aaddde6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.1514160b-0704-4e65-9076-6fa7acdabf94 1G" returned: 0 in 0.511s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:57:06 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-0ff0ca48-1a75-46c6-8ab3-28640ffb5b30 tempest-SnapshotsActionsTest-405643259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-031315b6-e4a1-49fb-9eca-70005ccac72f.f0be6290-85f2-404a-b192-6f307aaddde6 -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.1514160b-0704-4e65-9076-6fa7acdabf94 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:57:06 devstack sudo[93827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-031315b6-e4a1-49fb-9eca-70005ccac72f.f0be6290-85f2-404a-b192-6f307aaddde6 -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.1514160b-0704-4e65-9076-6fa7acdabf94 Sep 17 21:57:06 devstack sudo[93827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:57:06 devstack sudo[93827]: pam_unix(sudo:session): session closed for user root Sep 17 21:57:06 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-0ff0ca48-1a75-46c6-8ab3-28640ffb5b30 tempest-SnapshotsActionsTest-405643259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-031315b6-e4a1-49fb-9eca-70005ccac72f.f0be6290-85f2-404a-b192-6f307aaddde6 -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.1514160b-0704-4e65-9076-6fa7acdabf94" returned: 0 in 0.388s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:57:06 devstack cinder-volume[85458]: WARNING cinder.volume.drivers.remotefs [None req-0ff0ca48-1a75-46c6-8ab3-28640ffb5b30 tempest-SnapshotsActionsTest-405643259 None] /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.1514160b-0704-4e65-9076-6fa7acdabf94 is being set with open permissions: ugo+rw Sep 17 21:57:06 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-0ff0ca48-1a75-46c6-8ab3-28640ffb5b30 tempest-SnapshotsActionsTest-405643259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.1514160b-0704-4e65-9076-6fa7acdabf94 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:57:06 devstack sudo[93841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.1514160b-0704-4e65-9076-6fa7acdabf94 Sep 17 21:57:06 devstack sudo[93841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:57:07 devstack sudo[93841]: pam_unix(sudo:session): session closed for user root Sep 17 21:57:07 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-0ff0ca48-1a75-46c6-8ab3-28640ffb5b30 tempest-SnapshotsActionsTest-405643259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.1514160b-0704-4e65-9076-6fa7acdabf94" returned: 0 in 0.402s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:57:07 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-0ff0ca48-1a75-46c6-8ab3-28640ffb5b30 tempest-SnapshotsActionsTest-405643259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.863s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:57:07 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-0ff0ca48-1a75-46c6-8ab3-28640ffb5b30 tempest-SnapshotsActionsTest-405643259 None] Create snapshot completed successfully Sep 17 21:57:07 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-17ce8979-af27-40d1-8968-4dfe8284a01c tempest-SnapshotsActionsTest-733634761 None] Acquiring lock "cinder-1514160b-0704-4e65-9076-6fa7acdabf94-delete_snapshot" by "delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 21:57:07 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-17ce8979-af27-40d1-8968-4dfe8284a01c tempest-SnapshotsActionsTest-733634761 None] Lock "cinder-1514160b-0704-4e65-9076-6fa7acdabf94-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 21:57:07 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-17ce8979-af27-40d1-8968-4dfe8284a01c tempest-SnapshotsActionsTest-733634761 None] Acquiring lock "cinder-quobyte-031315b6-e4a1-49fb-9eca-70005ccac72f" by "delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 21:57:07 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-17ce8979-af27-40d1-8968-4dfe8284a01c tempest-SnapshotsActionsTest-733634761 None] Lock "cinder-quobyte-031315b6-e4a1-49fb-9eca-70005ccac72f" acquired by "delete_snapshot" :: waited 0.028s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 21:57:07 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-17ce8979-af27-40d1-8968-4dfe8284a01c tempest-SnapshotsActionsTest-733634761 None] Acquiring lock "cinder-quobyte-1514160b-0704-4e65-9076-6fa7acdabf94" by "_delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 21:57:07 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-17ce8979-af27-40d1-8968-4dfe8284a01c tempest-SnapshotsActionsTest-733634761 None] Lock "cinder-quobyte-1514160b-0704-4e65-9076-6fa7acdabf94" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 21:57:07 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-17ce8979-af27-40d1-8968-4dfe8284a01c tempest-SnapshotsActionsTest-733634761 None] Deleting offline snapshot 1514160b-0704-4e65-9076-6fa7acdabf94 of volume 031315b6-e4a1-49fb-9eca-70005ccac72f {{(pid=85458) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 21:57:07 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-17ce8979-af27-40d1-8968-4dfe8284a01c tempest-SnapshotsActionsTest-733634761 None] snapshot_file for this snap is: volume-031315b6-e4a1-49fb-9eca-70005ccac72f.1514160b-0704-4e65-9076-6fa7acdabf94 {{(pid=85458) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 21:57:07 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d372185-39df-4b0f-8604-5ebc6167726b]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 21:57:07 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-17ce8979-af27-40d1-8968-4dfe8284a01c tempest-SnapshotsActionsTest-733634761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.1514160b-0704-4e65-9076-6fa7acdabf94 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:57:07 devstack sudo[93855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.1514160b-0704-4e65-9076-6fa7acdabf94 Sep 17 21:57:07 devstack sudo[93855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:57:08 devstack sudo[93855]: pam_unix(sudo:session): session closed for user root Sep 17 21:57:08 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-17ce8979-af27-40d1-8968-4dfe8284a01c tempest-SnapshotsActionsTest-733634761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.1514160b-0704-4e65-9076-6fa7acdabf94" returned: 0 in 0.520s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:57:08 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-17ce8979-af27-40d1-8968-4dfe8284a01c tempest-SnapshotsActionsTest-733634761 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-031315b6-e4a1-49fb-9eca-70005ccac72f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85458) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 21:57:08 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e012d55-1a61-4b07-8120-dfc4485e83d9]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 21:57:08 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-17ce8979-af27-40d1-8968-4dfe8284a01c tempest-SnapshotsActionsTest-733634761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.f0be6290-85f2-404a-b192-6f307aaddde6 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:57:08 devstack sudo[93862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.f0be6290-85f2-404a-b192-6f307aaddde6 Sep 17 21:57:08 devstack sudo[93862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:57:08 devstack sudo[93862]: pam_unix(sudo:session): session closed for user root Sep 17 21:57:08 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-17ce8979-af27-40d1-8968-4dfe8284a01c tempest-SnapshotsActionsTest-733634761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.f0be6290-85f2-404a-b192-6f307aaddde6" returned: 0 in 0.478s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:57:08 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-17ce8979-af27-40d1-8968-4dfe8284a01c tempest-SnapshotsActionsTest-733634761 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-031315b6-e4a1-49fb-9eca-70005ccac72f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85458) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 21:57:08 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-17ce8979-af27-40d1-8968-4dfe8284a01c tempest-SnapshotsActionsTest-733634761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.1514160b-0704-4e65-9076-6fa7acdabf94 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:57:08 devstack sudo[93870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.1514160b-0704-4e65-9076-6fa7acdabf94 Sep 17 21:57:08 devstack sudo[93870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:57:09 devstack sudo[93870]: pam_unix(sudo:session): session closed for user root Sep 17 21:57:09 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-17ce8979-af27-40d1-8968-4dfe8284a01c tempest-SnapshotsActionsTest-733634761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.1514160b-0704-4e65-9076-6fa7acdabf94" returned: 0 in 0.692s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:57:09 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-17ce8979-af27-40d1-8968-4dfe8284a01c tempest-SnapshotsActionsTest-733634761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.1514160b-0704-4e65-9076-6fa7acdabf94 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:57:09 devstack sudo[93876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.1514160b-0704-4e65-9076-6fa7acdabf94 Sep 17 21:57:09 devstack sudo[93876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:57:09 devstack sudo[93876]: pam_unix(sudo:session): session closed for user root Sep 17 21:57:09 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-17ce8979-af27-40d1-8968-4dfe8284a01c tempest-SnapshotsActionsTest-733634761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.1514160b-0704-4e65-9076-6fa7acdabf94" returned: 0 in 0.284s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:57:09 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-17ce8979-af27-40d1-8968-4dfe8284a01c tempest-SnapshotsActionsTest-733634761 None] Lock "cinder-quobyte-1514160b-0704-4e65-9076-6fa7acdabf94" released by "_delete_snapshot" :: held 2.122s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 21:57:09 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-17ce8979-af27-40d1-8968-4dfe8284a01c tempest-SnapshotsActionsTest-733634761 None] Lock "cinder-quobyte-031315b6-e4a1-49fb-9eca-70005ccac72f" released by "delete_snapshot" :: held 2.160s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 21:57:09 devstack cinder-volume[85458]: DEBUG dbcounter [-] [85458] Writing DB stats cinder:SELECT=99,cinder:UPDATE=97,cinder:DELETE=5,cinder:INSERT=16 {{(pid=85458) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 21:57:09 devstack cinder-volume[85458]: DEBUG dbcounter [-] [85458] Writing DB stats cinder:UPDATE=95,cinder:SELECT=110,cinder:INSERT=23,cinder:DELETE=5 {{(pid=85458) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 21:57:09 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-17ce8979-af27-40d1-8968-4dfe8284a01c tempest-SnapshotsActionsTest-733634761 None] Created reservations ['e6e4cc87-3eb1-4c6e-9f96-cd1bf7038606', 'a20d277a-a721-4742-b0db-7cfeeb17cff8', 'fbe239b9-a30b-4c4f-bff8-6f2a2d069135', '7e99c44d-78fc-4065-983e-1f8391dbfa46'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 21:57:09 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-17ce8979-af27-40d1-8968-4dfe8284a01c tempest-SnapshotsActionsTest-733634761 None] Delete snapshot completed successfully. Sep 17 21:57:09 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-17ce8979-af27-40d1-8968-4dfe8284a01c tempest-SnapshotsActionsTest-733634761 None] Lock "cinder-1514160b-0704-4e65-9076-6fa7acdabf94-delete_snapshot" released by "delete_snapshot" :: held 2.452s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 21:57:11 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-cf843ba4-9679-4346-81bd-f1494510d5e0 tempest-SnapshotsActionsTest-405643259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:57:11 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-cf843ba4-9679-4346-81bd-f1494510d5e0 tempest-SnapshotsActionsTest-405643259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:57:11 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-cf843ba4-9679-4346-81bd-f1494510d5e0 tempest-SnapshotsActionsTest-405643259 None] Creating offline snapshot 7f3cd4e0-01f9-4d68-8c40-a5f23c03ec27 of volume 031315b6-e4a1-49fb-9eca-70005ccac72f {{(pid=85458) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 21:57:11 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c7a0b42-aff8-4f51-ad7b-8f0cfb5ed56a]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 21:57:11 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-cf843ba4-9679-4346-81bd-f1494510d5e0 tempest-SnapshotsActionsTest-405643259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.f0be6290-85f2-404a-b192-6f307aaddde6 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:57:11 devstack sudo[93879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.f0be6290-85f2-404a-b192-6f307aaddde6 Sep 17 21:57:11 devstack sudo[93879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:57:11 devstack sudo[93879]: pam_unix(sudo:session): session closed for user root Sep 17 21:57:11 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-cf843ba4-9679-4346-81bd-f1494510d5e0 tempest-SnapshotsActionsTest-405643259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.f0be6290-85f2-404a-b192-6f307aaddde6" returned: 0 in 0.427s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:57:11 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-cf843ba4-9679-4346-81bd-f1494510d5e0 tempest-SnapshotsActionsTest-405643259 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-031315b6-e4a1-49fb-9eca-70005ccac72f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85458) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 21:57:11 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-cf843ba4-9679-4346-81bd-f1494510d5e0 tempest-SnapshotsActionsTest-405643259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.f0be6290-85f2-404a-b192-6f307aaddde6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.7f3cd4e0-01f9-4d68-8c40-a5f23c03ec27 1G {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:57:11 devstack sudo[93885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.f0be6290-85f2-404a-b192-6f307aaddde6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.7f3cd4e0-01f9-4d68-8c40-a5f23c03ec27 1G Sep 17 21:57:11 devstack sudo[93885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:57:11 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-cb2b21ee-a6ff-47dd-8641-b5ea9417e304 tempest-AttachVolumeTestJSON-1856227952 None] Acquiring lock "cinder-cef6dd34-106b-42c0-8ae6-f7bc03bda472-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 21:57:11 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-cb2b21ee-a6ff-47dd-8641-b5ea9417e304 tempest-AttachVolumeTestJSON-1856227952 None] Lock "cinder-cef6dd34-106b-42c0-8ae6-f7bc03bda472-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 21:57:11 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-cb2b21ee-a6ff-47dd-8641-b5ea9417e304 tempest-AttachVolumeTestJSON-1856227952 None] Acquiring lock "cinder-quobyte-cef6dd34-106b-42c0-8ae6-f7bc03bda472" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 21:57:11 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-cb2b21ee-a6ff-47dd-8641-b5ea9417e304 tempest-AttachVolumeTestJSON-1856227952 None] Lock "cinder-quobyte-cef6dd34-106b-42c0-8ae6-f7bc03bda472" acquired by "delete_volume" :: waited 0.016s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 21:57:11 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[043091f1-7af9-4d27-90f3-dd7d5880aad7]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 21:57:11 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-cb2b21ee-a6ff-47dd-8641-b5ea9417e304 tempest-AttachVolumeTestJSON-1856227952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cef6dd34-106b-42c0-8ae6-f7bc03bda472 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:57:12 devstack sudo[93887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cef6dd34-106b-42c0-8ae6-f7bc03bda472 Sep 17 21:57:12 devstack sudo[93887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:57:12 devstack sudo[93885]: pam_unix(sudo:session): session closed for user root Sep 17 21:57:12 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-cf843ba4-9679-4346-81bd-f1494510d5e0 tempest-SnapshotsActionsTest-405643259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.f0be6290-85f2-404a-b192-6f307aaddde6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.7f3cd4e0-01f9-4d68-8c40-a5f23c03ec27 1G" returned: 0 in 0.558s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:57:12 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-cf843ba4-9679-4346-81bd-f1494510d5e0 tempest-SnapshotsActionsTest-405643259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-031315b6-e4a1-49fb-9eca-70005ccac72f.f0be6290-85f2-404a-b192-6f307aaddde6 -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.7f3cd4e0-01f9-4d68-8c40-a5f23c03ec27 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:57:12 devstack sudo[93894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-031315b6-e4a1-49fb-9eca-70005ccac72f.f0be6290-85f2-404a-b192-6f307aaddde6 -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.7f3cd4e0-01f9-4d68-8c40-a5f23c03ec27 Sep 17 21:57:12 devstack sudo[93894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:57:12 devstack sudo[93887]: pam_unix(sudo:session): session closed for user root Sep 17 21:57:12 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-cb2b21ee-a6ff-47dd-8641-b5ea9417e304 tempest-AttachVolumeTestJSON-1856227952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cef6dd34-106b-42c0-8ae6-f7bc03bda472" returned: 0 in 0.456s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:57:12 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-cb2b21ee-a6ff-47dd-8641-b5ea9417e304 tempest-AttachVolumeTestJSON-1856227952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cef6dd34-106b-42c0-8ae6-f7bc03bda472 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:57:12 devstack sudo[93898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cef6dd34-106b-42c0-8ae6-f7bc03bda472 Sep 17 21:57:12 devstack sudo[93898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:57:12 devstack sudo[93894]: pam_unix(sudo:session): session closed for user root Sep 17 21:57:12 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-cf843ba4-9679-4346-81bd-f1494510d5e0 tempest-SnapshotsActionsTest-405643259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-031315b6-e4a1-49fb-9eca-70005ccac72f.f0be6290-85f2-404a-b192-6f307aaddde6 -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.7f3cd4e0-01f9-4d68-8c40-a5f23c03ec27" returned: 0 in 0.319s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:57:12 devstack cinder-volume[85458]: WARNING cinder.volume.drivers.remotefs [None req-cf843ba4-9679-4346-81bd-f1494510d5e0 tempest-SnapshotsActionsTest-405643259 None] /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.7f3cd4e0-01f9-4d68-8c40-a5f23c03ec27 is being set with open permissions: ugo+rw Sep 17 21:57:12 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-cf843ba4-9679-4346-81bd-f1494510d5e0 tempest-SnapshotsActionsTest-405643259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.7f3cd4e0-01f9-4d68-8c40-a5f23c03ec27 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:57:12 devstack sudo[93904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.7f3cd4e0-01f9-4d68-8c40-a5f23c03ec27 Sep 17 21:57:12 devstack sudo[93904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:57:12 devstack sudo[93898]: pam_unix(sudo:session): session closed for user root Sep 17 21:57:12 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-cb2b21ee-a6ff-47dd-8641-b5ea9417e304 tempest-AttachVolumeTestJSON-1856227952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cef6dd34-106b-42c0-8ae6-f7bc03bda472" returned: 0 in 0.271s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:57:12 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-cb2b21ee-a6ff-47dd-8641-b5ea9417e304 tempest-AttachVolumeTestJSON-1856227952 None] Lock "cinder-quobyte-cef6dd34-106b-42c0-8ae6-f7bc03bda472" released by "delete_volume" :: held 0.775s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 21:57:12 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-cb2b21ee-a6ff-47dd-8641-b5ea9417e304 tempest-AttachVolumeTestJSON-1856227952 None] Created reservations ['36c65fee-98f5-49d3-8a2f-fe2805bfb78b', 'a11ddfeb-ca26-4428-a05f-0585e9ed76a5', 'b7d15bfa-923c-4fcc-ac87-911d9c0dd491', 'c11fd0b4-6f0f-431a-a6e2-6a8b8a4cd90b'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 21:57:12 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-cb2b21ee-a6ff-47dd-8641-b5ea9417e304 tempest-AttachVolumeTestJSON-1856227952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:57:12 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-cb2b21ee-a6ff-47dd-8641-b5ea9417e304 tempest-AttachVolumeTestJSON-1856227952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:57:12 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-cb2b21ee-a6ff-47dd-8641-b5ea9417e304 tempest-AttachVolumeTestJSON-1856227952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 21:57:12 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-cb2b21ee-a6ff-47dd-8641-b5ea9417e304 tempest-AttachVolumeTestJSON-1856227952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 21:57:12 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-cb2b21ee-a6ff-47dd-8641-b5ea9417e304 tempest-AttachVolumeTestJSON-1856227952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:57:12 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-cb2b21ee-a6ff-47dd-8641-b5ea9417e304 tempest-AttachVolumeTestJSON-1856227952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:57:12 devstack sudo[93906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 21:57:12 devstack sudo[93906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:57:12 devstack sudo[93904]: pam_unix(sudo:session): session closed for user root Sep 17 21:57:12 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-cf843ba4-9679-4346-81bd-f1494510d5e0 tempest-SnapshotsActionsTest-405643259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.7f3cd4e0-01f9-4d68-8c40-a5f23c03ec27" returned: 0 in 0.321s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:57:12 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-cf843ba4-9679-4346-81bd-f1494510d5e0 tempest-SnapshotsActionsTest-405643259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.780s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:57:12 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-c7bcf89c-791f-4f8e-824d-d9a76c452ef0 tempest-AttachVolumeTestJSON-1856227952 None] Acquiring lock "cinder-b7500956-5139-489a-8c16-5d10a00c26ed-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 21:57:13 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-cf843ba4-9679-4346-81bd-f1494510d5e0 tempest-SnapshotsActionsTest-405643259 None] Create snapshot completed successfully Sep 17 21:57:13 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-c7bcf89c-791f-4f8e-824d-d9a76c452ef0 tempest-AttachVolumeTestJSON-1856227952 None] Lock "cinder-b7500956-5139-489a-8c16-5d10a00c26ed-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 21:57:13 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-c7bcf89c-791f-4f8e-824d-d9a76c452ef0 tempest-AttachVolumeTestJSON-1856227952 None] Acquiring lock "cinder-quobyte-b7500956-5139-489a-8c16-5d10a00c26ed" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 21:57:13 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-c7bcf89c-791f-4f8e-824d-d9a76c452ef0 tempest-AttachVolumeTestJSON-1856227952 None] Lock "cinder-quobyte-b7500956-5139-489a-8c16-5d10a00c26ed" acquired by "delete_volume" :: waited 0.018s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 21:57:13 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[82d30bf0-f49e-48ce-8444-35929b4ae5c0]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 21:57:13 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-c7bcf89c-791f-4f8e-824d-d9a76c452ef0 tempest-AttachVolumeTestJSON-1856227952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b7500956-5139-489a-8c16-5d10a00c26ed {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:57:13 devstack sudo[93906]: pam_unix(sudo:session): session closed for user root Sep 17 21:57:13 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-cb2b21ee-a6ff-47dd-8641-b5ea9417e304 tempest-AttachVolumeTestJSON-1856227952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.319s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:57:13 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-cb2b21ee-a6ff-47dd-8641-b5ea9417e304 tempest-AttachVolumeTestJSON-1856227952 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 21:57:13 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-cb2b21ee-a6ff-47dd-8641-b5ea9417e304 tempest-AttachVolumeTestJSON-1856227952 None] Deleted volume successfully. Sep 17 21:57:13 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-cb2b21ee-a6ff-47dd-8641-b5ea9417e304 tempest-AttachVolumeTestJSON-1856227952 None] Lock "cinder-cef6dd34-106b-42c0-8ae6-f7bc03bda472-delete_volume" released by "delete_volume" :: held 1.354s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 21:57:13 devstack sudo[93910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b7500956-5139-489a-8c16-5d10a00c26ed Sep 17 21:57:13 devstack sudo[93910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:57:13 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-db4c40c2-817e-46ce-8dac-6f9184b7ebe5 tempest-SnapshotsActionsTest-733634761 None] Acquiring lock "cinder-7f3cd4e0-01f9-4d68-8c40-a5f23c03ec27-delete_snapshot" by "delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 21:57:13 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-db4c40c2-817e-46ce-8dac-6f9184b7ebe5 tempest-SnapshotsActionsTest-733634761 None] Lock "cinder-7f3cd4e0-01f9-4d68-8c40-a5f23c03ec27-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 21:57:13 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-db4c40c2-817e-46ce-8dac-6f9184b7ebe5 tempest-SnapshotsActionsTest-733634761 None] Acquiring lock "cinder-quobyte-031315b6-e4a1-49fb-9eca-70005ccac72f" by "delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 21:57:13 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-db4c40c2-817e-46ce-8dac-6f9184b7ebe5 tempest-SnapshotsActionsTest-733634761 None] Lock "cinder-quobyte-031315b6-e4a1-49fb-9eca-70005ccac72f" acquired by "delete_snapshot" :: waited 0.023s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 21:57:13 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-db4c40c2-817e-46ce-8dac-6f9184b7ebe5 tempest-SnapshotsActionsTest-733634761 None] Acquiring lock "cinder-quobyte-7f3cd4e0-01f9-4d68-8c40-a5f23c03ec27" by "_delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 21:57:13 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-db4c40c2-817e-46ce-8dac-6f9184b7ebe5 tempest-SnapshotsActionsTest-733634761 None] Lock "cinder-quobyte-7f3cd4e0-01f9-4d68-8c40-a5f23c03ec27" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 21:57:13 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-db4c40c2-817e-46ce-8dac-6f9184b7ebe5 tempest-SnapshotsActionsTest-733634761 None] Deleting offline snapshot 7f3cd4e0-01f9-4d68-8c40-a5f23c03ec27 of volume 031315b6-e4a1-49fb-9eca-70005ccac72f {{(pid=85458) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 21:57:13 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-db4c40c2-817e-46ce-8dac-6f9184b7ebe5 tempest-SnapshotsActionsTest-733634761 None] snapshot_file for this snap is: volume-031315b6-e4a1-49fb-9eca-70005ccac72f.7f3cd4e0-01f9-4d68-8c40-a5f23c03ec27 {{(pid=85458) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 21:57:13 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[c18a680a-2dfe-4830-87dc-613d62268879]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 21:57:13 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-db4c40c2-817e-46ce-8dac-6f9184b7ebe5 tempest-SnapshotsActionsTest-733634761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.7f3cd4e0-01f9-4d68-8c40-a5f23c03ec27 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:57:13 devstack sudo[93910]: pam_unix(sudo:session): session closed for user root Sep 17 21:57:13 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-c7bcf89c-791f-4f8e-824d-d9a76c452ef0 tempest-AttachVolumeTestJSON-1856227952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b7500956-5139-489a-8c16-5d10a00c26ed" returned: 0 in 0.488s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:57:13 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-c7bcf89c-791f-4f8e-824d-d9a76c452ef0 tempest-AttachVolumeTestJSON-1856227952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b7500956-5139-489a-8c16-5d10a00c26ed {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:57:13 devstack sudo[93919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b7500956-5139-489a-8c16-5d10a00c26ed Sep 17 21:57:13 devstack sudo[93919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:57:13 devstack sudo[93917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.7f3cd4e0-01f9-4d68-8c40-a5f23c03ec27 Sep 17 21:57:13 devstack sudo[93917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:57:13 devstack sudo[93919]: pam_unix(sudo:session): session closed for user root Sep 17 21:57:13 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-c7bcf89c-791f-4f8e-824d-d9a76c452ef0 tempest-AttachVolumeTestJSON-1856227952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b7500956-5139-489a-8c16-5d10a00c26ed" returned: 0 in 0.336s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:57:13 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-c7bcf89c-791f-4f8e-824d-d9a76c452ef0 tempest-AttachVolumeTestJSON-1856227952 None] Lock "cinder-quobyte-b7500956-5139-489a-8c16-5d10a00c26ed" released by "delete_volume" :: held 0.876s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 21:57:14 devstack sudo[93917]: pam_unix(sudo:session): session closed for user root Sep 17 21:57:14 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-db4c40c2-817e-46ce-8dac-6f9184b7ebe5 tempest-SnapshotsActionsTest-733634761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.7f3cd4e0-01f9-4d68-8c40-a5f23c03ec27" returned: 0 in 0.470s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:57:14 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-db4c40c2-817e-46ce-8dac-6f9184b7ebe5 tempest-SnapshotsActionsTest-733634761 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-031315b6-e4a1-49fb-9eca-70005ccac72f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85458) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 21:57:14 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[b10c26c1-fdef-4280-a773-2459fc0a818c]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 21:57:14 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-db4c40c2-817e-46ce-8dac-6f9184b7ebe5 tempest-SnapshotsActionsTest-733634761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.f0be6290-85f2-404a-b192-6f307aaddde6 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:57:14 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-c7bcf89c-791f-4f8e-824d-d9a76c452ef0 tempest-AttachVolumeTestJSON-1856227952 None] Created reservations ['16205c85-f938-4e2b-bcf1-030a94a740f4', '90aa697c-2520-4bf6-affd-6d2a66f251d6', 'eb65f8a9-c4e9-4f93-97c4-678479f1638c', '175df85b-757a-4114-a021-d414e733190b'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 21:57:14 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-c7bcf89c-791f-4f8e-824d-d9a76c452ef0 tempest-AttachVolumeTestJSON-1856227952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:57:14 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-c7bcf89c-791f-4f8e-824d-d9a76c452ef0 tempest-AttachVolumeTestJSON-1856227952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:57:14 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-c7bcf89c-791f-4f8e-824d-d9a76c452ef0 tempest-AttachVolumeTestJSON-1856227952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 21:57:14 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-c7bcf89c-791f-4f8e-824d-d9a76c452ef0 tempest-AttachVolumeTestJSON-1856227952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 21:57:14 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-c7bcf89c-791f-4f8e-824d-d9a76c452ef0 tempest-AttachVolumeTestJSON-1856227952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:57:14 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-c7bcf89c-791f-4f8e-824d-d9a76c452ef0 tempest-AttachVolumeTestJSON-1856227952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:57:14 devstack sudo[93932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.f0be6290-85f2-404a-b192-6f307aaddde6 Sep 17 21:57:14 devstack sudo[93932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:57:14 devstack sudo[93962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 21:57:14 devstack sudo[93962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:57:14 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef430f88-59e8-49b1-998b-1044a7df2030 tempest-AttachVolumeNegativeTest-28309225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 21:57:14 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-ef430f88-59e8-49b1-998b-1044a7df2030 tempest-AttachVolumeNegativeTest-28309225 None] Flow 'volume_create_manager' (ba24b2a8-527e-4417-a463-9967ce8a7a3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 21:57:14 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-ef430f88-59e8-49b1-998b-1044a7df2030 tempest-AttachVolumeNegativeTest-28309225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16344bb4-5361-45f7-a0d3-040471d0ca16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:57:14 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-ef430f88-59e8-49b1-998b-1044a7df2030 tempest-AttachVolumeNegativeTest-28309225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16344bb4-5361-45f7-a0d3-040471d0ca16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T19:57:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1681048105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b65d544b-3ffb-4eed-a9d9-51264d87bab9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec04416ff169406d84ffb9bc4ca1646e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T19:57:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T19:57:14Z,use_quota=True,user_id='fd944f203df44249aaf302f096d6a77d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:57:14 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-ef430f88-59e8-49b1-998b-1044a7df2030 tempest-AttachVolumeNegativeTest-28309225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (117a5813-c059-426d-981c-fe6f5d531fbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:57:14 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-ef430f88-59e8-49b1-998b-1044a7df2030 tempest-AttachVolumeNegativeTest-28309225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (117a5813-c059-426d-981c-fe6f5d531fbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:57:14 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-ef430f88-59e8-49b1-998b-1044a7df2030 tempest-AttachVolumeNegativeTest-28309225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bf10127-59af-4512-8798-9db0a2d43ca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:57:14 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-ef430f88-59e8-49b1-998b-1044a7df2030 tempest-AttachVolumeNegativeTest-28309225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bf10127-59af-4512-8798-9db0a2d43ca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b65d544b-3ffb-4eed-a9d9-51264d87bab9', 'volume_name': 'volume-b65d544b-3ffb-4eed-a9d9-51264d87bab9', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:57:14 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-ef430f88-59e8-49b1-998b-1044a7df2030 tempest-AttachVolumeNegativeTest-28309225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (171174b3-aa3a-420b-88fc-6449d2ffe607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:57:14 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-ef430f88-59e8-49b1-998b-1044a7df2030 tempest-AttachVolumeNegativeTest-28309225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (171174b3-aa3a-420b-88fc-6449d2ffe607) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:57:14 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-ef430f88-59e8-49b1-998b-1044a7df2030 tempest-AttachVolumeNegativeTest-28309225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73132f08-36e9-46e6-bdf8-df4a48fcae10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:57:14 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-ef430f88-59e8-49b1-998b-1044a7df2030 tempest-AttachVolumeNegativeTest-28309225 None] Volume b65d544b-3ffb-4eed-a9d9-51264d87bab9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b65d544b-3ffb-4eed-a9d9-51264d87bab9', 'volume_size': 1} Sep 17 21:57:14 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-ef430f88-59e8-49b1-998b-1044a7df2030 tempest-AttachVolumeNegativeTest-28309225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:57:14 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-ef430f88-59e8-49b1-998b-1044a7df2030 tempest-AttachVolumeNegativeTest-28309225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:57:14 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-ef430f88-59e8-49b1-998b-1044a7df2030 tempest-AttachVolumeNegativeTest-28309225 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T19:57:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1681048105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b65d544b-3ffb-4eed-a9d9-51264d87bab9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec04416ff169406d84ffb9bc4ca1646e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T19:57:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T19:57:14Z,use_quota=True,user_id='fd944f203df44249aaf302f096d6a77d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 21:57:14 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-ef430f88-59e8-49b1-998b-1044a7df2030 tempest-AttachVolumeNegativeTest-28309225 None] Creating volume b65d544b-3ffb-4eed-a9d9-51264d87bab9 {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 21:57:14 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-ef430f88-59e8-49b1-998b-1044a7df2030 tempest-AttachVolumeNegativeTest-28309225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:57:14 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-ef430f88-59e8-49b1-998b-1044a7df2030 tempest-AttachVolumeNegativeTest-28309225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:57:14 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-ef430f88-59e8-49b1-998b-1044a7df2030 tempest-AttachVolumeNegativeTest-28309225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 21:57:14 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-ef430f88-59e8-49b1-998b-1044a7df2030 tempest-AttachVolumeNegativeTest-28309225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 21:57:14 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-ef430f88-59e8-49b1-998b-1044a7df2030 tempest-AttachVolumeNegativeTest-28309225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:57:14 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-ef430f88-59e8-49b1-998b-1044a7df2030 tempest-AttachVolumeNegativeTest-28309225 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 21:57:14 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-ef430f88-59e8-49b1-998b-1044a7df2030 tempest-AttachVolumeNegativeTest-28309225 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 21:57:14 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-ef430f88-59e8-49b1-998b-1044a7df2030 tempest-AttachVolumeNegativeTest-28309225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b65d544b-3ffb-4eed-a9d9-51264d87bab9 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:57:14 devstack sudo[93964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b65d544b-3ffb-4eed-a9d9-51264d87bab9 1073741824 Sep 17 21:57:14 devstack sudo[93964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:57:14 devstack sudo[93962]: pam_unix(sudo:session): session closed for user root Sep 17 21:57:14 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-c7bcf89c-791f-4f8e-824d-d9a76c452ef0 tempest-AttachVolumeTestJSON-1856227952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.462s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:57:14 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-c7bcf89c-791f-4f8e-824d-d9a76c452ef0 tempest-AttachVolumeTestJSON-1856227952 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 21:57:14 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-c7bcf89c-791f-4f8e-824d-d9a76c452ef0 tempest-AttachVolumeTestJSON-1856227952 None] Deleted volume successfully. Sep 17 21:57:14 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-c7bcf89c-791f-4f8e-824d-d9a76c452ef0 tempest-AttachVolumeTestJSON-1856227952 None] Lock "cinder-b7500956-5139-489a-8c16-5d10a00c26ed-delete_volume" released by "delete_volume" :: held 1.760s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 21:57:14 devstack sudo[93932]: pam_unix(sudo:session): session closed for user root Sep 17 21:57:14 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-db4c40c2-817e-46ce-8dac-6f9184b7ebe5 tempest-SnapshotsActionsTest-733634761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.f0be6290-85f2-404a-b192-6f307aaddde6" returned: 0 in 0.737s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:57:14 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-db4c40c2-817e-46ce-8dac-6f9184b7ebe5 tempest-SnapshotsActionsTest-733634761 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-031315b6-e4a1-49fb-9eca-70005ccac72f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85458) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 21:57:14 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-db4c40c2-817e-46ce-8dac-6f9184b7ebe5 tempest-SnapshotsActionsTest-733634761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.7f3cd4e0-01f9-4d68-8c40-a5f23c03ec27 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:57:14 devstack sudo[93977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.7f3cd4e0-01f9-4d68-8c40-a5f23c03ec27 Sep 17 21:57:14 devstack sudo[93977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:57:15 devstack sudo[93964]: pam_unix(sudo:session): session closed for user root Sep 17 21:57:15 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-ef430f88-59e8-49b1-998b-1044a7df2030 tempest-AttachVolumeNegativeTest-28309225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b65d544b-3ffb-4eed-a9d9-51264d87bab9 1073741824" returned: 0 in 0.532s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:57:15 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-ef430f88-59e8-49b1-998b-1044a7df2030 tempest-AttachVolumeNegativeTest-28309225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b65d544b-3ffb-4eed-a9d9-51264d87bab9 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:57:15 devstack sudo[93980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b65d544b-3ffb-4eed-a9d9-51264d87bab9 Sep 17 21:57:15 devstack sudo[93980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:57:15 devstack sudo[93977]: pam_unix(sudo:session): session closed for user root Sep 17 21:57:15 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-db4c40c2-817e-46ce-8dac-6f9184b7ebe5 tempest-SnapshotsActionsTest-733634761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.7f3cd4e0-01f9-4d68-8c40-a5f23c03ec27" returned: 0 in 0.462s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:57:15 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-db4c40c2-817e-46ce-8dac-6f9184b7ebe5 tempest-SnapshotsActionsTest-733634761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.7f3cd4e0-01f9-4d68-8c40-a5f23c03ec27 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:57:15 devstack sudo[93985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.7f3cd4e0-01f9-4d68-8c40-a5f23c03ec27 Sep 17 21:57:15 devstack sudo[93985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:57:15 devstack sudo[93980]: pam_unix(sudo:session): session closed for user root Sep 17 21:57:15 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-ef430f88-59e8-49b1-998b-1044a7df2030 tempest-AttachVolumeNegativeTest-28309225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b65d544b-3ffb-4eed-a9d9-51264d87bab9" returned: 0 in 0.296s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:57:15 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-ef430f88-59e8-49b1-998b-1044a7df2030 tempest-AttachVolumeNegativeTest-28309225 None] <== create_volume: return (878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 21:57:15 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-ef430f88-59e8-49b1-998b-1044a7df2030 tempest-AttachVolumeNegativeTest-28309225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.882s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:57:15 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-ef430f88-59e8-49b1-998b-1044a7df2030 tempest-AttachVolumeNegativeTest-28309225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73132f08-36e9-46e6-bdf8-df4a48fcae10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b65d544b-3ffb-4eed-a9d9-51264d87bab9', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:57:15 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-ef430f88-59e8-49b1-998b-1044a7df2030 tempest-AttachVolumeNegativeTest-28309225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9e1f763-2bde-4e0b-93ad-68971b5f73a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:57:15 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-ef430f88-59e8-49b1-998b-1044a7df2030 tempest-AttachVolumeNegativeTest-28309225 None] Volume volume-b65d544b-3ffb-4eed-a9d9-51264d87bab9 (b65d544b-3ffb-4eed-a9d9-51264d87bab9): created successfully Sep 17 21:57:15 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-ef430f88-59e8-49b1-998b-1044a7df2030 tempest-AttachVolumeNegativeTest-28309225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9e1f763-2bde-4e0b-93ad-68971b5f73a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:57:15 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-ef430f88-59e8-49b1-998b-1044a7df2030 tempest-AttachVolumeNegativeTest-28309225 None] Flow 'volume_create_manager' (ba24b2a8-527e-4417-a463-9967ce8a7a3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 21:57:15 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-ef430f88-59e8-49b1-998b-1044a7df2030 tempest-AttachVolumeNegativeTest-28309225 None] Created volume successfully. Sep 17 21:57:15 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-dc36e232-a7ed-4dd6-81b4-56d1b79cb834 tempest-AttachVolumeTestJSON-1856227952 None] Acquiring lock "cinder-2191676c-a779-4ad0-8daa-de672f643aab-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 21:57:15 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-dc36e232-a7ed-4dd6-81b4-56d1b79cb834 tempest-AttachVolumeTestJSON-1856227952 None] Lock "cinder-2191676c-a779-4ad0-8daa-de672f643aab-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 21:57:15 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-dc36e232-a7ed-4dd6-81b4-56d1b79cb834 tempest-AttachVolumeTestJSON-1856227952 None] Acquiring lock "cinder-quobyte-2191676c-a779-4ad0-8daa-de672f643aab" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 21:57:15 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-dc36e232-a7ed-4dd6-81b4-56d1b79cb834 tempest-AttachVolumeTestJSON-1856227952 None] Lock "cinder-quobyte-2191676c-a779-4ad0-8daa-de672f643aab" acquired by "delete_volume" :: waited 0.017s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 21:57:15 devstack sudo[93985]: pam_unix(sudo:session): session closed for user root Sep 17 21:57:15 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-db4c40c2-817e-46ce-8dac-6f9184b7ebe5 tempest-SnapshotsActionsTest-733634761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.7f3cd4e0-01f9-4d68-8c40-a5f23c03ec27" returned: 0 in 0.303s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:57:15 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[712b6325-27f5-4167-aecc-50a175d0f793]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 21:57:15 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-dc36e232-a7ed-4dd6-81b4-56d1b79cb834 tempest-AttachVolumeTestJSON-1856227952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-2191676c-a779-4ad0-8daa-de672f643aab {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:57:15 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-db4c40c2-817e-46ce-8dac-6f9184b7ebe5 tempest-SnapshotsActionsTest-733634761 None] Lock "cinder-quobyte-7f3cd4e0-01f9-4d68-8c40-a5f23c03ec27" released by "_delete_snapshot" :: held 2.140s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 21:57:15 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-db4c40c2-817e-46ce-8dac-6f9184b7ebe5 tempest-SnapshotsActionsTest-733634761 None] Lock "cinder-quobyte-031315b6-e4a1-49fb-9eca-70005ccac72f" released by "delete_snapshot" :: held 2.172s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 21:57:15 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-db4c40c2-817e-46ce-8dac-6f9184b7ebe5 tempest-SnapshotsActionsTest-733634761 None] Created reservations ['077744f2-a237-4c66-ba71-e4783c3567c3', 'bcaf9962-1fe3-4ace-b205-78fb9dd90913', '9ccfd305-9ae6-4638-8693-e5250ebfa518', '7fef5e94-a1df-4964-8fe9-77924aa2bcb1'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 21:57:15 devstack sudo[93989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-2191676c-a779-4ad0-8daa-de672f643aab Sep 17 21:57:15 devstack sudo[93989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:57:15 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-db4c40c2-817e-46ce-8dac-6f9184b7ebe5 tempest-SnapshotsActionsTest-733634761 None] Delete snapshot completed successfully. Sep 17 21:57:15 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-db4c40c2-817e-46ce-8dac-6f9184b7ebe5 tempest-SnapshotsActionsTest-733634761 None] Lock "cinder-7f3cd4e0-01f9-4d68-8c40-a5f23c03ec27-delete_snapshot" released by "delete_snapshot" :: held 2.351s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 21:57:16 devstack sudo[93989]: pam_unix(sudo:session): session closed for user root Sep 17 21:57:16 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-dc36e232-a7ed-4dd6-81b4-56d1b79cb834 tempest-AttachVolumeTestJSON-1856227952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-2191676c-a779-4ad0-8daa-de672f643aab" returned: 0 in 0.409s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:57:16 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-dc36e232-a7ed-4dd6-81b4-56d1b79cb834 tempest-AttachVolumeTestJSON-1856227952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-2191676c-a779-4ad0-8daa-de672f643aab {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:57:16 devstack sudo[93994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-2191676c-a779-4ad0-8daa-de672f643aab Sep 17 21:57:16 devstack sudo[93994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:57:16 devstack sudo[93994]: pam_unix(sudo:session): session closed for user root Sep 17 21:57:16 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-dc36e232-a7ed-4dd6-81b4-56d1b79cb834 tempest-AttachVolumeTestJSON-1856227952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-2191676c-a779-4ad0-8daa-de672f643aab" returned: 0 in 0.264s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:57:16 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-dc36e232-a7ed-4dd6-81b4-56d1b79cb834 tempest-AttachVolumeTestJSON-1856227952 None] Lock "cinder-quobyte-2191676c-a779-4ad0-8daa-de672f643aab" released by "delete_volume" :: held 0.752s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 21:57:16 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-dc36e232-a7ed-4dd6-81b4-56d1b79cb834 tempest-AttachVolumeTestJSON-1856227952 None] Created reservations ['495c825a-971b-4a04-b6b3-094a2bfba2c0', 'c8f1523f-4ca9-465a-8016-3822a86920b6', '7d556441-edd9-4b15-b08d-27f1ffcf54a1', '7ee06748-3686-43bc-a182-e8b5868294dd'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 21:57:16 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-dc36e232-a7ed-4dd6-81b4-56d1b79cb834 tempest-AttachVolumeTestJSON-1856227952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:57:16 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-dc36e232-a7ed-4dd6-81b4-56d1b79cb834 tempest-AttachVolumeTestJSON-1856227952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:57:16 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-dc36e232-a7ed-4dd6-81b4-56d1b79cb834 tempest-AttachVolumeTestJSON-1856227952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 21:57:16 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-dc36e232-a7ed-4dd6-81b4-56d1b79cb834 tempest-AttachVolumeTestJSON-1856227952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 21:57:16 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-dc36e232-a7ed-4dd6-81b4-56d1b79cb834 tempest-AttachVolumeTestJSON-1856227952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:57:16 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-dc36e232-a7ed-4dd6-81b4-56d1b79cb834 tempest-AttachVolumeTestJSON-1856227952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:57:16 devstack sudo[94000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 21:57:16 devstack sudo[94000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:57:16 devstack sudo[94000]: pam_unix(sudo:session): session closed for user root Sep 17 21:57:16 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-dc36e232-a7ed-4dd6-81b4-56d1b79cb834 tempest-AttachVolumeTestJSON-1856227952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.341s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:57:16 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-dc36e232-a7ed-4dd6-81b4-56d1b79cb834 tempest-AttachVolumeTestJSON-1856227952 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 21:57:16 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-dc36e232-a7ed-4dd6-81b4-56d1b79cb834 tempest-AttachVolumeTestJSON-1856227952 None] Deleted volume successfully. Sep 17 21:57:16 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-dc36e232-a7ed-4dd6-81b4-56d1b79cb834 tempest-AttachVolumeTestJSON-1856227952 None] Lock "cinder-2191676c-a779-4ad0-8daa-de672f643aab-delete_volume" released by "delete_volume" :: held 1.414s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 21:57:17 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e5c6dcbe-e8f8-4081-a603-f45334b629fd tempest-SnapshotsActionsTest-405643259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:57:17 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e5c6dcbe-e8f8-4081-a603-f45334b629fd tempest-SnapshotsActionsTest-405643259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:57:17 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-e5c6dcbe-e8f8-4081-a603-f45334b629fd tempest-SnapshotsActionsTest-405643259 None] Creating offline snapshot 75b86a25-5c16-4be4-8442-6bbb63bce5b3 of volume 031315b6-e4a1-49fb-9eca-70005ccac72f {{(pid=85458) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 21:57:17 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d401276-fb11-4070-a7c0-69ce960ce558]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 21:57:17 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e5c6dcbe-e8f8-4081-a603-f45334b629fd tempest-SnapshotsActionsTest-405643259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.f0be6290-85f2-404a-b192-6f307aaddde6 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:57:17 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [req-f0ede924-fdeb-4c03-8cfb-2405cff0482d req-eb5e6116-0687-4213-82ce-37e5dc9ecfa6 tempest-AttachVolumeNegativeTest-28309225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:57:17 devstack sudo[94011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.f0be6290-85f2-404a-b192-6f307aaddde6 Sep 17 21:57:17 devstack sudo[94011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:57:17 devstack sudo[94011]: pam_unix(sudo:session): session closed for user root Sep 17 21:57:17 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e5c6dcbe-e8f8-4081-a603-f45334b629fd tempest-SnapshotsActionsTest-405643259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.f0be6290-85f2-404a-b192-6f307aaddde6" returned: 0 in 0.460s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:57:17 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-e5c6dcbe-e8f8-4081-a603-f45334b629fd tempest-SnapshotsActionsTest-405643259 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-031315b6-e4a1-49fb-9eca-70005ccac72f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85458) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 21:57:17 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e5c6dcbe-e8f8-4081-a603-f45334b629fd tempest-SnapshotsActionsTest-405643259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.f0be6290-85f2-404a-b192-6f307aaddde6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.75b86a25-5c16-4be4-8442-6bbb63bce5b3 1G {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:57:17 devstack sudo[94016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.f0be6290-85f2-404a-b192-6f307aaddde6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.75b86a25-5c16-4be4-8442-6bbb63bce5b3 1G Sep 17 21:57:17 devstack sudo[94016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:57:18 devstack sudo[94016]: pam_unix(sudo:session): session closed for user root Sep 17 21:57:18 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e5c6dcbe-e8f8-4081-a603-f45334b629fd tempest-SnapshotsActionsTest-405643259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.f0be6290-85f2-404a-b192-6f307aaddde6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.75b86a25-5c16-4be4-8442-6bbb63bce5b3 1G" returned: 0 in 0.567s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:57:18 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e5c6dcbe-e8f8-4081-a603-f45334b629fd tempest-SnapshotsActionsTest-405643259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-031315b6-e4a1-49fb-9eca-70005ccac72f.f0be6290-85f2-404a-b192-6f307aaddde6 -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.75b86a25-5c16-4be4-8442-6bbb63bce5b3 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:57:18 devstack sudo[94022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-031315b6-e4a1-49fb-9eca-70005ccac72f.f0be6290-85f2-404a-b192-6f307aaddde6 -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.75b86a25-5c16-4be4-8442-6bbb63bce5b3 Sep 17 21:57:18 devstack sudo[94022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:57:18 devstack sudo[94022]: pam_unix(sudo:session): session closed for user root Sep 17 21:57:18 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e5c6dcbe-e8f8-4081-a603-f45334b629fd tempest-SnapshotsActionsTest-405643259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-031315b6-e4a1-49fb-9eca-70005ccac72f.f0be6290-85f2-404a-b192-6f307aaddde6 -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.75b86a25-5c16-4be4-8442-6bbb63bce5b3" returned: 0 in 0.347s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:57:18 devstack cinder-volume[85458]: WARNING cinder.volume.drivers.remotefs [None req-e5c6dcbe-e8f8-4081-a603-f45334b629fd tempest-SnapshotsActionsTest-405643259 None] /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.75b86a25-5c16-4be4-8442-6bbb63bce5b3 is being set with open permissions: ugo+rw Sep 17 21:57:18 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e5c6dcbe-e8f8-4081-a603-f45334b629fd tempest-SnapshotsActionsTest-405643259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.75b86a25-5c16-4be4-8442-6bbb63bce5b3 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:57:18 devstack sudo[94028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.75b86a25-5c16-4be4-8442-6bbb63bce5b3 Sep 17 21:57:18 devstack sudo[94028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:57:19 devstack sudo[94028]: pam_unix(sudo:session): session closed for user root Sep 17 21:57:19 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e5c6dcbe-e8f8-4081-a603-f45334b629fd tempest-SnapshotsActionsTest-405643259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.75b86a25-5c16-4be4-8442-6bbb63bce5b3" returned: 0 in 0.304s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:57:19 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e5c6dcbe-e8f8-4081-a603-f45334b629fd tempest-SnapshotsActionsTest-405643259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.863s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:57:19 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [req-f0ede924-fdeb-4c03-8cfb-2405cff0482d req-eb5e6116-0687-4213-82ce-37e5dc9ecfa6 tempest-AttachVolumeNegativeTest-28309225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.737s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:57:19 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [req-f0ede924-fdeb-4c03-8cfb-2405cff0482d req-eb5e6116-0687-4213-82ce-37e5dc9ecfa6 tempest-AttachVolumeNegativeTest-28309225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:57:19 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-e5c6dcbe-e8f8-4081-a603-f45334b629fd tempest-SnapshotsActionsTest-405643259 None] Create snapshot completed successfully Sep 17 21:57:19 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [req-f0ede924-fdeb-4c03-8cfb-2405cff0482d req-eb5e6116-0687-4213-82ce-37e5dc9ecfa6 tempest-AttachVolumeNegativeTest-28309225 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5', 'name': 'volume-b65d544b-3ffb-4eed-a9d9-51264d87bab9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd8636a55-96cb-48e9-9902-e0f1e9f5998a', 'enforce_multipath': True} {{(pid=85458) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 21:57:19 devstack cinder-volume[85458]: INFO cinder.volume.manager [req-f0ede924-fdeb-4c03-8cfb-2405cff0482d req-eb5e6116-0687-4213-82ce-37e5dc9ecfa6 tempest-AttachVolumeNegativeTest-28309225 None] attachment_update completed successfully. Sep 17 21:57:19 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-12aa030a-95df-4589-bd42-f49cc13baf69 tempest-SnapshotsActionsTest-733634761 None] Acquiring lock "cinder-75b86a25-5c16-4be4-8442-6bbb63bce5b3-delete_snapshot" by "delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 21:57:19 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-12aa030a-95df-4589-bd42-f49cc13baf69 tempest-SnapshotsActionsTest-733634761 None] Lock "cinder-75b86a25-5c16-4be4-8442-6bbb63bce5b3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 21:57:19 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-12aa030a-95df-4589-bd42-f49cc13baf69 tempest-SnapshotsActionsTest-733634761 None] Acquiring lock "cinder-quobyte-031315b6-e4a1-49fb-9eca-70005ccac72f" by "delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 21:57:19 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-12aa030a-95df-4589-bd42-f49cc13baf69 tempest-SnapshotsActionsTest-733634761 None] Lock "cinder-quobyte-031315b6-e4a1-49fb-9eca-70005ccac72f" acquired by "delete_snapshot" :: waited 0.035s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 21:57:19 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-12aa030a-95df-4589-bd42-f49cc13baf69 tempest-SnapshotsActionsTest-733634761 None] Acquiring lock "cinder-quobyte-75b86a25-5c16-4be4-8442-6bbb63bce5b3" by "_delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 21:57:19 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-12aa030a-95df-4589-bd42-f49cc13baf69 tempest-SnapshotsActionsTest-733634761 None] Lock "cinder-quobyte-75b86a25-5c16-4be4-8442-6bbb63bce5b3" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 21:57:19 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-12aa030a-95df-4589-bd42-f49cc13baf69 tempest-SnapshotsActionsTest-733634761 None] Deleting offline snapshot 75b86a25-5c16-4be4-8442-6bbb63bce5b3 of volume 031315b6-e4a1-49fb-9eca-70005ccac72f {{(pid=85458) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 21:57:19 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-12aa030a-95df-4589-bd42-f49cc13baf69 tempest-SnapshotsActionsTest-733634761 None] snapshot_file for this snap is: volume-031315b6-e4a1-49fb-9eca-70005ccac72f.75b86a25-5c16-4be4-8442-6bbb63bce5b3 {{(pid=85458) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 21:57:19 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b0fcb20-285a-4930-9574-fce44c13cd79]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 21:57:19 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-12aa030a-95df-4589-bd42-f49cc13baf69 tempest-SnapshotsActionsTest-733634761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.75b86a25-5c16-4be4-8442-6bbb63bce5b3 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:57:19 devstack sudo[94333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.75b86a25-5c16-4be4-8442-6bbb63bce5b3 Sep 17 21:57:19 devstack sudo[94333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:57:20 devstack sudo[94333]: pam_unix(sudo:session): session closed for user root Sep 17 21:57:20 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-12aa030a-95df-4589-bd42-f49cc13baf69 tempest-SnapshotsActionsTest-733634761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.75b86a25-5c16-4be4-8442-6bbb63bce5b3" returned: 0 in 0.466s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:57:20 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-12aa030a-95df-4589-bd42-f49cc13baf69 tempest-SnapshotsActionsTest-733634761 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-031315b6-e4a1-49fb-9eca-70005ccac72f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85458) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 21:57:20 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[e999c295-59a6-4931-a0e1-528ded9b9fba]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 21:57:20 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-12aa030a-95df-4589-bd42-f49cc13baf69 tempest-SnapshotsActionsTest-733634761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.f0be6290-85f2-404a-b192-6f307aaddde6 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:57:20 devstack sudo[94451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.f0be6290-85f2-404a-b192-6f307aaddde6 Sep 17 21:57:20 devstack sudo[94451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:57:20 devstack sudo[94451]: pam_unix(sudo:session): session closed for user root Sep 17 21:57:20 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-12aa030a-95df-4589-bd42-f49cc13baf69 tempest-SnapshotsActionsTest-733634761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.f0be6290-85f2-404a-b192-6f307aaddde6" returned: 0 in 0.421s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:57:20 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-12aa030a-95df-4589-bd42-f49cc13baf69 tempest-SnapshotsActionsTest-733634761 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-031315b6-e4a1-49fb-9eca-70005ccac72f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85458) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 21:57:20 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-12aa030a-95df-4589-bd42-f49cc13baf69 tempest-SnapshotsActionsTest-733634761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.75b86a25-5c16-4be4-8442-6bbb63bce5b3 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:57:20 devstack sudo[94456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.75b86a25-5c16-4be4-8442-6bbb63bce5b3 Sep 17 21:57:20 devstack sudo[94456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:57:21 devstack sudo[94456]: pam_unix(sudo:session): session closed for user root Sep 17 21:57:21 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-12aa030a-95df-4589-bd42-f49cc13baf69 tempest-SnapshotsActionsTest-733634761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.75b86a25-5c16-4be4-8442-6bbb63bce5b3" returned: 0 in 0.452s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:57:21 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-12aa030a-95df-4589-bd42-f49cc13baf69 tempest-SnapshotsActionsTest-733634761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.75b86a25-5c16-4be4-8442-6bbb63bce5b3 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:57:21 devstack sudo[94462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.75b86a25-5c16-4be4-8442-6bbb63bce5b3 Sep 17 21:57:21 devstack sudo[94462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:57:21 devstack sudo[94462]: pam_unix(sudo:session): session closed for user root Sep 17 21:57:21 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-12aa030a-95df-4589-bd42-f49cc13baf69 tempest-SnapshotsActionsTest-733634761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.75b86a25-5c16-4be4-8442-6bbb63bce5b3" returned: 0 in 0.380s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:57:21 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-12aa030a-95df-4589-bd42-f49cc13baf69 tempest-SnapshotsActionsTest-733634761 None] Lock "cinder-quobyte-75b86a25-5c16-4be4-8442-6bbb63bce5b3" released by "_delete_snapshot" :: held 1.930s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 21:57:21 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-12aa030a-95df-4589-bd42-f49cc13baf69 tempest-SnapshotsActionsTest-733634761 None] Lock "cinder-quobyte-031315b6-e4a1-49fb-9eca-70005ccac72f" released by "delete_snapshot" :: held 1.964s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 21:57:21 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-12aa030a-95df-4589-bd42-f49cc13baf69 tempest-SnapshotsActionsTest-733634761 None] Created reservations ['504e6359-4cce-4688-b22e-39427427f5d3', '7e8647b4-69cc-4138-8447-b9ee095a3d0c', 'c3afff5f-219b-409c-b692-7ebcbdc1c72a', '42589782-7e29-4cf8-8793-41a7ffd510cd'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 21:57:21 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f1fe40c-e93a-4c3a-9e7b-627ca89b9976 tempest-VolumesImageMetadata-1673387060 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 21:57:21 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-8f1fe40c-e93a-4c3a-9e7b-627ca89b9976 tempest-VolumesImageMetadata-1673387060 None] Flow 'volume_create_manager' (c0f28887-8481-4a44-8042-b19c3a75f94b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 21:57:21 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-8f1fe40c-e93a-4c3a-9e7b-627ca89b9976 tempest-VolumesImageMetadata-1673387060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c8130a8-a9bc-418e-a60f-8e4ab33cd2c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:57:21 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-8f1fe40c-e93a-4c3a-9e7b-627ca89b9976 tempest-VolumesImageMetadata-1673387060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c8130a8-a9bc-418e-a60f-8e4ab33cd2c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T19:57:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-2121141823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cbf4d21-c89d-449f-a979-ac0ac5608712,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b3c723a7c354083beac82b6b6d628ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T19:57:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T19:57:22Z,use_quota=True,user_id='6242b47202b54e10aacbfb6ab560824e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:57:21 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-8f1fe40c-e93a-4c3a-9e7b-627ca89b9976 tempest-VolumesImageMetadata-1673387060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e116e234-f6d3-491c-8e37-755344c6267c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:57:21 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-8f1fe40c-e93a-4c3a-9e7b-627ca89b9976 tempest-VolumesImageMetadata-1673387060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e116e234-f6d3-491c-8e37-755344c6267c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:57:21 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-8f1fe40c-e93a-4c3a-9e7b-627ca89b9976 tempest-VolumesImageMetadata-1673387060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2caef124-d4e2-44e8-953b-070229b9e83b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:57:21 devstack cinder-volume[85458]: DEBUG cinder.image.glance [None req-8f1fe40c-e93a-4c3a-9e7b-627ca89b9976 tempest-VolumesImageMetadata-1673387060 None] Creating Keystone auth plugin from conf {{(pid=85458) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 17 21:57:21 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-12aa030a-95df-4589-bd42-f49cc13baf69 tempest-SnapshotsActionsTest-733634761 None] Delete snapshot completed successfully. Sep 17 21:57:21 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-12aa030a-95df-4589-bd42-f49cc13baf69 tempest-SnapshotsActionsTest-733634761 None] Lock "cinder-75b86a25-5c16-4be4-8442-6bbb63bce5b3-delete_snapshot" released by "delete_snapshot" :: held 2.295s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 21:57:22 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-8f1fe40c-e93a-4c3a-9e7b-627ca89b9976 tempest-VolumesImageMetadata-1673387060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2caef124-d4e2-44e8-953b-070229b9e83b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1cbf4d21-c89d-449f-a979-ac0ac5608712', 'volume_name': 'volume-1cbf4d21-c89d-449f-a979-ac0ac5608712', 'volume_size': 1, 'image_id': '764e44ff-49f7-469a-925c-23f254888b59', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/764e44ff-49f7-469a-925c-23f254888b59', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '530062d71c924da39eff46373302dc71', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '764e44ff-49f7-469a-925c-23f254888b59', 'created_at': datetime.datetime(2026, 9, 17, 19, 45, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 19, 45, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/764e44ff-49f7-469a-925c-23f254888b59/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:57:22 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-8f1fe40c-e93a-4c3a-9e7b-627ca89b9976 tempest-VolumesImageMetadata-1673387060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91bb074f-be6c-4997-add7-6ec674302e23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:57:22 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-8f1fe40c-e93a-4c3a-9e7b-627ca89b9976 tempest-VolumesImageMetadata-1673387060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91bb074f-be6c-4997-add7-6ec674302e23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:57:22 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-8f1fe40c-e93a-4c3a-9e7b-627ca89b9976 tempest-VolumesImageMetadata-1673387060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20a3ff31-6e43-451a-906e-bc73a4c8a2fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:57:22 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-8f1fe40c-e93a-4c3a-9e7b-627ca89b9976 tempest-VolumesImageMetadata-1673387060 None] Volume 1cbf4d21-c89d-449f-a979-ac0ac5608712: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1cbf4d21-c89d-449f-a979-ac0ac5608712', 'volume_size': 1, 'image_id': '764e44ff-49f7-469a-925c-23f254888b59', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/764e44ff-49f7-469a-925c-23f254888b59', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '530062d71c924da39eff46373302dc71', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '764e44ff-49f7-469a-925c-23f254888b59', 'created_at': datetime.datetime(2026, 9, 17, 19, 45, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 19, 45, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/764e44ff-49f7-469a-925c-23f254888b59/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 17 21:57:22 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f1fe40c-e93a-4c3a-9e7b-627ca89b9976 tempest-VolumesImageMetadata-1673387060 None] Trying to clone 1cbf4d21-c89d-449f-a979-ac0ac5608712 from image 764e44ff-49f7-469a-925c-23f254888b59 at location (None, [{'url': 'file:///opt/stack/data/glance/images/764e44ff-49f7-469a-925c-23f254888b59', 'metadata': {}}]). {{(pid=85458) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 17 21:57:22 devstack cinder-volume[85458]: DEBUG cinder.image.image_utils [None req-8f1fe40c-e93a-4c3a-9e7b-627ca89b9976 tempest-VolumesImageMetadata-1673387060 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_764e44ff-49f7-469a-925c-23f254888b59_siz3fxgcdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=85458) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 17 21:57:22 devstack cinder-volume[85458]: INFO cinder.image.image_utils [None req-8f1fe40c-e93a-4c3a-9e7b-627ca89b9976 tempest-VolumesImageMetadata-1673387060 None] Image download 20.69 MB at 20.69 MB/s Sep 17 21:57:22 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f186b7a-bf8b-469f-a409-382118a83d2b]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 21:57:22 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-8f1fe40c-e93a-4c3a-9e7b-627ca89b9976 tempest-VolumesImageMetadata-1673387060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_764e44ff-49f7-469a-925c-23f254888b59_siz3fxgcdevstack@QuobyteHD {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:57:22 devstack cinder-volume[85458]: INFO cinder.volume.manager [req-e29695b1-800b-4422-8c2f-c1d70f321812 req-74178412-81f3-4003-91d7-fdb7c6f32bfe tempest-AttachVolumeNegativeTest-28309225 None] Terminate volume connection completed successfully. Sep 17 21:57:22 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [req-e29695b1-800b-4422-8c2f-c1d70f321812 req-74178412-81f3-4003-91d7-fdb7c6f32bfe tempest-AttachVolumeNegativeTest-28309225 None] Deleting attachment d8636a55-96cb-48e9-9902-e0f1e9f5998a. {{(pid=85458) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 21:57:22 devstack sudo[94494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_764e44ff-49f7-469a-925c-23f254888b59_siz3fxgcdevstack@QuobyteHD Sep 17 21:57:22 devstack sudo[94494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:57:23 devstack sudo[94494]: pam_unix(sudo:session): session closed for user root Sep 17 21:57:23 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-8f1fe40c-e93a-4c3a-9e7b-627ca89b9976 tempest-VolumesImageMetadata-1673387060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_764e44ff-49f7-469a-925c-23f254888b59_siz3fxgcdevstack@QuobyteHD" returned: 0 in 0.454s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:57:23 devstack cinder-volume[85458]: DEBUG cinder.image.image_utils [None req-8f1fe40c-e93a-4c3a-9e7b-627ca89b9976 tempest-VolumesImageMetadata-1673387060 None] Temporary image 764e44ff-49f7-469a-925c-23f254888b59 is fetched for user 6242b47202b54e10aacbfb6ab560824e. {{(pid=85458) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 17 21:57:23 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef5cfe7f-1b78-4371-9303-c46e0fd3cce2]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 21:57:23 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-8f1fe40c-e93a-4c3a-9e7b-627ca89b9976 tempest-VolumesImageMetadata-1673387060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_764e44ff-49f7-469a-925c-23f254888b59_siz3fxgcdevstack@QuobyteHD {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:57:23 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-52fce0cb-6ba9-4e67-ac4d-a299e33c30de tempest-SnapshotsActionsTest-405643259 None] Acquiring lock "cinder-f0be6290-85f2-404a-b192-6f307aaddde6-delete_snapshot" by "delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 21:57:23 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-52fce0cb-6ba9-4e67-ac4d-a299e33c30de tempest-SnapshotsActionsTest-405643259 None] Lock "cinder-f0be6290-85f2-404a-b192-6f307aaddde6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 21:57:23 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-52fce0cb-6ba9-4e67-ac4d-a299e33c30de tempest-SnapshotsActionsTest-405643259 None] Acquiring lock "cinder-quobyte-031315b6-e4a1-49fb-9eca-70005ccac72f" by "delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 21:57:23 devstack sudo[94499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_764e44ff-49f7-469a-925c-23f254888b59_siz3fxgcdevstack@QuobyteHD Sep 17 21:57:23 devstack sudo[94499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:57:23 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-52fce0cb-6ba9-4e67-ac4d-a299e33c30de tempest-SnapshotsActionsTest-405643259 None] Lock "cinder-quobyte-031315b6-e4a1-49fb-9eca-70005ccac72f" acquired by "delete_snapshot" :: waited 0.028s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 21:57:23 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-52fce0cb-6ba9-4e67-ac4d-a299e33c30de tempest-SnapshotsActionsTest-405643259 None] Acquiring lock "cinder-quobyte-f0be6290-85f2-404a-b192-6f307aaddde6" by "_delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 21:57:23 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-52fce0cb-6ba9-4e67-ac4d-a299e33c30de tempest-SnapshotsActionsTest-405643259 None] Lock "cinder-quobyte-f0be6290-85f2-404a-b192-6f307aaddde6" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 21:57:23 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-52fce0cb-6ba9-4e67-ac4d-a299e33c30de tempest-SnapshotsActionsTest-405643259 None] Deleting offline snapshot f0be6290-85f2-404a-b192-6f307aaddde6 of volume 031315b6-e4a1-49fb-9eca-70005ccac72f {{(pid=85458) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 21:57:23 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-52fce0cb-6ba9-4e67-ac4d-a299e33c30de tempest-SnapshotsActionsTest-405643259 None] snapshot_file for this snap is: volume-031315b6-e4a1-49fb-9eca-70005ccac72f.f0be6290-85f2-404a-b192-6f307aaddde6 {{(pid=85458) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 21:57:23 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b5f0056-6bec-49fc-9837-28dd1dc98d92]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 21:57:23 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-52fce0cb-6ba9-4e67-ac4d-a299e33c30de tempest-SnapshotsActionsTest-405643259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.f0be6290-85f2-404a-b192-6f307aaddde6 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:57:23 devstack sudo[94501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.f0be6290-85f2-404a-b192-6f307aaddde6 Sep 17 21:57:23 devstack sudo[94501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:57:23 devstack sudo[94499]: pam_unix(sudo:session): session closed for user root Sep 17 21:57:23 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-8f1fe40c-e93a-4c3a-9e7b-627ca89b9976 tempest-VolumesImageMetadata-1673387060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_764e44ff-49f7-469a-925c-23f254888b59_siz3fxgcdevstack@QuobyteHD" returned: 0 in 0.427s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:57:23 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-8f1fe40c-e93a-4c3a-9e7b-627ca89b9976 tempest-VolumesImageMetadata-1673387060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:57:23 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-8f1fe40c-e93a-4c3a-9e7b-627ca89b9976 tempest-VolumesImageMetadata-1673387060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:57:23 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-8f1fe40c-e93a-4c3a-9e7b-627ca89b9976 tempest-VolumesImageMetadata-1673387060 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T19:57:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-2121141823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cbf4d21-c89d-449f-a979-ac0ac5608712,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b3c723a7c354083beac82b6b6d628ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T19:57:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T19:57:22Z,use_quota=True,user_id='6242b47202b54e10aacbfb6ab560824e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 21:57:23 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-8f1fe40c-e93a-4c3a-9e7b-627ca89b9976 tempest-VolumesImageMetadata-1673387060 None] Creating volume 1cbf4d21-c89d-449f-a979-ac0ac5608712 {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 21:57:23 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-8f1fe40c-e93a-4c3a-9e7b-627ca89b9976 tempest-VolumesImageMetadata-1673387060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:57:23 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-8f1fe40c-e93a-4c3a-9e7b-627ca89b9976 tempest-VolumesImageMetadata-1673387060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:57:23 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-8f1fe40c-e93a-4c3a-9e7b-627ca89b9976 tempest-VolumesImageMetadata-1673387060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 21:57:23 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-8f1fe40c-e93a-4c3a-9e7b-627ca89b9976 tempest-VolumesImageMetadata-1673387060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 21:57:23 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-8f1fe40c-e93a-4c3a-9e7b-627ca89b9976 tempest-VolumesImageMetadata-1673387060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:57:23 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-8f1fe40c-e93a-4c3a-9e7b-627ca89b9976 tempest-VolumesImageMetadata-1673387060 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 21:57:23 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-8f1fe40c-e93a-4c3a-9e7b-627ca89b9976 tempest-VolumesImageMetadata-1673387060 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 21:57:23 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-8f1fe40c-e93a-4c3a-9e7b-627ca89b9976 tempest-VolumesImageMetadata-1673387060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-1cbf4d21-c89d-449f-a979-ac0ac5608712 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:57:23 devstack sudo[94506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-1cbf4d21-c89d-449f-a979-ac0ac5608712 1073741824 Sep 17 21:57:23 devstack sudo[94506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:57:24 devstack sudo[94501]: pam_unix(sudo:session): session closed for user root Sep 17 21:57:24 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-52fce0cb-6ba9-4e67-ac4d-a299e33c30de tempest-SnapshotsActionsTest-405643259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.f0be6290-85f2-404a-b192-6f307aaddde6" returned: 0 in 0.610s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:57:24 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-52fce0cb-6ba9-4e67-ac4d-a299e33c30de tempest-SnapshotsActionsTest-405643259 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-031315b6-e4a1-49fb-9eca-70005ccac72f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85458) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 21:57:24 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[16a5a95d-bbbb-4060-bc25-cf2b92d1f19e]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 21:57:24 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-52fce0cb-6ba9-4e67-ac4d-a299e33c30de tempest-SnapshotsActionsTest-405643259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:57:24 devstack sudo[94519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f Sep 17 21:57:24 devstack sudo[94519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:57:24 devstack sudo[94506]: pam_unix(sudo:session): session closed for user root Sep 17 21:57:24 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-8f1fe40c-e93a-4c3a-9e7b-627ca89b9976 tempest-VolumesImageMetadata-1673387060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-1cbf4d21-c89d-449f-a979-ac0ac5608712 1073741824" returned: 0 in 0.819s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:57:24 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-8f1fe40c-e93a-4c3a-9e7b-627ca89b9976 tempest-VolumesImageMetadata-1673387060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-1cbf4d21-c89d-449f-a979-ac0ac5608712 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:57:24 devstack sudo[94536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-1cbf4d21-c89d-449f-a979-ac0ac5608712 Sep 17 21:57:24 devstack sudo[94536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:57:24 devstack sudo[94519]: pam_unix(sudo:session): session closed for user root Sep 17 21:57:24 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-52fce0cb-6ba9-4e67-ac4d-a299e33c30de tempest-SnapshotsActionsTest-405643259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f" returned: 0 in 0.621s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:57:24 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-52fce0cb-6ba9-4e67-ac4d-a299e33c30de tempest-SnapshotsActionsTest-405643259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.f0be6290-85f2-404a-b192-6f307aaddde6 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:57:24 devstack sudo[94543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.f0be6290-85f2-404a-b192-6f307aaddde6 Sep 17 21:57:24 devstack sudo[94543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:57:24 devstack sudo[94536]: pam_unix(sudo:session): session closed for user root Sep 17 21:57:24 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-8f1fe40c-e93a-4c3a-9e7b-627ca89b9976 tempest-VolumesImageMetadata-1673387060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-1cbf4d21-c89d-449f-a979-ac0ac5608712" returned: 0 in 0.391s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:57:24 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-8f1fe40c-e93a-4c3a-9e7b-627ca89b9976 tempest-VolumesImageMetadata-1673387060 None] <== create_volume: return (1277ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 21:57:24 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-8f1fe40c-e93a-4c3a-9e7b-627ca89b9976 tempest-VolumesImageMetadata-1673387060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.280s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:57:24 devstack cinder-volume[85458]: DEBUG cinder.volume.volume_utils [None req-8f1fe40c-e93a-4c3a-9e7b-627ca89b9976 tempest-VolumesImageMetadata-1673387060 None] Attempting download of 764e44ff-49f7-469a-925c-23f254888b59 ((None, [{'url': 'file:///opt/stack/data/glance/images/764e44ff-49f7-469a-925c-23f254888b59', 'metadata': {}}])) to volume 1cbf4d21-c89d-449f-a979-ac0ac5608712. {{(pid=85458) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 17 21:57:25 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[058c2390-1d7a-4e3c-b3f7-dd439409453b]: (4, 'raw') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 21:57:25 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-8f1fe40c-e93a-4c3a-9e7b-627ca89b9976 tempest-VolumesImageMetadata-1673387060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_764e44ff-49f7-469a-925c-23f254888b59_sbkdmytb {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:57:25 devstack sudo[94547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_764e44ff-49f7-469a-925c-23f254888b59_sbkdmytb Sep 17 21:57:25 devstack sudo[94547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:57:25 devstack sudo[94543]: pam_unix(sudo:session): session closed for user root Sep 17 21:57:25 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-52fce0cb-6ba9-4e67-ac4d-a299e33c30de tempest-SnapshotsActionsTest-405643259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.f0be6290-85f2-404a-b192-6f307aaddde6" returned: 0 in 0.507s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:57:25 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-52fce0cb-6ba9-4e67-ac4d-a299e33c30de tempest-SnapshotsActionsTest-405643259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.f0be6290-85f2-404a-b192-6f307aaddde6 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:57:25 devstack sudo[94554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.f0be6290-85f2-404a-b192-6f307aaddde6 Sep 17 21:57:25 devstack sudo[94554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:57:25 devstack sudo[94547]: pam_unix(sudo:session): session closed for user root Sep 17 21:57:25 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-8f1fe40c-e93a-4c3a-9e7b-627ca89b9976 tempest-VolumesImageMetadata-1673387060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_764e44ff-49f7-469a-925c-23f254888b59_sbkdmytb" returned: 0 in 0.457s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:57:25 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-8f1fe40c-e93a-4c3a-9e7b-627ca89b9976 tempest-VolumesImageMetadata-1673387060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_764e44ff-49f7-469a-925c-23f254888b59_sbkdmytb {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:57:25 devstack sudo[94559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_764e44ff-49f7-469a-925c-23f254888b59_sbkdmytb Sep 17 21:57:25 devstack sudo[94559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:57:25 devstack sudo[94554]: pam_unix(sudo:session): session closed for user root Sep 17 21:57:25 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-52fce0cb-6ba9-4e67-ac4d-a299e33c30de tempest-SnapshotsActionsTest-405643259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f.f0be6290-85f2-404a-b192-6f307aaddde6" returned: 0 in 0.486s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:57:25 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-52fce0cb-6ba9-4e67-ac4d-a299e33c30de tempest-SnapshotsActionsTest-405643259 None] Lock "cinder-quobyte-f0be6290-85f2-404a-b192-6f307aaddde6" released by "_delete_snapshot" :: held 2.399s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 21:57:25 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-52fce0cb-6ba9-4e67-ac4d-a299e33c30de tempest-SnapshotsActionsTest-405643259 None] Lock "cinder-quobyte-031315b6-e4a1-49fb-9eca-70005ccac72f" released by "delete_snapshot" :: held 2.439s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 21:57:25 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-52fce0cb-6ba9-4e67-ac4d-a299e33c30de tempest-SnapshotsActionsTest-405643259 None] Created reservations ['167af83b-24f8-4fef-b10d-e04da80886c3', 'dcd29589-80ad-472f-8af0-f6d46f494129', '68b73342-4ce2-4a11-9440-f59abff6e8e7', '29875fd4-3cd5-4564-ac9d-cc2e85277dbf'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 21:57:25 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-52fce0cb-6ba9-4e67-ac4d-a299e33c30de tempest-SnapshotsActionsTest-405643259 None] Delete snapshot completed successfully. Sep 17 21:57:25 devstack sudo[94559]: pam_unix(sudo:session): session closed for user root Sep 17 21:57:25 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-52fce0cb-6ba9-4e67-ac4d-a299e33c30de tempest-SnapshotsActionsTest-405643259 None] Lock "cinder-f0be6290-85f2-404a-b192-6f307aaddde6-delete_snapshot" released by "delete_snapshot" :: held 2.674s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 21:57:25 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-8f1fe40c-e93a-4c3a-9e7b-627ca89b9976 tempest-VolumesImageMetadata-1673387060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_764e44ff-49f7-469a-925c-23f254888b59_sbkdmytb" returned: 1 in 0.506s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:57:25 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-8f1fe40c-e93a-4c3a-9e7b-627ca89b9976 tempest-VolumesImageMetadata-1673387060 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_764e44ff-49f7-469a-925c-23f254888b59_sbkdmytb' failed. Not Retrying. {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 21:57:26 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd62856a-8291-40e7-930e-294b0fb10b06]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 21:57:26 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-8f1fe40c-e93a-4c3a-9e7b-627ca89b9976 tempest-VolumesImageMetadata-1673387060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_764e44ff-49f7-469a-925c-23f254888b59_siz3fxgcdevstack@QuobyteHD {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:57:26 devstack sudo[94564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_764e44ff-49f7-469a-925c-23f254888b59_siz3fxgcdevstack@QuobyteHD Sep 17 21:57:26 devstack sudo[94564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:57:26 devstack sudo[94564]: pam_unix(sudo:session): session closed for user root Sep 17 21:57:26 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-8f1fe40c-e93a-4c3a-9e7b-627ca89b9976 tempest-VolumesImageMetadata-1673387060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_764e44ff-49f7-469a-925c-23f254888b59_siz3fxgcdevstack@QuobyteHD" returned: 0 in 0.407s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:57:26 devstack cinder-volume[85458]: DEBUG cinder.image.image_utils [None req-8f1fe40c-e93a-4c3a-9e7b-627ca89b9976 tempest-VolumesImageMetadata-1673387060 None] 764e44ff-49f7-469a-925c-23f254888b59 was qcow2, converting to qcow2 {{(pid=85458) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 17 21:57:26 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-8f1fe40c-e93a-4c3a-9e7b-627ca89b9976 tempest-VolumesImageMetadata-1673387060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_764e44ff-49f7-469a-925c-23f254888b59_siz3fxgcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-1cbf4d21-c89d-449f-a979-ac0ac5608712 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:57:26 devstack sudo[94570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_764e44ff-49f7-469a-925c-23f254888b59_siz3fxgcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-1cbf4d21-c89d-449f-a979-ac0ac5608712 Sep 17 21:57:26 devstack sudo[94570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:57:26 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-97bfabd0-075b-4619-b844-0c03836afb60 tempest-SnapshotsActionsTest-405643259 None] Acquiring lock "cinder-031315b6-e4a1-49fb-9eca-70005ccac72f-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 21:57:26 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-97bfabd0-075b-4619-b844-0c03836afb60 tempest-SnapshotsActionsTest-405643259 None] Lock "cinder-031315b6-e4a1-49fb-9eca-70005ccac72f-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 21:57:26 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-97bfabd0-075b-4619-b844-0c03836afb60 tempest-SnapshotsActionsTest-405643259 None] Acquiring lock "cinder-quobyte-031315b6-e4a1-49fb-9eca-70005ccac72f" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 21:57:26 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-97bfabd0-075b-4619-b844-0c03836afb60 tempest-SnapshotsActionsTest-405643259 None] Lock "cinder-quobyte-031315b6-e4a1-49fb-9eca-70005ccac72f" acquired by "delete_volume" :: waited 0.026s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 21:57:26 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3df305b-68ab-4bfc-9a0b-6b2190d4a0f3]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 21:57:26 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-97bfabd0-075b-4619-b844-0c03836afb60 tempest-SnapshotsActionsTest-405643259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:57:27 devstack sudo[94575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f Sep 17 21:57:27 devstack sudo[94575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:57:27 devstack sudo[94575]: pam_unix(sudo:session): session closed for user root Sep 17 21:57:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-97bfabd0-075b-4619-b844-0c03836afb60 tempest-SnapshotsActionsTest-405643259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f" returned: 0 in 0.527s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:57:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-97bfabd0-075b-4619-b844-0c03836afb60 tempest-SnapshotsActionsTest-405643259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:57:27 devstack sudo[94591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f Sep 17 21:57:27 devstack sudo[94591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:57:27 devstack cinder-volume[85458]: DEBUG oslo_service.periodic_task [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Running periodic task VolumeManager._thread_info {{(pid=85458) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 21:57:27 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] thread count: 28 {{(pid=85458) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 21:57:27 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] thread info: [<_MainThread(MainThread, started 127546830999680)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85458) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 21:57:27 devstack sudo[94591]: pam_unix(sudo:session): session closed for user root Sep 17 21:57:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-97bfabd0-075b-4619-b844-0c03836afb60 tempest-SnapshotsActionsTest-405643259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031315b6-e4a1-49fb-9eca-70005ccac72f" returned: 0 in 0.400s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:57:27 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-97bfabd0-075b-4619-b844-0c03836afb60 tempest-SnapshotsActionsTest-405643259 None] Lock "cinder-quobyte-031315b6-e4a1-49fb-9eca-70005ccac72f" released by "delete_volume" :: held 1.019s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 21:57:27 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-97bfabd0-075b-4619-b844-0c03836afb60 tempest-SnapshotsActionsTest-405643259 None] Created reservations ['5de837d4-5312-4903-8fe0-270667b62a0a', '422f786b-cb84-4a70-a13b-2b491748a394', '97c2b081-2ecf-404d-b96c-3321b65fff79', '8fcff3a6-38fc-4ef1-a195-1148587e1bea'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 21:57:28 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-97bfabd0-075b-4619-b844-0c03836afb60 tempest-SnapshotsActionsTest-405643259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:57:28 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-97bfabd0-075b-4619-b844-0c03836afb60 tempest-SnapshotsActionsTest-405643259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:57:28 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-97bfabd0-075b-4619-b844-0c03836afb60 tempest-SnapshotsActionsTest-405643259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 21:57:28 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-97bfabd0-075b-4619-b844-0c03836afb60 tempest-SnapshotsActionsTest-405643259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 21:57:28 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-97bfabd0-075b-4619-b844-0c03836afb60 tempest-SnapshotsActionsTest-405643259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:57:28 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-97bfabd0-075b-4619-b844-0c03836afb60 tempest-SnapshotsActionsTest-405643259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:57:28 devstack sudo[94595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 21:57:28 devstack sudo[94595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:57:28 devstack sudo[94595]: pam_unix(sudo:session): session closed for user root Sep 17 21:57:28 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-97bfabd0-075b-4619-b844-0c03836afb60 tempest-SnapshotsActionsTest-405643259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.324s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:57:28 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-039e6002-c6f1-465b-a8c3-4279531859b3 tempest-GroupSnapshotsTest-809568564 None] Group tempest-GroupSnapshotsTest-Group-1312717272: creating Sep 17 21:57:28 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-97bfabd0-075b-4619-b844-0c03836afb60 tempest-SnapshotsActionsTest-405643259 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 21:57:28 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-97bfabd0-075b-4619-b844-0c03836afb60 tempest-SnapshotsActionsTest-405643259 None] Deleted volume successfully. Sep 17 21:57:28 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-97bfabd0-075b-4619-b844-0c03836afb60 tempest-SnapshotsActionsTest-405643259 None] Lock "cinder-031315b6-e4a1-49fb-9eca-70005ccac72f-delete_volume" released by "delete_volume" :: held 1.737s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 21:57:28 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-039e6002-c6f1-465b-a8c3-4279531859b3 tempest-GroupSnapshotsTest-809568564 None] Group tempest-GroupSnapshotsTest-Group-1312717272: created successfully Sep 17 21:57:28 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-039e6002-c6f1-465b-a8c3-4279531859b3 tempest-GroupSnapshotsTest-809568564 None] Create group completed successfully. Sep 17 21:57:28 devstack sudo[94570]: pam_unix(sudo:session): session closed for user root Sep 17 21:57:28 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-8f1fe40c-e93a-4c3a-9e7b-627ca89b9976 tempest-VolumesImageMetadata-1673387060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_764e44ff-49f7-469a-925c-23f254888b59_siz3fxgcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-1cbf4d21-c89d-449f-a979-ac0ac5608712" returned: 0 in 2.455s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:57:28 devstack cinder-volume[85458]: DEBUG cinder.image.image_utils [None req-8f1fe40c-e93a-4c3a-9e7b-627ca89b9976 tempest-VolumesImageMetadata-1673387060 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_764e44ff-49f7-469a-925c-23f254888b59_siz3fxgcdevstack@QuobyteHD, size 112.00 MB, duration 2.46 sec, destination /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-1cbf4d21-c89d-449f-a979-ac0ac5608712 {{(pid=85458) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 17 21:57:28 devstack cinder-volume[85458]: INFO cinder.image.image_utils [None req-8f1fe40c-e93a-4c3a-9e7b-627ca89b9976 tempest-VolumesImageMetadata-1673387060 None] Converted 112.00 MB image at 45.60 MB/s Sep 17 21:57:28 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-8f1fe40c-e93a-4c3a-9e7b-627ca89b9976 tempest-VolumesImageMetadata-1673387060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-1cbf4d21-c89d-449f-a979-ac0ac5608712 1G {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:57:28 devstack sudo[94599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-1cbf4d21-c89d-449f-a979-ac0ac5608712 1G Sep 17 21:57:28 devstack sudo[94599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:57:29 devstack sudo[94599]: pam_unix(sudo:session): session closed for user root Sep 17 21:57:29 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-8f1fe40c-e93a-4c3a-9e7b-627ca89b9976 tempest-VolumesImageMetadata-1673387060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-1cbf4d21-c89d-449f-a979-ac0ac5608712 1G" returned: 0 in 0.433s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:57:29 devstack cinder-volume[85458]: DEBUG cinder.volume.volume_utils [None req-8f1fe40c-e93a-4c3a-9e7b-627ca89b9976 tempest-VolumesImageMetadata-1673387060 None] Downloaded image 764e44ff-49f7-469a-925c-23f254888b59 ((None, [{'url': 'file:///opt/stack/data/glance/images/764e44ff-49f7-469a-925c-23f254888b59', 'metadata': {}}])) to volume 1cbf4d21-c89d-449f-a979-ac0ac5608712 successfully. {{(pid=85458) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 17 21:57:29 devstack cinder-volume[85458]: DEBUG cinder.image.image_utils [None req-8f1fe40c-e93a-4c3a-9e7b-627ca89b9976 tempest-VolumesImageMetadata-1673387060 None] Temporary image 764e44ff-49f7-469a-925c-23f254888b59 for user 6242b47202b54e10aacbfb6ab560824e is deleted. {{(pid=85458) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 17 21:57:29 devstack cinder-volume[85458]: DEBUG cinder.volume.volume_utils [None req-8f1fe40c-e93a-4c3a-9e7b-627ca89b9976 tempest-VolumesImageMetadata-1673387060 None] Marking volume 1cbf4d21-c89d-449f-a979-ac0ac5608712 as bootable. {{(pid=85458) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 17 21:57:29 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f1fe40c-e93a-4c3a-9e7b-627ca89b9976 tempest-VolumesImageMetadata-1673387060 None] Copying metadata from image 764e44ff-49f7-469a-925c-23f254888b59 to 1cbf4d21-c89d-449f-a979-ac0ac5608712. {{(pid=85458) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 17 21:57:29 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f1fe40c-e93a-4c3a-9e7b-627ca89b9976 tempest-VolumesImageMetadata-1673387060 None] Creating volume glance metadata for volume 1cbf4d21-c89d-449f-a979-ac0ac5608712 backed by image 764e44ff-49f7-469a-925c-23f254888b59 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '764e44ff-49f7-469a-925c-23f254888b59', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=85458) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 17 21:57:29 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-8f1fe40c-e93a-4c3a-9e7b-627ca89b9976 tempest-VolumesImageMetadata-1673387060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20a3ff31-6e43-451a-906e-bc73a4c8a2fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1cbf4d21-c89d-449f-a979-ac0ac5608712', 'volume_size': 1, 'image_id': '764e44ff-49f7-469a-925c-23f254888b59', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/764e44ff-49f7-469a-925c-23f254888b59', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '530062d71c924da39eff46373302dc71', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '764e44ff-49f7-469a-925c-23f254888b59', 'created_at': datetime.datetime(2026, 9, 17, 19, 45, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 19, 45, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/764e44ff-49f7-469a-925c-23f254888b59/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:57:29 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-8f1fe40c-e93a-4c3a-9e7b-627ca89b9976 tempest-VolumesImageMetadata-1673387060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (313da528-140b-4d58-b24b-4420b256429a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:57:29 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-8f1fe40c-e93a-4c3a-9e7b-627ca89b9976 tempest-VolumesImageMetadata-1673387060 None] Volume volume-1cbf4d21-c89d-449f-a979-ac0ac5608712 (1cbf4d21-c89d-449f-a979-ac0ac5608712): created successfully Sep 17 21:57:29 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-8f1fe40c-e93a-4c3a-9e7b-627ca89b9976 tempest-VolumesImageMetadata-1673387060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (313da528-140b-4d58-b24b-4420b256429a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:57:29 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-8f1fe40c-e93a-4c3a-9e7b-627ca89b9976 tempest-VolumesImageMetadata-1673387060 None] Flow 'volume_create_manager' (c0f28887-8481-4a44-8042-b19c3a75f94b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 21:57:29 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-8f1fe40c-e93a-4c3a-9e7b-627ca89b9976 tempest-VolumesImageMetadata-1673387060 None] Created volume successfully. Sep 17 21:57:30 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-95223ad5-6af1-4b31-bd0a-4703d99e79f7 tempest-GroupSnapshotsTest-809568564 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 21:57:30 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-95223ad5-6af1-4b31-bd0a-4703d99e79f7 tempest-GroupSnapshotsTest-809568564 None] Flow 'volume_create_manager' (c7015a77-4a14-4545-b351-11611dcc38d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 21:57:30 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-95223ad5-6af1-4b31-bd0a-4703d99e79f7 tempest-GroupSnapshotsTest-809568564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93483d04-ef85-4d4c-b4e2-6d1c61d5ac47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:57:30 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-95223ad5-6af1-4b31-bd0a-4703d99e79f7 tempest-GroupSnapshotsTest-809568564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93483d04-ef85-4d4c-b4e2-6d1c61d5ac47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T19:57:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-523843676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ca1da93b-1641-4e1d-bed4-27822afed09b,host='devstack@QuobyteHD#QuobyteHD',id=b2247e13-fbc9-476e-b9c3-334bff642242,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5addd66fbea4ce983d8868233d58dd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T19:57:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T19:57:30Z,use_quota=True,user_id='32ad7a4fdca249cdb7b4968da545adc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af5b34a6-8a75-43d6-80b6-c12790ce0062),volume_type_id=af5b34a6-8a75-43d6-80b6-c12790ce0062)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:57:30 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-95223ad5-6af1-4b31-bd0a-4703d99e79f7 tempest-GroupSnapshotsTest-809568564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a430f45-e620-4e79-9fa9-aca9d82544b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:57:30 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-95223ad5-6af1-4b31-bd0a-4703d99e79f7 tempest-GroupSnapshotsTest-809568564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a430f45-e620-4e79-9fa9-aca9d82544b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:57:30 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-95223ad5-6af1-4b31-bd0a-4703d99e79f7 tempest-GroupSnapshotsTest-809568564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d46cbb13-25cd-4be7-8a54-86aeca61e306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:57:30 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-95223ad5-6af1-4b31-bd0a-4703d99e79f7 tempest-GroupSnapshotsTest-809568564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d46cbb13-25cd-4be7-8a54-86aeca61e306) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2247e13-fbc9-476e-b9c3-334bff642242', 'volume_name': 'volume-b2247e13-fbc9-476e-b9c3-334bff642242', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:57:30 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-95223ad5-6af1-4b31-bd0a-4703d99e79f7 tempest-GroupSnapshotsTest-809568564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d85af522-1fc9-45d4-bdde-70ca101b5f39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:57:30 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-95223ad5-6af1-4b31-bd0a-4703d99e79f7 tempest-GroupSnapshotsTest-809568564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d85af522-1fc9-45d4-bdde-70ca101b5f39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:57:30 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-95223ad5-6af1-4b31-bd0a-4703d99e79f7 tempest-GroupSnapshotsTest-809568564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49be7b52-fc9e-4894-9662-1f5212f9af11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:57:30 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-95223ad5-6af1-4b31-bd0a-4703d99e79f7 tempest-GroupSnapshotsTest-809568564 None] Volume b2247e13-fbc9-476e-b9c3-334bff642242: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2247e13-fbc9-476e-b9c3-334bff642242', 'volume_size': 1} Sep 17 21:57:30 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-95223ad5-6af1-4b31-bd0a-4703d99e79f7 tempest-GroupSnapshotsTest-809568564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:57:30 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-95223ad5-6af1-4b31-bd0a-4703d99e79f7 tempest-GroupSnapshotsTest-809568564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:57:30 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-95223ad5-6af1-4b31-bd0a-4703d99e79f7 tempest-GroupSnapshotsTest-809568564 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ca1da93b-1641-4e1d-bed4-27822afed09b,created_at=2026-09-17T19:57:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-523843676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ca1da93b-1641-4e1d-bed4-27822afed09b,host='devstack@QuobyteHD#QuobyteHD',id=b2247e13-fbc9-476e-b9c3-334bff642242,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5addd66fbea4ce983d8868233d58dd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T19:57:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T19:57:30Z,use_quota=True,user_id='32ad7a4fdca249cdb7b4968da545adc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af5b34a6-8a75-43d6-80b6-c12790ce0062),volume_type_id=af5b34a6-8a75-43d6-80b6-c12790ce0062)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 21:57:30 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-95223ad5-6af1-4b31-bd0a-4703d99e79f7 tempest-GroupSnapshotsTest-809568564 None] Creating volume b2247e13-fbc9-476e-b9c3-334bff642242 {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 21:57:30 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-95223ad5-6af1-4b31-bd0a-4703d99e79f7 tempest-GroupSnapshotsTest-809568564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:57:30 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-95223ad5-6af1-4b31-bd0a-4703d99e79f7 tempest-GroupSnapshotsTest-809568564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:57:30 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-95223ad5-6af1-4b31-bd0a-4703d99e79f7 tempest-GroupSnapshotsTest-809568564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 21:57:30 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-95223ad5-6af1-4b31-bd0a-4703d99e79f7 tempest-GroupSnapshotsTest-809568564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 21:57:30 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-95223ad5-6af1-4b31-bd0a-4703d99e79f7 tempest-GroupSnapshotsTest-809568564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:57:30 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-95223ad5-6af1-4b31-bd0a-4703d99e79f7 tempest-GroupSnapshotsTest-809568564 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 21:57:30 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-95223ad5-6af1-4b31-bd0a-4703d99e79f7 tempest-GroupSnapshotsTest-809568564 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 21:57:30 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-95223ad5-6af1-4b31-bd0a-4703d99e79f7 tempest-GroupSnapshotsTest-809568564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b2247e13-fbc9-476e-b9c3-334bff642242 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:57:30 devstack sudo[94613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b2247e13-fbc9-476e-b9c3-334bff642242 1073741824 Sep 17 21:57:30 devstack sudo[94613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:57:30 devstack sudo[94613]: pam_unix(sudo:session): session closed for user root Sep 17 21:57:30 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-95223ad5-6af1-4b31-bd0a-4703d99e79f7 tempest-GroupSnapshotsTest-809568564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b2247e13-fbc9-476e-b9c3-334bff642242 1073741824" returned: 0 in 0.597s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:57:30 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-95223ad5-6af1-4b31-bd0a-4703d99e79f7 tempest-GroupSnapshotsTest-809568564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b2247e13-fbc9-476e-b9c3-334bff642242 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:57:30 devstack sudo[94619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b2247e13-fbc9-476e-b9c3-334bff642242 Sep 17 21:57:30 devstack sudo[94619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:57:31 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-632c9528-74e0-40e9-b80c-283572cddc81 tempest-VolumesImageMetadata-1673387060 None] Acquiring lock "cinder-1cbf4d21-c89d-449f-a979-ac0ac5608712-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 21:57:31 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-632c9528-74e0-40e9-b80c-283572cddc81 tempest-VolumesImageMetadata-1673387060 None] Lock "cinder-1cbf4d21-c89d-449f-a979-ac0ac5608712-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 21:57:31 devstack sudo[94619]: pam_unix(sudo:session): session closed for user root Sep 17 21:57:31 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-632c9528-74e0-40e9-b80c-283572cddc81 tempest-VolumesImageMetadata-1673387060 None] Acquiring lock "cinder-quobyte-1cbf4d21-c89d-449f-a979-ac0ac5608712" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 21:57:31 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-95223ad5-6af1-4b31-bd0a-4703d99e79f7 tempest-GroupSnapshotsTest-809568564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b2247e13-fbc9-476e-b9c3-334bff642242" returned: 0 in 0.404s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:57:31 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-95223ad5-6af1-4b31-bd0a-4703d99e79f7 tempest-GroupSnapshotsTest-809568564 None] <== create_volume: return (1064ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 21:57:31 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-95223ad5-6af1-4b31-bd0a-4703d99e79f7 tempest-GroupSnapshotsTest-809568564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.067s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:57:31 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-95223ad5-6af1-4b31-bd0a-4703d99e79f7 tempest-GroupSnapshotsTest-809568564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49be7b52-fc9e-4894-9662-1f5212f9af11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2247e13-fbc9-476e-b9c3-334bff642242', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:57:31 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-95223ad5-6af1-4b31-bd0a-4703d99e79f7 tempest-GroupSnapshotsTest-809568564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (893add1d-9124-4a7e-b96b-9b92672c5d73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:57:31 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-632c9528-74e0-40e9-b80c-283572cddc81 tempest-VolumesImageMetadata-1673387060 None] Lock "cinder-quobyte-1cbf4d21-c89d-449f-a979-ac0ac5608712" acquired by "delete_volume" :: waited 0.038s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 21:57:31 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-95223ad5-6af1-4b31-bd0a-4703d99e79f7 tempest-GroupSnapshotsTest-809568564 None] Volume volume-b2247e13-fbc9-476e-b9c3-334bff642242 (b2247e13-fbc9-476e-b9c3-334bff642242): created successfully Sep 17 21:57:31 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-95223ad5-6af1-4b31-bd0a-4703d99e79f7 tempest-GroupSnapshotsTest-809568564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (893add1d-9124-4a7e-b96b-9b92672c5d73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:57:31 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-95223ad5-6af1-4b31-bd0a-4703d99e79f7 tempest-GroupSnapshotsTest-809568564 None] Flow 'volume_create_manager' (c7015a77-4a14-4545-b351-11611dcc38d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 21:57:31 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d5df724-86d7-46fe-8463-b46f7348208b]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 21:57:31 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-632c9528-74e0-40e9-b80c-283572cddc81 tempest-VolumesImageMetadata-1673387060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-1cbf4d21-c89d-449f-a979-ac0ac5608712 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:57:31 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-95223ad5-6af1-4b31-bd0a-4703d99e79f7 tempest-GroupSnapshotsTest-809568564 None] Created volume successfully. Sep 17 21:57:31 devstack sudo[94622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-1cbf4d21-c89d-449f-a979-ac0ac5608712 Sep 17 21:57:31 devstack sudo[94622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:57:31 devstack sudo[94622]: pam_unix(sudo:session): session closed for user root Sep 17 21:57:31 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-632c9528-74e0-40e9-b80c-283572cddc81 tempest-VolumesImageMetadata-1673387060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-1cbf4d21-c89d-449f-a979-ac0ac5608712" returned: 0 in 0.438s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:57:31 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-632c9528-74e0-40e9-b80c-283572cddc81 tempest-VolumesImageMetadata-1673387060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-1cbf4d21-c89d-449f-a979-ac0ac5608712 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:57:31 devstack sudo[94630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-1cbf4d21-c89d-449f-a979-ac0ac5608712 Sep 17 21:57:31 devstack sudo[94630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:57:32 devstack sudo[94630]: pam_unix(sudo:session): session closed for user root Sep 17 21:57:32 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-632c9528-74e0-40e9-b80c-283572cddc81 tempest-VolumesImageMetadata-1673387060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-1cbf4d21-c89d-449f-a979-ac0ac5608712" returned: 0 in 0.334s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:57:32 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-632c9528-74e0-40e9-b80c-283572cddc81 tempest-VolumesImageMetadata-1673387060 None] Lock "cinder-quobyte-1cbf4d21-c89d-449f-a979-ac0ac5608712" released by "delete_volume" :: held 0.860s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 21:57:32 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-632c9528-74e0-40e9-b80c-283572cddc81 tempest-VolumesImageMetadata-1673387060 None] Created reservations ['f6a6abdf-f9f5-4b5c-859d-7eee94f86748', '0c06c8c6-1234-4d90-8176-05464b2366f6', '7c9896db-bb6e-48f7-ba43-7557cd92668a', 'bc2e26a3-4a9b-472f-b8d9-4615b1a03d93'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 21:57:32 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-632c9528-74e0-40e9-b80c-283572cddc81 tempest-VolumesImageMetadata-1673387060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:57:32 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-632c9528-74e0-40e9-b80c-283572cddc81 tempest-VolumesImageMetadata-1673387060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:57:32 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-632c9528-74e0-40e9-b80c-283572cddc81 tempest-VolumesImageMetadata-1673387060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 21:57:32 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-632c9528-74e0-40e9-b80c-283572cddc81 tempest-VolumesImageMetadata-1673387060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 21:57:32 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-632c9528-74e0-40e9-b80c-283572cddc81 tempest-VolumesImageMetadata-1673387060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:57:32 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-632c9528-74e0-40e9-b80c-283572cddc81 tempest-VolumesImageMetadata-1673387060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:57:32 devstack sudo[94635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 21:57:32 devstack sudo[94635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:57:32 devstack sudo[94635]: pam_unix(sudo:session): session closed for user root Sep 17 21:57:32 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-632c9528-74e0-40e9-b80c-283572cddc81 tempest-VolumesImageMetadata-1673387060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.414s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:57:32 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-632c9528-74e0-40e9-b80c-283572cddc81 tempest-VolumesImageMetadata-1673387060 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 21:57:32 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-632c9528-74e0-40e9-b80c-283572cddc81 tempest-VolumesImageMetadata-1673387060 None] Deleted volume successfully. Sep 17 21:57:32 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-632c9528-74e0-40e9-b80c-283572cddc81 tempest-VolumesImageMetadata-1673387060 None] Lock "cinder-1cbf4d21-c89d-449f-a979-ac0ac5608712-delete_volume" released by "delete_volume" :: held 1.637s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 21:57:33 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-9e707aa2-1ee3-4646-b1ed-c212fad42bbd tempest-GroupSnapshotsTest-809568564 None] GroupSnapshot 716ccf10-9ff7-4906-9ac2-470214b1c7ca: creating. Sep 17 21:57:33 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-9e707aa2-1ee3-4646-b1ed-c212fad42bbd tempest-GroupSnapshotsTest-809568564 None] Group snapshot 716ccf10-9ff7-4906-9ac2-470214b1c7ca: creating. {{(pid=85458) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 17 21:57:33 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-9e707aa2-1ee3-4646-b1ed-c212fad42bbd tempest-GroupSnapshotsTest-809568564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:57:33 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-9e707aa2-1ee3-4646-b1ed-c212fad42bbd tempest-GroupSnapshotsTest-809568564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:57:33 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-9e707aa2-1ee3-4646-b1ed-c212fad42bbd tempest-GroupSnapshotsTest-809568564 None] Creating offline snapshot edaecff7-403e-40a3-92c0-8c61e1ad6111 of volume b2247e13-fbc9-476e-b9c3-334bff642242 {{(pid=85458) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 21:57:33 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[40b9b4ce-eff1-4c93-bae9-7cde688fb1a6]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 21:57:33 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-9e707aa2-1ee3-4646-b1ed-c212fad42bbd tempest-GroupSnapshotsTest-809568564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b2247e13-fbc9-476e-b9c3-334bff642242 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:57:33 devstack sudo[94638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b2247e13-fbc9-476e-b9c3-334bff642242 Sep 17 21:57:33 devstack sudo[94638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:57:33 devstack sudo[94638]: pam_unix(sudo:session): session closed for user root Sep 17 21:57:33 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-9e707aa2-1ee3-4646-b1ed-c212fad42bbd tempest-GroupSnapshotsTest-809568564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b2247e13-fbc9-476e-b9c3-334bff642242" returned: 0 in 0.614s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:57:33 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-9e707aa2-1ee3-4646-b1ed-c212fad42bbd tempest-GroupSnapshotsTest-809568564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b2247e13-fbc9-476e-b9c3-334bff642242,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b2247e13-fbc9-476e-b9c3-334bff642242.edaecff7-403e-40a3-92c0-8c61e1ad6111 1G {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:57:33 devstack sudo[94644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b2247e13-fbc9-476e-b9c3-334bff642242,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b2247e13-fbc9-476e-b9c3-334bff642242.edaecff7-403e-40a3-92c0-8c61e1ad6111 1G Sep 17 21:57:33 devstack sudo[94644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:57:34 devstack sudo[94644]: pam_unix(sudo:session): session closed for user root Sep 17 21:57:34 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-9e707aa2-1ee3-4646-b1ed-c212fad42bbd tempest-GroupSnapshotsTest-809568564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b2247e13-fbc9-476e-b9c3-334bff642242,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b2247e13-fbc9-476e-b9c3-334bff642242.edaecff7-403e-40a3-92c0-8c61e1ad6111 1G" returned: 0 in 0.730s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:57:34 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-9e707aa2-1ee3-4646-b1ed-c212fad42bbd tempest-GroupSnapshotsTest-809568564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2247e13-fbc9-476e-b9c3-334bff642242 -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b2247e13-fbc9-476e-b9c3-334bff642242.edaecff7-403e-40a3-92c0-8c61e1ad6111 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:57:34 devstack sudo[94660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2247e13-fbc9-476e-b9c3-334bff642242 -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b2247e13-fbc9-476e-b9c3-334bff642242.edaecff7-403e-40a3-92c0-8c61e1ad6111 Sep 17 21:57:34 devstack sudo[94660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:57:34 devstack sudo[94660]: pam_unix(sudo:session): session closed for user root Sep 17 21:57:34 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-9e707aa2-1ee3-4646-b1ed-c212fad42bbd tempest-GroupSnapshotsTest-809568564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2247e13-fbc9-476e-b9c3-334bff642242 -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b2247e13-fbc9-476e-b9c3-334bff642242.edaecff7-403e-40a3-92c0-8c61e1ad6111" returned: 0 in 0.474s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:57:34 devstack cinder-volume[85458]: WARNING cinder.volume.drivers.remotefs [None req-9e707aa2-1ee3-4646-b1ed-c212fad42bbd tempest-GroupSnapshotsTest-809568564 None] /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b2247e13-fbc9-476e-b9c3-334bff642242.edaecff7-403e-40a3-92c0-8c61e1ad6111 is being set with open permissions: ugo+rw: NotImplementedError Sep 17 21:57:34 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-9e707aa2-1ee3-4646-b1ed-c212fad42bbd tempest-GroupSnapshotsTest-809568564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b2247e13-fbc9-476e-b9c3-334bff642242.edaecff7-403e-40a3-92c0-8c61e1ad6111 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:57:35 devstack sudo[94668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b2247e13-fbc9-476e-b9c3-334bff642242.edaecff7-403e-40a3-92c0-8c61e1ad6111 Sep 17 21:57:35 devstack sudo[94668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:57:35 devstack sudo[94668]: pam_unix(sudo:session): session closed for user root Sep 17 21:57:35 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-9e707aa2-1ee3-4646-b1ed-c212fad42bbd tempest-GroupSnapshotsTest-809568564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b2247e13-fbc9-476e-b9c3-334bff642242.edaecff7-403e-40a3-92c0-8c61e1ad6111" returned: 0 in 0.365s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:57:35 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-9e707aa2-1ee3-4646-b1ed-c212fad42bbd tempest-GroupSnapshotsTest-809568564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b2247e13-fbc9-476e-b9c3-334bff642242.info {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:57:35 devstack sudo[94671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b2247e13-fbc9-476e-b9c3-334bff642242.info Sep 17 21:57:35 devstack sudo[94671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:57:35 devstack sudo[94671]: pam_unix(sudo:session): session closed for user root Sep 17 21:57:35 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-9e707aa2-1ee3-4646-b1ed-c212fad42bbd tempest-GroupSnapshotsTest-809568564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b2247e13-fbc9-476e-b9c3-334bff642242.info" returned: 0 in 0.304s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:57:35 devstack cinder-volume[85458]: WARNING cinder.volume.drivers.remotefs [None req-9e707aa2-1ee3-4646-b1ed-c212fad42bbd tempest-GroupSnapshotsTest-809568564 None] /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b2247e13-fbc9-476e-b9c3-334bff642242.info is being set with open permissions: ugo+rw: NotImplementedError Sep 17 21:57:35 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-9e707aa2-1ee3-4646-b1ed-c212fad42bbd tempest-GroupSnapshotsTest-809568564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b2247e13-fbc9-476e-b9c3-334bff642242.info {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:57:35 devstack sudo[94674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b2247e13-fbc9-476e-b9c3-334bff642242.info Sep 17 21:57:35 devstack sudo[94674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:57:36 devstack sudo[94674]: pam_unix(sudo:session): session closed for user root Sep 17 21:57:36 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-9e707aa2-1ee3-4646-b1ed-c212fad42bbd tempest-GroupSnapshotsTest-809568564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b2247e13-fbc9-476e-b9c3-334bff642242.info" returned: 0 in 0.334s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:57:36 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-9e707aa2-1ee3-4646-b1ed-c212fad42bbd tempest-GroupSnapshotsTest-809568564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.941s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:57:36 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-9e707aa2-1ee3-4646-b1ed-c212fad42bbd tempest-GroupSnapshotsTest-809568564 None] group_snapshot 716ccf10-9ff7-4906-9ac2-470214b1c7ca: created successfully Sep 17 21:57:37 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-2b927d3b-06ca-41c2-a4ba-b5abcfa36368 tempest-GroupSnapshotsTest-809568564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:57:37 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-2b927d3b-06ca-41c2-a4ba-b5abcfa36368 tempest-GroupSnapshotsTest-809568564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:57:37 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-2b927d3b-06ca-41c2-a4ba-b5abcfa36368 tempest-GroupSnapshotsTest-809568564 None] Acquiring lock "cinder-quobyte-edaecff7-403e-40a3-92c0-8c61e1ad6111-499dc8a5-b516-4009-bc2d-7e2c3eb3763c" by "_create_volume_from_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 21:57:37 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-2b927d3b-06ca-41c2-a4ba-b5abcfa36368 tempest-GroupSnapshotsTest-809568564 None] Lock "cinder-quobyte-edaecff7-403e-40a3-92c0-8c61e1ad6111-499dc8a5-b516-4009-bc2d-7e2c3eb3763c" acquired by "_create_volume_from_snapshot" :: waited 0.030s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 21:57:37 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-2b927d3b-06ca-41c2-a4ba-b5abcfa36368 tempest-GroupSnapshotsTest-809568564 None] Creating volume 499dc8a5-b516-4009-bc2d-7e2c3eb3763c from snapshot edaecff7-403e-40a3-92c0-8c61e1ad6111 {{(pid=85458) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 17 21:57:37 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-2b927d3b-06ca-41c2-a4ba-b5abcfa36368 tempest-GroupSnapshotsTest-809568564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:57:37 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-2b927d3b-06ca-41c2-a4ba-b5abcfa36368 tempest-GroupSnapshotsTest-809568564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:57:37 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-2b927d3b-06ca-41c2-a4ba-b5abcfa36368 tempest-GroupSnapshotsTest-809568564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 21:57:37 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-2b927d3b-06ca-41c2-a4ba-b5abcfa36368 tempest-GroupSnapshotsTest-809568564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 21:57:37 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-2b927d3b-06ca-41c2-a4ba-b5abcfa36368 tempest-GroupSnapshotsTest-809568564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:57:37 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-2b927d3b-06ca-41c2-a4ba-b5abcfa36368 tempest-GroupSnapshotsTest-809568564 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 21:57:37 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-2b927d3b-06ca-41c2-a4ba-b5abcfa36368 tempest-GroupSnapshotsTest-809568564 None] Acquiring lock "cinder-quobyte-499dc8a5-b516-4009-bc2d-7e2c3eb3763c" by "_copy_volume_from_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 21:57:37 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-2b927d3b-06ca-41c2-a4ba-b5abcfa36368 tempest-GroupSnapshotsTest-809568564 None] Lock "cinder-quobyte-499dc8a5-b516-4009-bc2d-7e2c3eb3763c" acquired by "_copy_volume_from_snapshot" :: waited 0.032s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 21:57:37 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-2b927d3b-06ca-41c2-a4ba-b5abcfa36368 tempest-GroupSnapshotsTest-809568564 None] snapshot: edaecff7-403e-40a3-92c0-8c61e1ad6111, volume: 499dc8a5-b516-4009-bc2d-7e2c3eb3763c, {{(pid=85458) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 17 21:57:37 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-2b927d3b-06ca-41c2-a4ba-b5abcfa36368 tempest-GroupSnapshotsTest-809568564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:57:37 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-2b927d3b-06ca-41c2-a4ba-b5abcfa36368 tempest-GroupSnapshotsTest-809568564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:57:37 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-2b927d3b-06ca-41c2-a4ba-b5abcfa36368 tempest-GroupSnapshotsTest-809568564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 21:57:37 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-2b927d3b-06ca-41c2-a4ba-b5abcfa36368 tempest-GroupSnapshotsTest-809568564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 21:57:37 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-2b927d3b-06ca-41c2-a4ba-b5abcfa36368 tempest-GroupSnapshotsTest-809568564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:57:37 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b5a4105-4131-4b75-aa6c-84fcb6243d6f]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 21:57:37 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-2b927d3b-06ca-41c2-a4ba-b5abcfa36368 tempest-GroupSnapshotsTest-809568564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b2247e13-fbc9-476e-b9c3-334bff642242.edaecff7-403e-40a3-92c0-8c61e1ad6111 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:57:37 devstack sudo[94678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b2247e13-fbc9-476e-b9c3-334bff642242.edaecff7-403e-40a3-92c0-8c61e1ad6111 Sep 17 21:57:37 devstack sudo[94678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:57:38 devstack sudo[94678]: pam_unix(sudo:session): session closed for user root Sep 17 21:57:38 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-2b927d3b-06ca-41c2-a4ba-b5abcfa36368 tempest-GroupSnapshotsTest-809568564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b2247e13-fbc9-476e-b9c3-334bff642242.edaecff7-403e-40a3-92c0-8c61e1ad6111" returned: 0 in 0.599s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:57:38 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-2b927d3b-06ca-41c2-a4ba-b5abcfa36368 tempest-GroupSnapshotsTest-809568564 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b2247e13-fbc9-476e-b9c3-334bff642242(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85458) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 21:57:38 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3db5412-ebc3-481d-86f2-e9c03df342d7]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 21:57:38 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-2b927d3b-06ca-41c2-a4ba-b5abcfa36368 tempest-GroupSnapshotsTest-809568564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b2247e13-fbc9-476e-b9c3-334bff642242 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:57:38 devstack sudo[94683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b2247e13-fbc9-476e-b9c3-334bff642242 Sep 17 21:57:38 devstack sudo[94683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:57:38 devstack sudo[94683]: pam_unix(sudo:session): session closed for user root Sep 17 21:57:38 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-2b927d3b-06ca-41c2-a4ba-b5abcfa36368 tempest-GroupSnapshotsTest-809568564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b2247e13-fbc9-476e-b9c3-334bff642242" returned: 0 in 0.545s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:57:38 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-2b927d3b-06ca-41c2-a4ba-b5abcfa36368 tempest-GroupSnapshotsTest-809568564 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b2247e13-fbc9-476e-b9c3-334bff642242 {{(pid=85458) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 17 21:57:38 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-2b927d3b-06ca-41c2-a4ba-b5abcfa36368 tempest-GroupSnapshotsTest-809568564 None] Creating direct copy from snapshot {{(pid=85458) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 17 21:57:38 devstack cinder-volume[85458]: DEBUG cinder.utils [None req-2b927d3b-06ca-41c2-a4ba-b5abcfa36368 tempest-GroupSnapshotsTest-809568564 None] Path /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-499dc8a5-b516-4009-bc2d-7e2c3eb3763c not found in is_blk_device check {{(pid=85458) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 17 21:57:38 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-2b927d3b-06ca-41c2-a4ba-b5abcfa36368 tempest-GroupSnapshotsTest-809568564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b2247e13-fbc9-476e-b9c3-334bff642242 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-499dc8a5-b516-4009-bc2d-7e2c3eb3763c {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:57:38 devstack sudo[94706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b2247e13-fbc9-476e-b9c3-334bff642242 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-499dc8a5-b516-4009-bc2d-7e2c3eb3763c Sep 17 21:57:38 devstack sudo[94706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:57:42 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4b77be7-54d0-4943-a95f-b6f06444ecac tempest-VolumesTransfersV357Test-701551214 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 21:57:42 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-d4b77be7-54d0-4943-a95f-b6f06444ecac tempest-VolumesTransfersV357Test-701551214 None] Flow 'volume_create_manager' (7bf08a02-c5d4-4993-9ab1-de284c9b4818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 21:57:42 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-d4b77be7-54d0-4943-a95f-b6f06444ecac tempest-VolumesTransfersV357Test-701551214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fc6e3d9-9d75-418a-ab21-cf7f6e1f8dfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:57:42 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-d4b77be7-54d0-4943-a95f-b6f06444ecac tempest-VolumesTransfersV357Test-701551214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fc6e3d9-9d75-418a-ab21-cf7f6e1f8dfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T19:57:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1965021925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c639ceee-0d72-4f3c-aa5b-0f2677aaaf78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8cccd4ae07e44189993f50bfd51ac16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T19:57:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T19:57:42Z,use_quota=True,user_id='daa10de243704722b1fdd78ec89696bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:57:42 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-d4b77be7-54d0-4943-a95f-b6f06444ecac tempest-VolumesTransfersV357Test-701551214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (582b2ebe-17a3-486f-a477-7e64714e3dd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:57:42 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-d4b77be7-54d0-4943-a95f-b6f06444ecac tempest-VolumesTransfersV357Test-701551214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (582b2ebe-17a3-486f-a477-7e64714e3dd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:57:42 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-d4b77be7-54d0-4943-a95f-b6f06444ecac tempest-VolumesTransfersV357Test-701551214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da64b3c2-1c4e-487c-a98c-2cee72c02d03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:57:42 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-d4b77be7-54d0-4943-a95f-b6f06444ecac tempest-VolumesTransfersV357Test-701551214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da64b3c2-1c4e-487c-a98c-2cee72c02d03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c639ceee-0d72-4f3c-aa5b-0f2677aaaf78', 'volume_name': 'volume-c639ceee-0d72-4f3c-aa5b-0f2677aaaf78', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:57:42 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-d4b77be7-54d0-4943-a95f-b6f06444ecac tempest-VolumesTransfersV357Test-701551214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bf791d2-b9b9-40a0-b14d-18b713fd9fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:57:42 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-d4b77be7-54d0-4943-a95f-b6f06444ecac tempest-VolumesTransfersV357Test-701551214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bf791d2-b9b9-40a0-b14d-18b713fd9fa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:57:42 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-d4b77be7-54d0-4943-a95f-b6f06444ecac tempest-VolumesTransfersV357Test-701551214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57c1d0fb-daa3-45d1-af9c-2f1c4902a89a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:57:42 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-d4b77be7-54d0-4943-a95f-b6f06444ecac tempest-VolumesTransfersV357Test-701551214 None] Volume c639ceee-0d72-4f3c-aa5b-0f2677aaaf78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c639ceee-0d72-4f3c-aa5b-0f2677aaaf78', 'volume_size': 1} Sep 17 21:57:42 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-d4b77be7-54d0-4943-a95f-b6f06444ecac tempest-VolumesTransfersV357Test-701551214 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:57:49 devstack sudo[94706]: pam_unix(sudo:session): session closed for user root Sep 17 21:57:49 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-2b927d3b-06ca-41c2-a4ba-b5abcfa36368 tempest-GroupSnapshotsTest-809568564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b2247e13-fbc9-476e-b9c3-334bff642242 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-499dc8a5-b516-4009-bc2d-7e2c3eb3763c" returned: 0 in 10.773s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:57:49 devstack cinder-volume[85458]: DEBUG cinder.image.image_utils [None req-2b927d3b-06ca-41c2-a4ba-b5abcfa36368 tempest-GroupSnapshotsTest-809568564 None] Image conversion details: src /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b2247e13-fbc9-476e-b9c3-334bff642242, size 1024.00 MB, duration 10.78 sec, destination /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-499dc8a5-b516-4009-bc2d-7e2c3eb3763c {{(pid=85458) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 17 21:57:49 devstack cinder-volume[85458]: INFO cinder.image.image_utils [None req-2b927d3b-06ca-41c2-a4ba-b5abcfa36368 tempest-GroupSnapshotsTest-809568564 None] Converted 1024.00 MB image at 95.03 MB/s Sep 17 21:57:49 devstack cinder-volume[85458]: WARNING cinder.volume.drivers.remotefs [None req-2b927d3b-06ca-41c2-a4ba-b5abcfa36368 tempest-GroupSnapshotsTest-809568564 None] /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-499dc8a5-b516-4009-bc2d-7e2c3eb3763c is being set with open permissions: ugo+rw: NotImplementedError Sep 17 21:57:49 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-2b927d3b-06ca-41c2-a4ba-b5abcfa36368 tempest-GroupSnapshotsTest-809568564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-499dc8a5-b516-4009-bc2d-7e2c3eb3763c {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:57:49 devstack sudo[94775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-499dc8a5-b516-4009-bc2d-7e2c3eb3763c Sep 17 21:57:49 devstack sudo[94775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:57:49 devstack sudo[94775]: pam_unix(sudo:session): session closed for user root Sep 17 21:57:49 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-2b927d3b-06ca-41c2-a4ba-b5abcfa36368 tempest-GroupSnapshotsTest-809568564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-499dc8a5-b516-4009-bc2d-7e2c3eb3763c" returned: 0 in 0.288s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:57:49 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-2b927d3b-06ca-41c2-a4ba-b5abcfa36368 tempest-GroupSnapshotsTest-809568564 None] Lock "cinder-quobyte-499dc8a5-b516-4009-bc2d-7e2c3eb3763c" released by "_copy_volume_from_snapshot" :: held 12.393s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 21:57:49 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-2b927d3b-06ca-41c2-a4ba-b5abcfa36368 tempest-GroupSnapshotsTest-809568564 None] Lock "cinder-quobyte-edaecff7-403e-40a3-92c0-8c61e1ad6111-499dc8a5-b516-4009-bc2d-7e2c3eb3763c" released by "_create_volume_from_snapshot" :: held 12.524s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 21:57:49 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-2b927d3b-06ca-41c2-a4ba-b5abcfa36368 tempest-GroupSnapshotsTest-809568564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.556s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:57:49 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-d4b77be7-54d0-4943-a95f-b6f06444ecac tempest-VolumesTransfersV357Test-701551214 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.932s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:57:49 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-d4b77be7-54d0-4943-a95f-b6f06444ecac tempest-VolumesTransfersV357Test-701551214 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T19:57:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1965021925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c639ceee-0d72-4f3c-aa5b-0f2677aaaf78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8cccd4ae07e44189993f50bfd51ac16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T19:57:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T19:57:42Z,use_quota=True,user_id='daa10de243704722b1fdd78ec89696bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 21:57:49 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-d4b77be7-54d0-4943-a95f-b6f06444ecac tempest-VolumesTransfersV357Test-701551214 None] Creating volume c639ceee-0d72-4f3c-aa5b-0f2677aaaf78 {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 21:57:49 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-d4b77be7-54d0-4943-a95f-b6f06444ecac tempest-VolumesTransfersV357Test-701551214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:57:49 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-d4b77be7-54d0-4943-a95f-b6f06444ecac tempest-VolumesTransfersV357Test-701551214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:57:49 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-d4b77be7-54d0-4943-a95f-b6f06444ecac tempest-VolumesTransfersV357Test-701551214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 21:57:49 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-d4b77be7-54d0-4943-a95f-b6f06444ecac tempest-VolumesTransfersV357Test-701551214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 21:57:49 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-d4b77be7-54d0-4943-a95f-b6f06444ecac tempest-VolumesTransfersV357Test-701551214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:57:49 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-d4b77be7-54d0-4943-a95f-b6f06444ecac tempest-VolumesTransfersV357Test-701551214 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 21:57:49 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-d4b77be7-54d0-4943-a95f-b6f06444ecac tempest-VolumesTransfersV357Test-701551214 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 21:57:49 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-d4b77be7-54d0-4943-a95f-b6f06444ecac tempest-VolumesTransfersV357Test-701551214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c639ceee-0d72-4f3c-aa5b-0f2677aaaf78 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:57:49 devstack sudo[94778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c639ceee-0d72-4f3c-aa5b-0f2677aaaf78 1073741824 Sep 17 21:57:49 devstack sudo[94778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:57:50 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-2b927d3b-06ca-41c2-a4ba-b5abcfa36368 tempest-GroupSnapshotsTest-809568564 None] Create group from source-snapshot-716ccf10-9ff7-4906-9ac2-470214b1c7ca completed successfully. Sep 17 21:57:50 devstack sudo[94778]: pam_unix(sudo:session): session closed for user root Sep 17 21:57:50 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-d4b77be7-54d0-4943-a95f-b6f06444ecac tempest-VolumesTransfersV357Test-701551214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c639ceee-0d72-4f3c-aa5b-0f2677aaaf78 1073741824" returned: 0 in 0.545s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:57:50 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-d4b77be7-54d0-4943-a95f-b6f06444ecac tempest-VolumesTransfersV357Test-701551214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c639ceee-0d72-4f3c-aa5b-0f2677aaaf78 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:57:50 devstack sudo[94784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c639ceee-0d72-4f3c-aa5b-0f2677aaaf78 Sep 17 21:57:50 devstack sudo[94784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:57:50 devstack sudo[94784]: pam_unix(sudo:session): session closed for user root Sep 17 21:57:50 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-d4b77be7-54d0-4943-a95f-b6f06444ecac tempest-VolumesTransfersV357Test-701551214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c639ceee-0d72-4f3c-aa5b-0f2677aaaf78" returned: 0 in 0.318s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:57:50 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-d4b77be7-54d0-4943-a95f-b6f06444ecac tempest-VolumesTransfersV357Test-701551214 None] <== create_volume: return (904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 21:57:50 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-d4b77be7-54d0-4943-a95f-b6f06444ecac tempest-VolumesTransfersV357Test-701551214 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.908s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:57:50 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-d4b77be7-54d0-4943-a95f-b6f06444ecac tempest-VolumesTransfersV357Test-701551214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57c1d0fb-daa3-45d1-af9c-2f1c4902a89a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c639ceee-0d72-4f3c-aa5b-0f2677aaaf78', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:57:50 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-d4b77be7-54d0-4943-a95f-b6f06444ecac tempest-VolumesTransfersV357Test-701551214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (496b3ff6-5b83-4cf8-a44d-05ea2ab3d28c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:57:50 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-d4b77be7-54d0-4943-a95f-b6f06444ecac tempest-VolumesTransfersV357Test-701551214 None] Volume volume-c639ceee-0d72-4f3c-aa5b-0f2677aaaf78 (c639ceee-0d72-4f3c-aa5b-0f2677aaaf78): created successfully Sep 17 21:57:50 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-d4b77be7-54d0-4943-a95f-b6f06444ecac tempest-VolumesTransfersV357Test-701551214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (496b3ff6-5b83-4cf8-a44d-05ea2ab3d28c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:57:50 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-d4b77be7-54d0-4943-a95f-b6f06444ecac tempest-VolumesTransfersV357Test-701551214 None] Flow 'volume_create_manager' (7bf08a02-c5d4-4993-9ab1-de284c9b4818) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 21:57:50 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-d4b77be7-54d0-4943-a95f-b6f06444ecac tempest-VolumesTransfersV357Test-701551214 None] Created volume successfully. Sep 17 21:57:51 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-c4bd129a-b84c-40ad-a266-be2fbfc78c8a tempest-GroupSnapshotsTest-809568564 None] Acquiring lock "cinder-quobyte-499dc8a5-b516-4009-bc2d-7e2c3eb3763c" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 21:57:51 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-c4bd129a-b84c-40ad-a266-be2fbfc78c8a tempest-GroupSnapshotsTest-809568564 None] Lock "cinder-quobyte-499dc8a5-b516-4009-bc2d-7e2c3eb3763c" acquired by "delete_volume" :: waited 0.034s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 21:57:51 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f35ff84-a600-4e4b-adb3-ec9f99c483cf]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 21:57:51 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-c4bd129a-b84c-40ad-a266-be2fbfc78c8a tempest-GroupSnapshotsTest-809568564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-499dc8a5-b516-4009-bc2d-7e2c3eb3763c {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:57:51 devstack sudo[94787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-499dc8a5-b516-4009-bc2d-7e2c3eb3763c Sep 17 21:57:51 devstack sudo[94787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:57:52 devstack sudo[94787]: pam_unix(sudo:session): session closed for user root Sep 17 21:57:52 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-c4bd129a-b84c-40ad-a266-be2fbfc78c8a tempest-GroupSnapshotsTest-809568564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-499dc8a5-b516-4009-bc2d-7e2c3eb3763c" returned: 0 in 0.540s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:57:52 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-c4bd129a-b84c-40ad-a266-be2fbfc78c8a tempest-GroupSnapshotsTest-809568564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-499dc8a5-b516-4009-bc2d-7e2c3eb3763c {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:57:52 devstack sudo[94793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-499dc8a5-b516-4009-bc2d-7e2c3eb3763c Sep 17 21:57:52 devstack sudo[94793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:57:52 devstack sudo[94793]: pam_unix(sudo:session): session closed for user root Sep 17 21:57:52 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-c4bd129a-b84c-40ad-a266-be2fbfc78c8a tempest-GroupSnapshotsTest-809568564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-499dc8a5-b516-4009-bc2d-7e2c3eb3763c" returned: 0 in 0.317s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:57:52 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-c4bd129a-b84c-40ad-a266-be2fbfc78c8a tempest-GroupSnapshotsTest-809568564 None] Lock "cinder-quobyte-499dc8a5-b516-4009-bc2d-7e2c3eb3763c" released by "delete_volume" :: held 0.940s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 21:57:52 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-c4bd129a-b84c-40ad-a266-be2fbfc78c8a tempest-GroupSnapshotsTest-809568564 None] Created reservations ['bd8f58c5-3b97-4e3d-a4ba-3ea3788f2a31'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 21:57:52 devstack cinder-volume[85458]: WARNING cinder.quota [None req-c4bd129a-b84c-40ad-a266-be2fbfc78c8a tempest-GroupSnapshotsTest-809568564 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1688939785 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1688939785, it is now deprecated. Please use the default quota class for default quota. Sep 17 21:57:52 devstack cinder-volume[85458]: WARNING cinder.quota [None req-c4bd129a-b84c-40ad-a266-be2fbfc78c8a tempest-GroupSnapshotsTest-809568564 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1688939785 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1688939785, it is now deprecated. Please use the default quota class for default quota. Sep 17 21:57:52 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-c4bd129a-b84c-40ad-a266-be2fbfc78c8a tempest-GroupSnapshotsTest-809568564 None] Created reservations ['cfcff3d3-4dec-4494-8c61-5cb45c836cbf', '1ed118c4-ccce-46b7-ada4-b433f238466c', '0d0584f4-d57c-43bf-9d86-a53a1044814a', 'c8a88e0c-b6f7-4349-ab0d-68fe9bc2d021'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 21:57:52 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-8601792b-da05-4543-b1b4-0019415a71c6 tempest-VolumesTransfersV357Test-2133804274 None] Transfer volume completed successfully. Sep 17 21:57:52 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-c4bd129a-b84c-40ad-a266-be2fbfc78c8a tempest-GroupSnapshotsTest-809568564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:57:52 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-c4bd129a-b84c-40ad-a266-be2fbfc78c8a tempest-GroupSnapshotsTest-809568564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:57:52 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-c4bd129a-b84c-40ad-a266-be2fbfc78c8a tempest-GroupSnapshotsTest-809568564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 21:57:52 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-c4bd129a-b84c-40ad-a266-be2fbfc78c8a tempest-GroupSnapshotsTest-809568564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 21:57:52 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-c4bd129a-b84c-40ad-a266-be2fbfc78c8a tempest-GroupSnapshotsTest-809568564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:57:52 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-c4bd129a-b84c-40ad-a266-be2fbfc78c8a tempest-GroupSnapshotsTest-809568564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:57:52 devstack sudo[94805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 21:57:52 devstack sudo[94805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:57:53 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-8089675a-9d92-49b7-84b5-f17e93907198 tempest-GroupSnapshotsTest-809568564 None] group_snapshot 716ccf10-9ff7-4906-9ac2-470214b1c7ca: deleting Sep 17 21:57:53 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-8089675a-9d92-49b7-84b5-f17e93907198 tempest-GroupSnapshotsTest-809568564 None] group_snapshot 716ccf10-9ff7-4906-9ac2-470214b1c7ca: deleting {{(pid=85458) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 17 21:57:53 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-8089675a-9d92-49b7-84b5-f17e93907198 tempest-GroupSnapshotsTest-809568564 None] Acquiring lock "cinder-quobyte-b2247e13-fbc9-476e-b9c3-334bff642242" by "delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 21:57:53 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-8089675a-9d92-49b7-84b5-f17e93907198 tempest-GroupSnapshotsTest-809568564 None] Lock "cinder-quobyte-b2247e13-fbc9-476e-b9c3-334bff642242" acquired by "delete_snapshot" :: waited 0.046s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 21:57:53 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-8089675a-9d92-49b7-84b5-f17e93907198 tempest-GroupSnapshotsTest-809568564 None] Acquiring lock "cinder-quobyte-edaecff7-403e-40a3-92c0-8c61e1ad6111" by "_delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 21:57:53 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-8089675a-9d92-49b7-84b5-f17e93907198 tempest-GroupSnapshotsTest-809568564 None] Lock "cinder-quobyte-edaecff7-403e-40a3-92c0-8c61e1ad6111" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 21:57:53 devstack sudo[94805]: pam_unix(sudo:session): session closed for user root Sep 17 21:57:53 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-8089675a-9d92-49b7-84b5-f17e93907198 tempest-GroupSnapshotsTest-809568564 None] Deleting offline snapshot edaecff7-403e-40a3-92c0-8c61e1ad6111 of volume b2247e13-fbc9-476e-b9c3-334bff642242 {{(pid=85458) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 21:57:53 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-8089675a-9d92-49b7-84b5-f17e93907198 tempest-GroupSnapshotsTest-809568564 None] snapshot_file for this snap is: volume-b2247e13-fbc9-476e-b9c3-334bff642242.edaecff7-403e-40a3-92c0-8c61e1ad6111 {{(pid=85458) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 21:57:53 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-c4bd129a-b84c-40ad-a266-be2fbfc78c8a tempest-GroupSnapshotsTest-809568564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.475s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:57:53 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-c4bd129a-b84c-40ad-a266-be2fbfc78c8a tempest-GroupSnapshotsTest-809568564 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 21:57:53 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-c4bd129a-b84c-40ad-a266-be2fbfc78c8a tempest-GroupSnapshotsTest-809568564 None] Delete group completed successfully. Sep 17 21:57:53 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[10f37786-c7f0-42da-99b7-d71233f5e448]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 21:57:53 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-8089675a-9d92-49b7-84b5-f17e93907198 tempest-GroupSnapshotsTest-809568564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b2247e13-fbc9-476e-b9c3-334bff642242.edaecff7-403e-40a3-92c0-8c61e1ad6111 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:57:53 devstack sudo[94811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b2247e13-fbc9-476e-b9c3-334bff642242.edaecff7-403e-40a3-92c0-8c61e1ad6111 Sep 17 21:57:53 devstack sudo[94811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:57:53 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-fc255902-a138-41c5-866e-43a273c5b2f5 tempest-VolumesTransfersV357Test-1472277794 None] Acquiring lock "cinder-c639ceee-0d72-4f3c-aa5b-0f2677aaaf78-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 21:57:53 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-fc255902-a138-41c5-866e-43a273c5b2f5 tempest-VolumesTransfersV357Test-1472277794 None] Lock "cinder-c639ceee-0d72-4f3c-aa5b-0f2677aaaf78-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 21:57:53 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-fc255902-a138-41c5-866e-43a273c5b2f5 tempest-VolumesTransfersV357Test-1472277794 None] Acquiring lock "cinder-quobyte-c639ceee-0d72-4f3c-aa5b-0f2677aaaf78" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 21:57:53 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-fc255902-a138-41c5-866e-43a273c5b2f5 tempest-VolumesTransfersV357Test-1472277794 None] Lock "cinder-quobyte-c639ceee-0d72-4f3c-aa5b-0f2677aaaf78" acquired by "delete_volume" :: waited 0.018s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 21:57:53 devstack sudo[94811]: pam_unix(sudo:session): session closed for user root Sep 17 21:57:53 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-8089675a-9d92-49b7-84b5-f17e93907198 tempest-GroupSnapshotsTest-809568564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b2247e13-fbc9-476e-b9c3-334bff642242.edaecff7-403e-40a3-92c0-8c61e1ad6111" returned: 0 in 0.483s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:57:53 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-8089675a-9d92-49b7-84b5-f17e93907198 tempest-GroupSnapshotsTest-809568564 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b2247e13-fbc9-476e-b9c3-334bff642242(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85458) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 21:57:53 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[39897a4a-fdfc-487b-a437-5b4a9b465212]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 21:57:53 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-fc255902-a138-41c5-866e-43a273c5b2f5 tempest-VolumesTransfersV357Test-1472277794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c639ceee-0d72-4f3c-aa5b-0f2677aaaf78 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:57:53 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[54f70daa-74d4-44ac-9b04-605184f39149]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 21:57:53 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-8089675a-9d92-49b7-84b5-f17e93907198 tempest-GroupSnapshotsTest-809568564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b2247e13-fbc9-476e-b9c3-334bff642242 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:57:54 devstack sudo[94816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c639ceee-0d72-4f3c-aa5b-0f2677aaaf78 Sep 17 21:57:54 devstack sudo[94816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:57:54 devstack sudo[94817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b2247e13-fbc9-476e-b9c3-334bff642242 Sep 17 21:57:54 devstack sudo[94817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:57:54 devstack sudo[94816]: pam_unix(sudo:session): session closed for user root Sep 17 21:57:54 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-fc255902-a138-41c5-866e-43a273c5b2f5 tempest-VolumesTransfersV357Test-1472277794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c639ceee-0d72-4f3c-aa5b-0f2677aaaf78" returned: 0 in 0.390s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:57:54 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-fc255902-a138-41c5-866e-43a273c5b2f5 tempest-VolumesTransfersV357Test-1472277794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c639ceee-0d72-4f3c-aa5b-0f2677aaaf78 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:57:54 devstack sudo[94825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c639ceee-0d72-4f3c-aa5b-0f2677aaaf78 Sep 17 21:57:54 devstack sudo[94825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:57:54 devstack sudo[94817]: pam_unix(sudo:session): session closed for user root Sep 17 21:57:54 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-8089675a-9d92-49b7-84b5-f17e93907198 tempest-GroupSnapshotsTest-809568564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b2247e13-fbc9-476e-b9c3-334bff642242" returned: 0 in 0.597s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:57:54 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-8089675a-9d92-49b7-84b5-f17e93907198 tempest-GroupSnapshotsTest-809568564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b2247e13-fbc9-476e-b9c3-334bff642242.edaecff7-403e-40a3-92c0-8c61e1ad6111 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:57:54 devstack sudo[94829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b2247e13-fbc9-476e-b9c3-334bff642242.edaecff7-403e-40a3-92c0-8c61e1ad6111 Sep 17 21:57:54 devstack sudo[94829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:57:54 devstack sudo[94825]: pam_unix(sudo:session): session closed for user root Sep 17 21:57:54 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-fc255902-a138-41c5-866e-43a273c5b2f5 tempest-VolumesTransfersV357Test-1472277794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c639ceee-0d72-4f3c-aa5b-0f2677aaaf78" returned: 0 in 0.283s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:57:54 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-fc255902-a138-41c5-866e-43a273c5b2f5 tempest-VolumesTransfersV357Test-1472277794 None] Lock "cinder-quobyte-c639ceee-0d72-4f3c-aa5b-0f2677aaaf78" released by "delete_volume" :: held 0.741s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 21:57:54 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-fc255902-a138-41c5-866e-43a273c5b2f5 tempest-VolumesTransfersV357Test-1472277794 None] Created reservations ['6873e2da-d73f-4958-b974-65d286e922e9', '36daef30-8254-463f-afc3-f6964fbbe93c', '8f125dac-fa53-40ae-b979-ea1b12283a03', 'bc27b2af-6e99-47e7-a1f3-3463f7477e44'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 21:57:54 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-fc255902-a138-41c5-866e-43a273c5b2f5 tempest-VolumesTransfersV357Test-1472277794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:57:54 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-fc255902-a138-41c5-866e-43a273c5b2f5 tempest-VolumesTransfersV357Test-1472277794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:57:54 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-fc255902-a138-41c5-866e-43a273c5b2f5 tempest-VolumesTransfersV357Test-1472277794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 21:57:54 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-fc255902-a138-41c5-866e-43a273c5b2f5 tempest-VolumesTransfersV357Test-1472277794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 21:57:54 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-fc255902-a138-41c5-866e-43a273c5b2f5 tempest-VolumesTransfersV357Test-1472277794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:57:54 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-fc255902-a138-41c5-866e-43a273c5b2f5 tempest-VolumesTransfersV357Test-1472277794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:57:54 devstack sudo[94832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 21:57:54 devstack sudo[94832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:57:54 devstack sudo[94829]: pam_unix(sudo:session): session closed for user root Sep 17 21:57:54 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-8089675a-9d92-49b7-84b5-f17e93907198 tempest-GroupSnapshotsTest-809568564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b2247e13-fbc9-476e-b9c3-334bff642242.edaecff7-403e-40a3-92c0-8c61e1ad6111" returned: 0 in 0.373s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:57:54 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-8089675a-9d92-49b7-84b5-f17e93907198 tempest-GroupSnapshotsTest-809568564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b2247e13-fbc9-476e-b9c3-334bff642242.edaecff7-403e-40a3-92c0-8c61e1ad6111 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:57:54 devstack sudo[94836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b2247e13-fbc9-476e-b9c3-334bff642242.edaecff7-403e-40a3-92c0-8c61e1ad6111 Sep 17 21:57:54 devstack sudo[94836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:57:55 devstack sudo[94832]: pam_unix(sudo:session): session closed for user root Sep 17 21:57:55 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-fc255902-a138-41c5-866e-43a273c5b2f5 tempest-VolumesTransfersV357Test-1472277794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.304s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:57:55 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-fc255902-a138-41c5-866e-43a273c5b2f5 tempest-VolumesTransfersV357Test-1472277794 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 21:57:55 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-fc255902-a138-41c5-866e-43a273c5b2f5 tempest-VolumesTransfersV357Test-1472277794 None] Deleted volume successfully. Sep 17 21:57:55 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-fc255902-a138-41c5-866e-43a273c5b2f5 tempest-VolumesTransfersV357Test-1472277794 None] Lock "cinder-c639ceee-0d72-4f3c-aa5b-0f2677aaaf78-delete_volume" released by "delete_volume" :: held 1.296s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 21:57:55 devstack sudo[94836]: pam_unix(sudo:session): session closed for user root Sep 17 21:57:55 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-8089675a-9d92-49b7-84b5-f17e93907198 tempest-GroupSnapshotsTest-809568564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b2247e13-fbc9-476e-b9c3-334bff642242.edaecff7-403e-40a3-92c0-8c61e1ad6111" returned: 0 in 0.317s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:57:55 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-8089675a-9d92-49b7-84b5-f17e93907198 tempest-GroupSnapshotsTest-809568564 None] Lock "cinder-quobyte-edaecff7-403e-40a3-92c0-8c61e1ad6111" released by "_delete_snapshot" :: held 1.929s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 21:57:55 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-8089675a-9d92-49b7-84b5-f17e93907198 tempest-GroupSnapshotsTest-809568564 None] Lock "cinder-quobyte-b2247e13-fbc9-476e-b9c3-334bff642242" released by "delete_snapshot" :: held 1.976s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 21:57:55 devstack cinder-volume[85458]: WARNING cinder.quota [None req-8089675a-9d92-49b7-84b5-f17e93907198 tempest-GroupSnapshotsTest-809568564 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1688939785 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1688939785, it is now deprecated. Please use the default quota class for default quota. Sep 17 21:57:55 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-8089675a-9d92-49b7-84b5-f17e93907198 tempest-GroupSnapshotsTest-809568564 None] Created reservations ['cc080ac3-b59f-4c57-854a-b6a277ccd4c7', '3851243c-ee48-41fd-aad6-051ecee9f171', 'e96fc646-e9a4-4bb0-969c-24157a73dc4c', '8684dad8-f46f-47c2-aa0a-acd0bb19d072'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 21:57:55 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-8089675a-9d92-49b7-84b5-f17e93907198 tempest-GroupSnapshotsTest-809568564 None] group_snapshot 716ccf10-9ff7-4906-9ac2-470214b1c7ca: deleted successfully Sep 17 21:57:55 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-521cf590-88d7-4408-a8a1-32fd943885a8 tempest-VolumesTransfersV357Test-701551214 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 21:57:55 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-521cf590-88d7-4408-a8a1-32fd943885a8 tempest-VolumesTransfersV357Test-701551214 None] Flow 'volume_create_manager' (f417e51d-d3c0-40b3-82eb-4b24fb833901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 21:57:55 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-521cf590-88d7-4408-a8a1-32fd943885a8 tempest-VolumesTransfersV357Test-701551214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (328419c3-0ee0-451b-8d3a-779881121edf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:57:55 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-521cf590-88d7-4408-a8a1-32fd943885a8 tempest-VolumesTransfersV357Test-701551214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (328419c3-0ee0-451b-8d3a-779881121edf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T19:57:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-912925314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07d45ff5-322e-4db6-a653-f3cd5d54d948,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8cccd4ae07e44189993f50bfd51ac16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T19:57:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T19:57:56Z,use_quota=True,user_id='daa10de243704722b1fdd78ec89696bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:57:55 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-521cf590-88d7-4408-a8a1-32fd943885a8 tempest-VolumesTransfersV357Test-701551214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (956f1f1d-ae68-4923-b7ef-3f812569ab21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:57:55 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-521cf590-88d7-4408-a8a1-32fd943885a8 tempest-VolumesTransfersV357Test-701551214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (956f1f1d-ae68-4923-b7ef-3f812569ab21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:57:55 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-521cf590-88d7-4408-a8a1-32fd943885a8 tempest-VolumesTransfersV357Test-701551214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ffe4b3e-76fa-4c94-b97b-e86291e14b2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:57:55 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-521cf590-88d7-4408-a8a1-32fd943885a8 tempest-VolumesTransfersV357Test-701551214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ffe4b3e-76fa-4c94-b97b-e86291e14b2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07d45ff5-322e-4db6-a653-f3cd5d54d948', 'volume_name': 'volume-07d45ff5-322e-4db6-a653-f3cd5d54d948', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:57:55 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-521cf590-88d7-4408-a8a1-32fd943885a8 tempest-VolumesTransfersV357Test-701551214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8beecaa-5911-4810-8ce0-6518cdd451e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:57:55 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-521cf590-88d7-4408-a8a1-32fd943885a8 tempest-VolumesTransfersV357Test-701551214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8beecaa-5911-4810-8ce0-6518cdd451e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:57:55 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-521cf590-88d7-4408-a8a1-32fd943885a8 tempest-VolumesTransfersV357Test-701551214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (353c264b-ae4f-4a0d-af0a-75e0d9f2480d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:57:55 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-521cf590-88d7-4408-a8a1-32fd943885a8 tempest-VolumesTransfersV357Test-701551214 None] Volume 07d45ff5-322e-4db6-a653-f3cd5d54d948: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07d45ff5-322e-4db6-a653-f3cd5d54d948', 'volume_size': 1} Sep 17 21:57:55 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-521cf590-88d7-4408-a8a1-32fd943885a8 tempest-VolumesTransfersV357Test-701551214 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:57:55 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-521cf590-88d7-4408-a8a1-32fd943885a8 tempest-VolumesTransfersV357Test-701551214 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:57:55 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-521cf590-88d7-4408-a8a1-32fd943885a8 tempest-VolumesTransfersV357Test-701551214 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T19:57:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-912925314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07d45ff5-322e-4db6-a653-f3cd5d54d948,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8cccd4ae07e44189993f50bfd51ac16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T19:57:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T19:57:56Z,use_quota=True,user_id='daa10de243704722b1fdd78ec89696bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 21:57:55 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-521cf590-88d7-4408-a8a1-32fd943885a8 tempest-VolumesTransfersV357Test-701551214 None] Creating volume 07d45ff5-322e-4db6-a653-f3cd5d54d948 {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 21:57:55 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-521cf590-88d7-4408-a8a1-32fd943885a8 tempest-VolumesTransfersV357Test-701551214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:57:55 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-521cf590-88d7-4408-a8a1-32fd943885a8 tempest-VolumesTransfersV357Test-701551214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:57:55 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-521cf590-88d7-4408-a8a1-32fd943885a8 tempest-VolumesTransfersV357Test-701551214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 21:57:55 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-521cf590-88d7-4408-a8a1-32fd943885a8 tempest-VolumesTransfersV357Test-701551214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 21:57:55 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-521cf590-88d7-4408-a8a1-32fd943885a8 tempest-VolumesTransfersV357Test-701551214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:57:55 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-521cf590-88d7-4408-a8a1-32fd943885a8 tempest-VolumesTransfersV357Test-701551214 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 21:57:55 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-521cf590-88d7-4408-a8a1-32fd943885a8 tempest-VolumesTransfersV357Test-701551214 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 21:57:55 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-521cf590-88d7-4408-a8a1-32fd943885a8 tempest-VolumesTransfersV357Test-701551214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-07d45ff5-322e-4db6-a653-f3cd5d54d948 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:57:55 devstack sudo[94840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-07d45ff5-322e-4db6-a653-f3cd5d54d948 1073741824 Sep 17 21:57:55 devstack sudo[94840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:57:55 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-41618141-7134-4a28-8758-08ecad97770f tempest-GroupSnapshotsTest-809568564 None] Acquiring lock "cinder-quobyte-b2247e13-fbc9-476e-b9c3-334bff642242" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 21:57:55 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-41618141-7134-4a28-8758-08ecad97770f tempest-GroupSnapshotsTest-809568564 None] Lock "cinder-quobyte-b2247e13-fbc9-476e-b9c3-334bff642242" acquired by "delete_volume" :: waited 0.024s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 21:57:55 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccf157e5-a4f1-4ac0-9936-27a326773dae]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 21:57:55 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-41618141-7134-4a28-8758-08ecad97770f tempest-GroupSnapshotsTest-809568564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b2247e13-fbc9-476e-b9c3-334bff642242 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:57:56 devstack sudo[94844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b2247e13-fbc9-476e-b9c3-334bff642242 Sep 17 21:57:56 devstack sudo[94844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:57:56 devstack sudo[94840]: pam_unix(sudo:session): session closed for user root Sep 17 21:57:56 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-521cf590-88d7-4408-a8a1-32fd943885a8 tempest-VolumesTransfersV357Test-701551214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-07d45ff5-322e-4db6-a653-f3cd5d54d948 1073741824" returned: 0 in 0.500s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:57:56 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-521cf590-88d7-4408-a8a1-32fd943885a8 tempest-VolumesTransfersV357Test-701551214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-07d45ff5-322e-4db6-a653-f3cd5d54d948 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:57:56 devstack sudo[94848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-07d45ff5-322e-4db6-a653-f3cd5d54d948 Sep 17 21:57:56 devstack sudo[94848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:57:56 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-77c7271f-9b98-47f7-915a-904874201efd tempest-VolumeQuotasAdminTestJSON-1115500992 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 21:57:56 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-77c7271f-9b98-47f7-915a-904874201efd tempest-VolumeQuotasAdminTestJSON-1115500992 None] Flow 'volume_create_manager' (40cf976e-1514-417b-84d0-a4370f05a28c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 21:57:56 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-77c7271f-9b98-47f7-915a-904874201efd tempest-VolumeQuotasAdminTestJSON-1115500992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc39a2e3-e7d4-44f3-8021-10c4922258c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:57:56 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-77c7271f-9b98-47f7-915a-904874201efd tempest-VolumeQuotasAdminTestJSON-1115500992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc39a2e3-e7d4-44f3-8021-10c4922258c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T19:57:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-565888897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c1517ac-212f-4a51-90a2-743e75fafdc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d3659adcbd54c34bff53d7e59eb9df4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T19:57:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T19:57:56Z,use_quota=True,user_id='8fd8b75633f74c22acdeef601c406665',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:57:56 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-77c7271f-9b98-47f7-915a-904874201efd tempest-VolumeQuotasAdminTestJSON-1115500992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27c1add5-1403-4b44-bb3a-7a61117cd8f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:57:56 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-77c7271f-9b98-47f7-915a-904874201efd tempest-VolumeQuotasAdminTestJSON-1115500992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27c1add5-1403-4b44-bb3a-7a61117cd8f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:57:56 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-77c7271f-9b98-47f7-915a-904874201efd tempest-VolumeQuotasAdminTestJSON-1115500992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae0c85b1-a1d8-4a96-b1f9-79c0465e9028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:57:56 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-77c7271f-9b98-47f7-915a-904874201efd tempest-VolumeQuotasAdminTestJSON-1115500992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae0c85b1-a1d8-4a96-b1f9-79c0465e9028) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c1517ac-212f-4a51-90a2-743e75fafdc7', 'volume_name': 'volume-0c1517ac-212f-4a51-90a2-743e75fafdc7', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:57:56 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-77c7271f-9b98-47f7-915a-904874201efd tempest-VolumeQuotasAdminTestJSON-1115500992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5e9b1ea-7896-49b8-9d5b-c36a4916951a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:57:56 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-77c7271f-9b98-47f7-915a-904874201efd tempest-VolumeQuotasAdminTestJSON-1115500992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5e9b1ea-7896-49b8-9d5b-c36a4916951a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:57:56 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-77c7271f-9b98-47f7-915a-904874201efd tempest-VolumeQuotasAdminTestJSON-1115500992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b6c135e-3742-4e01-95d3-93d51e68393d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:57:56 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-77c7271f-9b98-47f7-915a-904874201efd tempest-VolumeQuotasAdminTestJSON-1115500992 None] Volume 0c1517ac-212f-4a51-90a2-743e75fafdc7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c1517ac-212f-4a51-90a2-743e75fafdc7', 'volume_size': 1} Sep 17 21:57:56 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-77c7271f-9b98-47f7-915a-904874201efd tempest-VolumeQuotasAdminTestJSON-1115500992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:57:56 devstack sudo[94844]: pam_unix(sudo:session): session closed for user root Sep 17 21:57:56 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-41618141-7134-4a28-8758-08ecad97770f tempest-GroupSnapshotsTest-809568564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b2247e13-fbc9-476e-b9c3-334bff642242" returned: 0 in 0.459s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:57:56 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-41618141-7134-4a28-8758-08ecad97770f tempest-GroupSnapshotsTest-809568564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b2247e13-fbc9-476e-b9c3-334bff642242 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:57:56 devstack sudo[94853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b2247e13-fbc9-476e-b9c3-334bff642242 Sep 17 21:57:56 devstack sudo[94853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:57:56 devstack sudo[94848]: pam_unix(sudo:session): session closed for user root Sep 17 21:57:56 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-521cf590-88d7-4408-a8a1-32fd943885a8 tempest-VolumesTransfersV357Test-701551214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-07d45ff5-322e-4db6-a653-f3cd5d54d948" returned: 0 in 0.269s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:57:56 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-521cf590-88d7-4408-a8a1-32fd943885a8 tempest-VolumesTransfersV357Test-701551214 None] <== create_volume: return (831ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 21:57:56 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-521cf590-88d7-4408-a8a1-32fd943885a8 tempest-VolumesTransfersV357Test-701551214 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.834s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:57:56 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-77c7271f-9b98-47f7-915a-904874201efd tempest-VolumeQuotasAdminTestJSON-1115500992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.157s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:57:56 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-77c7271f-9b98-47f7-915a-904874201efd tempest-VolumeQuotasAdminTestJSON-1115500992 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T19:57:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-565888897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c1517ac-212f-4a51-90a2-743e75fafdc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d3659adcbd54c34bff53d7e59eb9df4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T19:57:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T19:57:56Z,use_quota=True,user_id='8fd8b75633f74c22acdeef601c406665',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 21:57:56 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-77c7271f-9b98-47f7-915a-904874201efd tempest-VolumeQuotasAdminTestJSON-1115500992 None] Creating volume 0c1517ac-212f-4a51-90a2-743e75fafdc7 {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 21:57:56 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-77c7271f-9b98-47f7-915a-904874201efd tempest-VolumeQuotasAdminTestJSON-1115500992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:57:56 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-77c7271f-9b98-47f7-915a-904874201efd tempest-VolumeQuotasAdminTestJSON-1115500992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:57:56 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-77c7271f-9b98-47f7-915a-904874201efd tempest-VolumeQuotasAdminTestJSON-1115500992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 21:57:56 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-77c7271f-9b98-47f7-915a-904874201efd tempest-VolumeQuotasAdminTestJSON-1115500992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 21:57:56 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-77c7271f-9b98-47f7-915a-904874201efd tempest-VolumeQuotasAdminTestJSON-1115500992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:57:56 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-77c7271f-9b98-47f7-915a-904874201efd tempest-VolumeQuotasAdminTestJSON-1115500992 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 21:57:56 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-77c7271f-9b98-47f7-915a-904874201efd tempest-VolumeQuotasAdminTestJSON-1115500992 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 21:57:56 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-77c7271f-9b98-47f7-915a-904874201efd tempest-VolumeQuotasAdminTestJSON-1115500992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0c1517ac-212f-4a51-90a2-743e75fafdc7 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:57:56 devstack sudo[94856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0c1517ac-212f-4a51-90a2-743e75fafdc7 1073741824 Sep 17 21:57:56 devstack sudo[94856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:57:56 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-521cf590-88d7-4408-a8a1-32fd943885a8 tempest-VolumesTransfersV357Test-701551214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (353c264b-ae4f-4a0d-af0a-75e0d9f2480d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07d45ff5-322e-4db6-a653-f3cd5d54d948', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:57:56 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-521cf590-88d7-4408-a8a1-32fd943885a8 tempest-VolumesTransfersV357Test-701551214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fe8a81d-9724-4978-86e9-85ee49f75798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:57:56 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-521cf590-88d7-4408-a8a1-32fd943885a8 tempest-VolumesTransfersV357Test-701551214 None] Volume volume-07d45ff5-322e-4db6-a653-f3cd5d54d948 (07d45ff5-322e-4db6-a653-f3cd5d54d948): created successfully Sep 17 21:57:56 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-521cf590-88d7-4408-a8a1-32fd943885a8 tempest-VolumesTransfersV357Test-701551214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fe8a81d-9724-4978-86e9-85ee49f75798) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:57:56 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-521cf590-88d7-4408-a8a1-32fd943885a8 tempest-VolumesTransfersV357Test-701551214 None] Flow 'volume_create_manager' (f417e51d-d3c0-40b3-82eb-4b24fb833901) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 21:57:56 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-521cf590-88d7-4408-a8a1-32fd943885a8 tempest-VolumesTransfersV357Test-701551214 None] Created volume successfully. Sep 17 21:57:56 devstack sudo[94853]: pam_unix(sudo:session): session closed for user root Sep 17 21:57:56 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-41618141-7134-4a28-8758-08ecad97770f tempest-GroupSnapshotsTest-809568564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b2247e13-fbc9-476e-b9c3-334bff642242" returned: 0 in 0.280s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:57:56 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-41618141-7134-4a28-8758-08ecad97770f tempest-GroupSnapshotsTest-809568564 None] Lock "cinder-quobyte-b2247e13-fbc9-476e-b9c3-334bff642242" released by "delete_volume" :: held 0.816s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 21:57:56 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-41618141-7134-4a28-8758-08ecad97770f tempest-GroupSnapshotsTest-809568564 None] Created reservations ['fae7993a-6ef9-4e6d-a8b0-017b23ef3dae'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 21:57:56 devstack cinder-volume[85458]: WARNING cinder.db.api [None req-41618141-7134-4a28-8758-08ecad97770f tempest-GroupSnapshotsTest-809568564 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1688939785'] Sep 17 21:57:56 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-41618141-7134-4a28-8758-08ecad97770f tempest-GroupSnapshotsTest-809568564 None] Created reservations ['9473340b-de4a-4f48-b249-3815e0e10d03', 'dbcd47a1-b29e-46f2-8ff3-47fa63a6470c', '79a01f85-2b4e-4888-b3c0-1624c2823987', 'fdf3ce6b-1d28-4504-900f-9782c079b747'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 21:57:56 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-41618141-7134-4a28-8758-08ecad97770f tempest-GroupSnapshotsTest-809568564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:57:56 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-41618141-7134-4a28-8758-08ecad97770f tempest-GroupSnapshotsTest-809568564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:57:56 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-41618141-7134-4a28-8758-08ecad97770f tempest-GroupSnapshotsTest-809568564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 21:57:56 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-41618141-7134-4a28-8758-08ecad97770f tempest-GroupSnapshotsTest-809568564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 21:57:56 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-41618141-7134-4a28-8758-08ecad97770f tempest-GroupSnapshotsTest-809568564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:57:56 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-41618141-7134-4a28-8758-08ecad97770f tempest-GroupSnapshotsTest-809568564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:57:56 devstack sudo[94862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 21:57:56 devstack sudo[94862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:57:56 devstack sudo[94856]: pam_unix(sudo:session): session closed for user root Sep 17 21:57:56 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-77c7271f-9b98-47f7-915a-904874201efd tempest-VolumeQuotasAdminTestJSON-1115500992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0c1517ac-212f-4a51-90a2-743e75fafdc7 1073741824" returned: 0 in 0.465s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:57:57 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-77c7271f-9b98-47f7-915a-904874201efd tempest-VolumeQuotasAdminTestJSON-1115500992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0c1517ac-212f-4a51-90a2-743e75fafdc7 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:57:57 devstack sudo[94864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0c1517ac-212f-4a51-90a2-743e75fafdc7 Sep 17 21:57:57 devstack sudo[94864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:57:57 devstack sudo[94862]: pam_unix(sudo:session): session closed for user root Sep 17 21:57:57 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-41618141-7134-4a28-8758-08ecad97770f tempest-GroupSnapshotsTest-809568564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.275s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:57:57 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-41618141-7134-4a28-8758-08ecad97770f tempest-GroupSnapshotsTest-809568564 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 21:57:57 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-41618141-7134-4a28-8758-08ecad97770f tempest-GroupSnapshotsTest-809568564 None] Delete group completed successfully. Sep 17 21:57:57 devstack sudo[94864]: pam_unix(sudo:session): session closed for user root Sep 17 21:57:57 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-77c7271f-9b98-47f7-915a-904874201efd tempest-VolumeQuotasAdminTestJSON-1115500992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0c1517ac-212f-4a51-90a2-743e75fafdc7" returned: 0 in 0.295s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:57:57 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-77c7271f-9b98-47f7-915a-904874201efd tempest-VolumeQuotasAdminTestJSON-1115500992 None] <== create_volume: return (807ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 21:57:57 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-77c7271f-9b98-47f7-915a-904874201efd tempest-VolumeQuotasAdminTestJSON-1115500992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.809s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:57:57 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-77c7271f-9b98-47f7-915a-904874201efd tempest-VolumeQuotasAdminTestJSON-1115500992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b6c135e-3742-4e01-95d3-93d51e68393d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c1517ac-212f-4a51-90a2-743e75fafdc7', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:57:57 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-77c7271f-9b98-47f7-915a-904874201efd tempest-VolumeQuotasAdminTestJSON-1115500992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53c9633f-9e75-44c4-89be-f17079874910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:57:57 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-77c7271f-9b98-47f7-915a-904874201efd tempest-VolumeQuotasAdminTestJSON-1115500992 None] Volume volume-0c1517ac-212f-4a51-90a2-743e75fafdc7 (0c1517ac-212f-4a51-90a2-743e75fafdc7): created successfully Sep 17 21:57:57 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-77c7271f-9b98-47f7-915a-904874201efd tempest-VolumeQuotasAdminTestJSON-1115500992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53c9633f-9e75-44c4-89be-f17079874910) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:57:57 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-77c7271f-9b98-47f7-915a-904874201efd tempest-VolumeQuotasAdminTestJSON-1115500992 None] Flow 'volume_create_manager' (40cf976e-1514-417b-84d0-a4370f05a28c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 21:57:57 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-77c7271f-9b98-47f7-915a-904874201efd tempest-VolumeQuotasAdminTestJSON-1115500992 None] Created volume successfully. Sep 17 21:57:57 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-bd8583a5-68be-4424-a631-5d3e644cc00b tempest-GroupSnapshotsTest-809568564 None] Group tempest-GroupSnapshotsTest-Group-429452278: creating Sep 17 21:57:57 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-bd8583a5-68be-4424-a631-5d3e644cc00b tempest-GroupSnapshotsTest-809568564 None] Group tempest-GroupSnapshotsTest-Group-429452278: created successfully Sep 17 21:57:57 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-bd8583a5-68be-4424-a631-5d3e644cc00b tempest-GroupSnapshotsTest-809568564 None] Create group completed successfully. Sep 17 21:57:57 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-c0926991-7dda-426b-bdc8-e5f85bcfdb35 tempest-VolumesTransfersV357Test-1472277794 None] Acquiring lock "cinder-07d45ff5-322e-4db6-a653-f3cd5d54d948-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 21:57:57 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-c0926991-7dda-426b-bdc8-e5f85bcfdb35 tempest-VolumesTransfersV357Test-1472277794 None] Lock "cinder-07d45ff5-322e-4db6-a653-f3cd5d54d948-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 21:57:58 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-c0926991-7dda-426b-bdc8-e5f85bcfdb35 tempest-VolumesTransfersV357Test-1472277794 None] Acquiring lock "cinder-quobyte-07d45ff5-322e-4db6-a653-f3cd5d54d948" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 21:57:58 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-c0926991-7dda-426b-bdc8-e5f85bcfdb35 tempest-VolumesTransfersV357Test-1472277794 None] Lock "cinder-quobyte-07d45ff5-322e-4db6-a653-f3cd5d54d948" acquired by "delete_volume" :: waited 0.019s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 21:57:58 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[35759355-d969-47a5-b3b4-9dcf8eae8843]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 21:57:58 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-c0926991-7dda-426b-bdc8-e5f85bcfdb35 tempest-VolumesTransfersV357Test-1472277794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-07d45ff5-322e-4db6-a653-f3cd5d54d948 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:57:58 devstack sudo[94868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-07d45ff5-322e-4db6-a653-f3cd5d54d948 Sep 17 21:57:58 devstack sudo[94868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:57:58 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-dc63434b-75cb-488b-a810-5d0a57434a6a tempest-VolumeQuotasAdminTestJSON-1115500992 None] Acquiring lock "cinder-0c1517ac-212f-4a51-90a2-743e75fafdc7-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 21:57:58 devstack sudo[94868]: pam_unix(sudo:session): session closed for user root Sep 17 21:57:58 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-c0926991-7dda-426b-bdc8-e5f85bcfdb35 tempest-VolumesTransfersV357Test-1472277794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-07d45ff5-322e-4db6-a653-f3cd5d54d948" returned: 0 in 0.364s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:57:58 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-c0926991-7dda-426b-bdc8-e5f85bcfdb35 tempest-VolumesTransfersV357Test-1472277794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-07d45ff5-322e-4db6-a653-f3cd5d54d948 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:57:58 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-dc63434b-75cb-488b-a810-5d0a57434a6a tempest-VolumeQuotasAdminTestJSON-1115500992 None] Lock "cinder-0c1517ac-212f-4a51-90a2-743e75fafdc7-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 21:57:58 devstack sudo[94873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-07d45ff5-322e-4db6-a653-f3cd5d54d948 Sep 17 21:57:58 devstack sudo[94873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:57:58 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-dc63434b-75cb-488b-a810-5d0a57434a6a tempest-VolumeQuotasAdminTestJSON-1115500992 None] Acquiring lock "cinder-quobyte-0c1517ac-212f-4a51-90a2-743e75fafdc7" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 21:57:58 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-dc63434b-75cb-488b-a810-5d0a57434a6a tempest-VolumeQuotasAdminTestJSON-1115500992 None] Lock "cinder-quobyte-0c1517ac-212f-4a51-90a2-743e75fafdc7" acquired by "delete_volume" :: waited 0.017s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 21:57:58 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[a35c7787-ec80-4a42-a329-432bb2801a11]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 21:57:58 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-dc63434b-75cb-488b-a810-5d0a57434a6a tempest-VolumeQuotasAdminTestJSON-1115500992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0c1517ac-212f-4a51-90a2-743e75fafdc7 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:57:58 devstack sudo[94875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0c1517ac-212f-4a51-90a2-743e75fafdc7 Sep 17 21:57:58 devstack sudo[94875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:57:58 devstack sudo[94873]: pam_unix(sudo:session): session closed for user root Sep 17 21:57:58 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-c0926991-7dda-426b-bdc8-e5f85bcfdb35 tempest-VolumesTransfersV357Test-1472277794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-07d45ff5-322e-4db6-a653-f3cd5d54d948" returned: 0 in 0.318s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:57:58 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-c0926991-7dda-426b-bdc8-e5f85bcfdb35 tempest-VolumesTransfersV357Test-1472277794 None] Lock "cinder-quobyte-07d45ff5-322e-4db6-a653-f3cd5d54d948" released by "delete_volume" :: held 0.736s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 21:57:58 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-c0926991-7dda-426b-bdc8-e5f85bcfdb35 tempest-VolumesTransfersV357Test-1472277794 None] Created reservations ['a72d3452-2b04-4cf9-b100-807adfd5915c', '737b1715-13b7-4853-bb11-fdc67107572d', 'c5ed38e6-83f4-4659-b8d7-829944c00e33', '3ccb9c6a-48e8-49fe-85d2-ae0c623ef530'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 21:57:58 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-c0926991-7dda-426b-bdc8-e5f85bcfdb35 tempest-VolumesTransfersV357Test-1472277794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:57:58 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-c0926991-7dda-426b-bdc8-e5f85bcfdb35 tempest-VolumesTransfersV357Test-1472277794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:57:58 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-c0926991-7dda-426b-bdc8-e5f85bcfdb35 tempest-VolumesTransfersV357Test-1472277794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 21:57:58 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-c0926991-7dda-426b-bdc8-e5f85bcfdb35 tempest-VolumesTransfersV357Test-1472277794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 21:57:58 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-c0926991-7dda-426b-bdc8-e5f85bcfdb35 tempest-VolumesTransfersV357Test-1472277794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:57:58 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-c0926991-7dda-426b-bdc8-e5f85bcfdb35 tempest-VolumesTransfersV357Test-1472277794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:57:58 devstack sudo[94875]: pam_unix(sudo:session): session closed for user root Sep 17 21:57:58 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-dc63434b-75cb-488b-a810-5d0a57434a6a tempest-VolumeQuotasAdminTestJSON-1115500992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0c1517ac-212f-4a51-90a2-743e75fafdc7" returned: 0 in 0.425s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:57:58 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-dc63434b-75cb-488b-a810-5d0a57434a6a tempest-VolumeQuotasAdminTestJSON-1115500992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0c1517ac-212f-4a51-90a2-743e75fafdc7 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:57:58 devstack sudo[94883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 21:57:58 devstack sudo[94883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:57:59 devstack sudo[94885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0c1517ac-212f-4a51-90a2-743e75fafdc7 Sep 17 21:57:59 devstack sudo[94885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:57:59 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ff393c4-bc39-4ff0-ae50-80693553a33a tempest-GroupSnapshotsTest-809568564 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 21:57:59 devstack sudo[94883]: pam_unix(sudo:session): session closed for user root Sep 17 21:57:59 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-6ff393c4-bc39-4ff0-ae50-80693553a33a tempest-GroupSnapshotsTest-809568564 None] Flow 'volume_create_manager' (8c0aa779-9c67-4bd5-acf5-4e73349eda49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 21:57:59 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-6ff393c4-bc39-4ff0-ae50-80693553a33a tempest-GroupSnapshotsTest-809568564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5caebaf7-30e3-4f23-9451-500daeb4186e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:57:59 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-c0926991-7dda-426b-bdc8-e5f85bcfdb35 tempest-VolumesTransfersV357Test-1472277794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.337s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:57:59 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-c0926991-7dda-426b-bdc8-e5f85bcfdb35 tempest-VolumesTransfersV357Test-1472277794 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 21:57:59 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-c0926991-7dda-426b-bdc8-e5f85bcfdb35 tempest-VolumesTransfersV357Test-1472277794 None] Deleted volume successfully. Sep 17 21:57:59 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-6ff393c4-bc39-4ff0-ae50-80693553a33a tempest-GroupSnapshotsTest-809568564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5caebaf7-30e3-4f23-9451-500daeb4186e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T19:57:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-116964318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8a85c593-76b0-43a9-ae77-aed9fd596e81,host='devstack@QuobyteHD#QuobyteHD',id=c8dce848-37aa-44b4-813f-3478957d1f34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5addd66fbea4ce983d8868233d58dd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T19:57:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T19:57:59Z,use_quota=True,user_id='32ad7a4fdca249cdb7b4968da545adc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f65da70-0f8f-49a9-9a7f-749278a20418),volume_type_id=2f65da70-0f8f-49a9-9a7f-749278a20418)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:57:59 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-6ff393c4-bc39-4ff0-ae50-80693553a33a tempest-GroupSnapshotsTest-809568564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4bebe21-39b0-4f2d-ab3c-596a7c563b2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:57:59 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-6ff393c4-bc39-4ff0-ae50-80693553a33a tempest-GroupSnapshotsTest-809568564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4bebe21-39b0-4f2d-ab3c-596a7c563b2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:57:59 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-6ff393c4-bc39-4ff0-ae50-80693553a33a tempest-GroupSnapshotsTest-809568564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33ab2824-d776-4dac-a427-6972d975a50d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:57:59 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-6ff393c4-bc39-4ff0-ae50-80693553a33a tempest-GroupSnapshotsTest-809568564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33ab2824-d776-4dac-a427-6972d975a50d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8dce848-37aa-44b4-813f-3478957d1f34', 'volume_name': 'volume-c8dce848-37aa-44b4-813f-3478957d1f34', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:57:59 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-6ff393c4-bc39-4ff0-ae50-80693553a33a tempest-GroupSnapshotsTest-809568564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f31427ee-a523-4c1b-ad70-e160708a5ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:57:59 devstack sudo[94885]: pam_unix(sudo:session): session closed for user root Sep 17 21:57:59 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-6ff393c4-bc39-4ff0-ae50-80693553a33a tempest-GroupSnapshotsTest-809568564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f31427ee-a523-4c1b-ad70-e160708a5ce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:57:59 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-6ff393c4-bc39-4ff0-ae50-80693553a33a tempest-GroupSnapshotsTest-809568564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60e53cb5-7ae5-4d36-baa3-bccecb923e7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:57:59 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-6ff393c4-bc39-4ff0-ae50-80693553a33a tempest-GroupSnapshotsTest-809568564 None] Volume c8dce848-37aa-44b4-813f-3478957d1f34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8dce848-37aa-44b4-813f-3478957d1f34', 'volume_size': 1} Sep 17 21:57:59 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-6ff393c4-bc39-4ff0-ae50-80693553a33a tempest-GroupSnapshotsTest-809568564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:57:59 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-6ff393c4-bc39-4ff0-ae50-80693553a33a tempest-GroupSnapshotsTest-809568564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:57:59 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-6ff393c4-bc39-4ff0-ae50-80693553a33a tempest-GroupSnapshotsTest-809568564 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8a85c593-76b0-43a9-ae77-aed9fd596e81,created_at=2026-09-17T19:57:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-116964318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8a85c593-76b0-43a9-ae77-aed9fd596e81,host='devstack@QuobyteHD#QuobyteHD',id=c8dce848-37aa-44b4-813f-3478957d1f34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5addd66fbea4ce983d8868233d58dd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T19:57:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T19:57:59Z,use_quota=True,user_id='32ad7a4fdca249cdb7b4968da545adc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f65da70-0f8f-49a9-9a7f-749278a20418),volume_type_id=2f65da70-0f8f-49a9-9a7f-749278a20418)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 21:57:59 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-6ff393c4-bc39-4ff0-ae50-80693553a33a tempest-GroupSnapshotsTest-809568564 None] Creating volume c8dce848-37aa-44b4-813f-3478957d1f34 {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 21:57:59 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-6ff393c4-bc39-4ff0-ae50-80693553a33a tempest-GroupSnapshotsTest-809568564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:57:59 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-6ff393c4-bc39-4ff0-ae50-80693553a33a tempest-GroupSnapshotsTest-809568564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:57:59 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-6ff393c4-bc39-4ff0-ae50-80693553a33a tempest-GroupSnapshotsTest-809568564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 21:57:59 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-6ff393c4-bc39-4ff0-ae50-80693553a33a tempest-GroupSnapshotsTest-809568564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 21:57:59 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-6ff393c4-bc39-4ff0-ae50-80693553a33a tempest-GroupSnapshotsTest-809568564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:57:59 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-6ff393c4-bc39-4ff0-ae50-80693553a33a tempest-GroupSnapshotsTest-809568564 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 21:57:59 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-6ff393c4-bc39-4ff0-ae50-80693553a33a tempest-GroupSnapshotsTest-809568564 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 21:57:59 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-6ff393c4-bc39-4ff0-ae50-80693553a33a tempest-GroupSnapshotsTest-809568564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c8dce848-37aa-44b4-813f-3478957d1f34 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:57:59 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-dc63434b-75cb-488b-a810-5d0a57434a6a tempest-VolumeQuotasAdminTestJSON-1115500992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0c1517ac-212f-4a51-90a2-743e75fafdc7" returned: 0 in 0.398s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:57:59 devstack sudo[94889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c8dce848-37aa-44b4-813f-3478957d1f34 1073741824 Sep 17 21:57:59 devstack sudo[94889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:57:59 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-dc63434b-75cb-488b-a810-5d0a57434a6a tempest-VolumeQuotasAdminTestJSON-1115500992 None] Lock "cinder-quobyte-0c1517ac-212f-4a51-90a2-743e75fafdc7" released by "delete_volume" :: held 0.893s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 21:57:59 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-c0926991-7dda-426b-bdc8-e5f85bcfdb35 tempest-VolumesTransfersV357Test-1472277794 None] Lock "cinder-07d45ff5-322e-4db6-a653-f3cd5d54d948-delete_volume" released by "delete_volume" :: held 1.417s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 21:57:59 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-dc63434b-75cb-488b-a810-5d0a57434a6a tempest-VolumeQuotasAdminTestJSON-1115500992 None] Created reservations ['7ac45e4d-c7f6-4a3c-bf8c-8288b17dd7a4', '4b97a64b-762d-4832-b0ee-4a7c099a605d', '3481225d-0030-4710-9f8b-c4c4ed07329c', '94bda3c1-878b-480c-9161-84876eb7e5bc'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 21:57:59 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-dc63434b-75cb-488b-a810-5d0a57434a6a tempest-VolumeQuotasAdminTestJSON-1115500992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:57:59 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-dc63434b-75cb-488b-a810-5d0a57434a6a tempest-VolumeQuotasAdminTestJSON-1115500992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:57:59 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-dc63434b-75cb-488b-a810-5d0a57434a6a tempest-VolumeQuotasAdminTestJSON-1115500992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 21:57:59 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-dc63434b-75cb-488b-a810-5d0a57434a6a tempest-VolumeQuotasAdminTestJSON-1115500992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 21:57:59 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-dc63434b-75cb-488b-a810-5d0a57434a6a tempest-VolumeQuotasAdminTestJSON-1115500992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:57:59 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-dc63434b-75cb-488b-a810-5d0a57434a6a tempest-VolumeQuotasAdminTestJSON-1115500992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:57:59 devstack sudo[94891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 21:57:59 devstack sudo[94891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:57:59 devstack sudo[94891]: pam_unix(sudo:session): session closed for user root Sep 17 21:57:59 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-dc63434b-75cb-488b-a810-5d0a57434a6a tempest-VolumeQuotasAdminTestJSON-1115500992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.334s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:57:59 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-dc63434b-75cb-488b-a810-5d0a57434a6a tempest-VolumeQuotasAdminTestJSON-1115500992 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 21:57:59 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-dc63434b-75cb-488b-a810-5d0a57434a6a tempest-VolumeQuotasAdminTestJSON-1115500992 None] Deleted volume successfully. Sep 17 21:57:59 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-dc63434b-75cb-488b-a810-5d0a57434a6a tempest-VolumeQuotasAdminTestJSON-1115500992 None] Lock "cinder-0c1517ac-212f-4a51-90a2-743e75fafdc7-delete_volume" released by "delete_volume" :: held 1.462s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 21:57:59 devstack sudo[94889]: pam_unix(sudo:session): session closed for user root Sep 17 21:57:59 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-6ff393c4-bc39-4ff0-ae50-80693553a33a tempest-GroupSnapshotsTest-809568564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c8dce848-37aa-44b4-813f-3478957d1f34 1073741824" returned: 0 in 0.629s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:58:00 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-6ff393c4-bc39-4ff0-ae50-80693553a33a tempest-GroupSnapshotsTest-809568564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c8dce848-37aa-44b4-813f-3478957d1f34 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:58:00 devstack sudo[94898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c8dce848-37aa-44b4-813f-3478957d1f34 Sep 17 21:58:00 devstack sudo[94898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:58:00 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-a239b3ee-daaa-4bc7-9ab1-9b6d38d0600a tempest-VolumeQuotasAdminTestJSON-1115500992 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 21:58:00 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-a239b3ee-daaa-4bc7-9ab1-9b6d38d0600a tempest-VolumeQuotasAdminTestJSON-1115500992 None] Flow 'volume_create_manager' (d1e99c64-5311-44da-80a9-938e959b0042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 21:58:00 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-a239b3ee-daaa-4bc7-9ab1-9b6d38d0600a tempest-VolumeQuotasAdminTestJSON-1115500992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12aef4ce-e48f-4f97-843a-b798dab09327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:58:00 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-a239b3ee-daaa-4bc7-9ab1-9b6d38d0600a tempest-VolumeQuotasAdminTestJSON-1115500992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12aef4ce-e48f-4f97-843a-b798dab09327) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T19:58:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-511756962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3298793-b88e-4910-a217-eacee151983e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d3659adcbd54c34bff53d7e59eb9df4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T19:58:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T19:58:00Z,use_quota=True,user_id='8fd8b75633f74c22acdeef601c406665',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:58:00 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-a239b3ee-daaa-4bc7-9ab1-9b6d38d0600a tempest-VolumeQuotasAdminTestJSON-1115500992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07eb4320-34ad-4663-a337-d0a60b2ab2b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:58:00 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-a239b3ee-daaa-4bc7-9ab1-9b6d38d0600a tempest-VolumeQuotasAdminTestJSON-1115500992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07eb4320-34ad-4663-a337-d0a60b2ab2b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:58:00 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-a239b3ee-daaa-4bc7-9ab1-9b6d38d0600a tempest-VolumeQuotasAdminTestJSON-1115500992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b38797c2-53ff-4ecc-94c7-697aebc61d90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:58:00 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-a239b3ee-daaa-4bc7-9ab1-9b6d38d0600a tempest-VolumeQuotasAdminTestJSON-1115500992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b38797c2-53ff-4ecc-94c7-697aebc61d90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3298793-b88e-4910-a217-eacee151983e', 'volume_name': 'volume-d3298793-b88e-4910-a217-eacee151983e', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:58:00 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-a239b3ee-daaa-4bc7-9ab1-9b6d38d0600a tempest-VolumeQuotasAdminTestJSON-1115500992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62859e13-9eb0-4410-beee-24ad3e157f94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:58:00 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-a239b3ee-daaa-4bc7-9ab1-9b6d38d0600a tempest-VolumeQuotasAdminTestJSON-1115500992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62859e13-9eb0-4410-beee-24ad3e157f94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:58:00 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-a239b3ee-daaa-4bc7-9ab1-9b6d38d0600a tempest-VolumeQuotasAdminTestJSON-1115500992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce680908-1765-4463-9f1d-350f9f6a7298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:58:00 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-a239b3ee-daaa-4bc7-9ab1-9b6d38d0600a tempest-VolumeQuotasAdminTestJSON-1115500992 None] Volume d3298793-b88e-4910-a217-eacee151983e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3298793-b88e-4910-a217-eacee151983e', 'volume_size': 1} Sep 17 21:58:00 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-a239b3ee-daaa-4bc7-9ab1-9b6d38d0600a tempest-VolumeQuotasAdminTestJSON-1115500992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:58:00 devstack sudo[94898]: pam_unix(sudo:session): session closed for user root Sep 17 21:58:00 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-6ff393c4-bc39-4ff0-ae50-80693553a33a tempest-GroupSnapshotsTest-809568564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c8dce848-37aa-44b4-813f-3478957d1f34" returned: 0 in 0.352s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:58:00 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-6ff393c4-bc39-4ff0-ae50-80693553a33a tempest-GroupSnapshotsTest-809568564 None] <== create_volume: return (1038ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 21:58:00 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-6ff393c4-bc39-4ff0-ae50-80693553a33a tempest-GroupSnapshotsTest-809568564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.040s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:58:00 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-a239b3ee-daaa-4bc7-9ab1-9b6d38d0600a tempest-VolumeQuotasAdminTestJSON-1115500992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.063s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:58:00 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-a239b3ee-daaa-4bc7-9ab1-9b6d38d0600a tempest-VolumeQuotasAdminTestJSON-1115500992 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T19:58:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-511756962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3298793-b88e-4910-a217-eacee151983e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d3659adcbd54c34bff53d7e59eb9df4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T19:58:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T19:58:00Z,use_quota=True,user_id='8fd8b75633f74c22acdeef601c406665',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 21:58:00 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-a239b3ee-daaa-4bc7-9ab1-9b6d38d0600a tempest-VolumeQuotasAdminTestJSON-1115500992 None] Creating volume d3298793-b88e-4910-a217-eacee151983e {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 21:58:00 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-a239b3ee-daaa-4bc7-9ab1-9b6d38d0600a tempest-VolumeQuotasAdminTestJSON-1115500992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:58:00 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-a239b3ee-daaa-4bc7-9ab1-9b6d38d0600a tempest-VolumeQuotasAdminTestJSON-1115500992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:58:00 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-a239b3ee-daaa-4bc7-9ab1-9b6d38d0600a tempest-VolumeQuotasAdminTestJSON-1115500992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 21:58:00 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-a239b3ee-daaa-4bc7-9ab1-9b6d38d0600a tempest-VolumeQuotasAdminTestJSON-1115500992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 21:58:00 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-a239b3ee-daaa-4bc7-9ab1-9b6d38d0600a tempest-VolumeQuotasAdminTestJSON-1115500992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:58:00 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-a239b3ee-daaa-4bc7-9ab1-9b6d38d0600a tempest-VolumeQuotasAdminTestJSON-1115500992 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 21:58:00 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-a239b3ee-daaa-4bc7-9ab1-9b6d38d0600a tempest-VolumeQuotasAdminTestJSON-1115500992 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 21:58:00 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a239b3ee-daaa-4bc7-9ab1-9b6d38d0600a tempest-VolumeQuotasAdminTestJSON-1115500992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-d3298793-b88e-4910-a217-eacee151983e 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:58:00 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-6ff393c4-bc39-4ff0-ae50-80693553a33a tempest-GroupSnapshotsTest-809568564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60e53cb5-7ae5-4d36-baa3-bccecb923e7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8dce848-37aa-44b4-813f-3478957d1f34', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:58:00 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-6ff393c4-bc39-4ff0-ae50-80693553a33a tempest-GroupSnapshotsTest-809568564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bdc064e-528e-4e18-a202-cb92ed760209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:58:00 devstack sudo[94901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-d3298793-b88e-4910-a217-eacee151983e 1073741824 Sep 17 21:58:00 devstack sudo[94901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:58:00 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-6ff393c4-bc39-4ff0-ae50-80693553a33a tempest-GroupSnapshotsTest-809568564 None] Volume volume-c8dce848-37aa-44b4-813f-3478957d1f34 (c8dce848-37aa-44b4-813f-3478957d1f34): created successfully Sep 17 21:58:00 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-6ff393c4-bc39-4ff0-ae50-80693553a33a tempest-GroupSnapshotsTest-809568564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bdc064e-528e-4e18-a202-cb92ed760209) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:58:00 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-6ff393c4-bc39-4ff0-ae50-80693553a33a tempest-GroupSnapshotsTest-809568564 None] Flow 'volume_create_manager' (8c0aa779-9c67-4bd5-acf5-4e73349eda49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 21:58:00 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-6ff393c4-bc39-4ff0-ae50-80693553a33a tempest-GroupSnapshotsTest-809568564 None] Created volume successfully. Sep 17 21:58:00 devstack sudo[94901]: pam_unix(sudo:session): session closed for user root Sep 17 21:58:00 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a239b3ee-daaa-4bc7-9ab1-9b6d38d0600a tempest-VolumeQuotasAdminTestJSON-1115500992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-d3298793-b88e-4910-a217-eacee151983e 1073741824" returned: 0 in 0.603s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:58:01 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a239b3ee-daaa-4bc7-9ab1-9b6d38d0600a tempest-VolumeQuotasAdminTestJSON-1115500992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-d3298793-b88e-4910-a217-eacee151983e {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:58:01 devstack sudo[94907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-d3298793-b88e-4910-a217-eacee151983e Sep 17 21:58:01 devstack sudo[94907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:58:01 devstack sudo[94907]: pam_unix(sudo:session): session closed for user root Sep 17 21:58:01 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a239b3ee-daaa-4bc7-9ab1-9b6d38d0600a tempest-VolumeQuotasAdminTestJSON-1115500992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-d3298793-b88e-4910-a217-eacee151983e" returned: 0 in 0.288s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:58:01 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-a239b3ee-daaa-4bc7-9ab1-9b6d38d0600a tempest-VolumeQuotasAdminTestJSON-1115500992 None] <== create_volume: return (944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 21:58:01 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-a239b3ee-daaa-4bc7-9ab1-9b6d38d0600a tempest-VolumeQuotasAdminTestJSON-1115500992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:58:01 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-a239b3ee-daaa-4bc7-9ab1-9b6d38d0600a tempest-VolumeQuotasAdminTestJSON-1115500992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce680908-1765-4463-9f1d-350f9f6a7298) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3298793-b88e-4910-a217-eacee151983e', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:58:01 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-a239b3ee-daaa-4bc7-9ab1-9b6d38d0600a tempest-VolumeQuotasAdminTestJSON-1115500992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0c21b0a-2a59-4fbc-bc31-78aa182f35a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:58:01 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-a239b3ee-daaa-4bc7-9ab1-9b6d38d0600a tempest-VolumeQuotasAdminTestJSON-1115500992 None] Volume volume-d3298793-b88e-4910-a217-eacee151983e (d3298793-b88e-4910-a217-eacee151983e): created successfully Sep 17 21:58:01 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-a239b3ee-daaa-4bc7-9ab1-9b6d38d0600a tempest-VolumeQuotasAdminTestJSON-1115500992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0c21b0a-2a59-4fbc-bc31-78aa182f35a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:58:01 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-a239b3ee-daaa-4bc7-9ab1-9b6d38d0600a tempest-VolumeQuotasAdminTestJSON-1115500992 None] Flow 'volume_create_manager' (d1e99c64-5311-44da-80a9-938e959b0042) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 21:58:01 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-a239b3ee-daaa-4bc7-9ab1-9b6d38d0600a tempest-VolumeQuotasAdminTestJSON-1115500992 None] Created volume successfully. Sep 17 21:58:02 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-3588d2bc-daac-4f76-8f0e-128e7140a3d3 tempest-GroupSnapshotsTest-809568564 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 21:58:02 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-3588d2bc-daac-4f76-8f0e-128e7140a3d3 tempest-GroupSnapshotsTest-809568564 None] Flow 'volume_create_manager' (15ad8e00-bb32-43fc-aebb-246b622b0202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 21:58:02 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-3588d2bc-daac-4f76-8f0e-128e7140a3d3 tempest-GroupSnapshotsTest-809568564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0ad286a-cf2d-4c56-bf13-b310dd74ecc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:58:02 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-3588d2bc-daac-4f76-8f0e-128e7140a3d3 tempest-GroupSnapshotsTest-809568564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0ad286a-cf2d-4c56-bf13-b310dd74ecc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T19:58:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-636720374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8a85c593-76b0-43a9-ae77-aed9fd596e81,host='devstack@QuobyteHD#QuobyteHD',id=e19dcfe4-39f2-45a4-a0f1-da9d01ca6521,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5addd66fbea4ce983d8868233d58dd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T19:58:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T19:58:02Z,use_quota=True,user_id='32ad7a4fdca249cdb7b4968da545adc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f65da70-0f8f-49a9-9a7f-749278a20418),volume_type_id=2f65da70-0f8f-49a9-9a7f-749278a20418)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:58:02 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-3588d2bc-daac-4f76-8f0e-128e7140a3d3 tempest-GroupSnapshotsTest-809568564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f02f074-13cd-4f8e-b172-217aa5b5b28c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:58:02 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-3588d2bc-daac-4f76-8f0e-128e7140a3d3 tempest-GroupSnapshotsTest-809568564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f02f074-13cd-4f8e-b172-217aa5b5b28c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:58:02 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-3588d2bc-daac-4f76-8f0e-128e7140a3d3 tempest-GroupSnapshotsTest-809568564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be40bd56-b136-4e91-9b85-d884da3f3c8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:58:02 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-3588d2bc-daac-4f76-8f0e-128e7140a3d3 tempest-GroupSnapshotsTest-809568564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be40bd56-b136-4e91-9b85-d884da3f3c8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e19dcfe4-39f2-45a4-a0f1-da9d01ca6521', 'volume_name': 'volume-e19dcfe4-39f2-45a4-a0f1-da9d01ca6521', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:58:02 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-3588d2bc-daac-4f76-8f0e-128e7140a3d3 tempest-GroupSnapshotsTest-809568564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae08fca9-c11b-4255-8c01-67a15baeb068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:58:02 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-3588d2bc-daac-4f76-8f0e-128e7140a3d3 tempest-GroupSnapshotsTest-809568564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae08fca9-c11b-4255-8c01-67a15baeb068) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:58:02 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-3588d2bc-daac-4f76-8f0e-128e7140a3d3 tempest-GroupSnapshotsTest-809568564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1c33228-98b7-4b63-8dbc-d74421b54511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:58:02 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-3588d2bc-daac-4f76-8f0e-128e7140a3d3 tempest-GroupSnapshotsTest-809568564 None] Volume e19dcfe4-39f2-45a4-a0f1-da9d01ca6521: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e19dcfe4-39f2-45a4-a0f1-da9d01ca6521', 'volume_size': 1} Sep 17 21:58:02 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-3588d2bc-daac-4f76-8f0e-128e7140a3d3 tempest-GroupSnapshotsTest-809568564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:58:02 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-3588d2bc-daac-4f76-8f0e-128e7140a3d3 tempest-GroupSnapshotsTest-809568564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:58:02 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-3588d2bc-daac-4f76-8f0e-128e7140a3d3 tempest-GroupSnapshotsTest-809568564 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8a85c593-76b0-43a9-ae77-aed9fd596e81,created_at=2026-09-17T19:58:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-636720374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8a85c593-76b0-43a9-ae77-aed9fd596e81,host='devstack@QuobyteHD#QuobyteHD',id=e19dcfe4-39f2-45a4-a0f1-da9d01ca6521,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5addd66fbea4ce983d8868233d58dd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T19:58:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T19:58:02Z,use_quota=True,user_id='32ad7a4fdca249cdb7b4968da545adc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f65da70-0f8f-49a9-9a7f-749278a20418),volume_type_id=2f65da70-0f8f-49a9-9a7f-749278a20418)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 21:58:02 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-3588d2bc-daac-4f76-8f0e-128e7140a3d3 tempest-GroupSnapshotsTest-809568564 None] Creating volume e19dcfe4-39f2-45a4-a0f1-da9d01ca6521 {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 21:58:02 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-3588d2bc-daac-4f76-8f0e-128e7140a3d3 tempest-GroupSnapshotsTest-809568564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:58:02 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-3588d2bc-daac-4f76-8f0e-128e7140a3d3 tempest-GroupSnapshotsTest-809568564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:58:02 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-3588d2bc-daac-4f76-8f0e-128e7140a3d3 tempest-GroupSnapshotsTest-809568564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 21:58:02 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-3588d2bc-daac-4f76-8f0e-128e7140a3d3 tempest-GroupSnapshotsTest-809568564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 21:58:02 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-3588d2bc-daac-4f76-8f0e-128e7140a3d3 tempest-GroupSnapshotsTest-809568564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:58:02 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-3588d2bc-daac-4f76-8f0e-128e7140a3d3 tempest-GroupSnapshotsTest-809568564 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 21:58:02 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-3588d2bc-daac-4f76-8f0e-128e7140a3d3 tempest-GroupSnapshotsTest-809568564 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 21:58:02 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-3588d2bc-daac-4f76-8f0e-128e7140a3d3 tempest-GroupSnapshotsTest-809568564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e19dcfe4-39f2-45a4-a0f1-da9d01ca6521 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:58:02 devstack sudo[94910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e19dcfe4-39f2-45a4-a0f1-da9d01ca6521 1073741824 Sep 17 21:58:02 devstack sudo[94910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:58:02 devstack sudo[94910]: pam_unix(sudo:session): session closed for user root Sep 17 21:58:02 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-3588d2bc-daac-4f76-8f0e-128e7140a3d3 tempest-GroupSnapshotsTest-809568564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e19dcfe4-39f2-45a4-a0f1-da9d01ca6521 1073741824" returned: 0 in 0.533s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:58:03 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-3588d2bc-daac-4f76-8f0e-128e7140a3d3 tempest-GroupSnapshotsTest-809568564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e19dcfe4-39f2-45a4-a0f1-da9d01ca6521 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:58:03 devstack sudo[94916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e19dcfe4-39f2-45a4-a0f1-da9d01ca6521 Sep 17 21:58:03 devstack sudo[94916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:58:03 devstack sudo[94916]: pam_unix(sudo:session): session closed for user root Sep 17 21:58:03 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-3588d2bc-daac-4f76-8f0e-128e7140a3d3 tempest-GroupSnapshotsTest-809568564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e19dcfe4-39f2-45a4-a0f1-da9d01ca6521" returned: 0 in 0.273s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:58:03 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-3588d2bc-daac-4f76-8f0e-128e7140a3d3 tempest-GroupSnapshotsTest-809568564 None] <== create_volume: return (869ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 21:58:03 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-3588d2bc-daac-4f76-8f0e-128e7140a3d3 tempest-GroupSnapshotsTest-809568564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.872s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:58:03 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-3588d2bc-daac-4f76-8f0e-128e7140a3d3 tempest-GroupSnapshotsTest-809568564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1c33228-98b7-4b63-8dbc-d74421b54511) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e19dcfe4-39f2-45a4-a0f1-da9d01ca6521', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:58:03 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-3588d2bc-daac-4f76-8f0e-128e7140a3d3 tempest-GroupSnapshotsTest-809568564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (591c08ae-6f98-4706-b34c-7658151a896e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:58:03 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-89f4e98d-26a7-4eac-911c-138f7b32cd16 tempest-VolumeQuotasAdminTestJSON-1082786295 None] Transfer volume completed successfully. Sep 17 21:58:03 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-3588d2bc-daac-4f76-8f0e-128e7140a3d3 tempest-GroupSnapshotsTest-809568564 None] Volume volume-e19dcfe4-39f2-45a4-a0f1-da9d01ca6521 (e19dcfe4-39f2-45a4-a0f1-da9d01ca6521): created successfully Sep 17 21:58:03 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-3588d2bc-daac-4f76-8f0e-128e7140a3d3 tempest-GroupSnapshotsTest-809568564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (591c08ae-6f98-4706-b34c-7658151a896e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:58:03 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-3588d2bc-daac-4f76-8f0e-128e7140a3d3 tempest-GroupSnapshotsTest-809568564 None] Flow 'volume_create_manager' (15ad8e00-bb32-43fc-aebb-246b622b0202) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 21:58:03 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-3588d2bc-daac-4f76-8f0e-128e7140a3d3 tempest-GroupSnapshotsTest-809568564 None] Created volume successfully. Sep 17 21:58:03 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-6c2f3dd8-2cb5-4ad1-b7b9-fbf367805788 tempest-VolumeQuotasAdminTestJSON-1965131442 None] Acquiring lock "cinder-d3298793-b88e-4910-a217-eacee151983e-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 21:58:03 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-6c2f3dd8-2cb5-4ad1-b7b9-fbf367805788 tempest-VolumeQuotasAdminTestJSON-1965131442 None] Lock "cinder-d3298793-b88e-4910-a217-eacee151983e-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 21:58:03 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-6c2f3dd8-2cb5-4ad1-b7b9-fbf367805788 tempest-VolumeQuotasAdminTestJSON-1965131442 None] Acquiring lock "cinder-quobyte-d3298793-b88e-4910-a217-eacee151983e" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 21:58:03 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-6c2f3dd8-2cb5-4ad1-b7b9-fbf367805788 tempest-VolumeQuotasAdminTestJSON-1965131442 None] Lock "cinder-quobyte-d3298793-b88e-4910-a217-eacee151983e" acquired by "delete_volume" :: waited 0.018s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 21:58:03 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d3c4153-499f-4a5d-b3a6-ee9cfee1fac0]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 21:58:03 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-6c2f3dd8-2cb5-4ad1-b7b9-fbf367805788 tempest-VolumeQuotasAdminTestJSON-1965131442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-d3298793-b88e-4910-a217-eacee151983e {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:58:04 devstack sudo[94919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-d3298793-b88e-4910-a217-eacee151983e Sep 17 21:58:04 devstack sudo[94919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:58:04 devstack sudo[94919]: pam_unix(sudo:session): session closed for user root Sep 17 21:58:04 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-6c2f3dd8-2cb5-4ad1-b7b9-fbf367805788 tempest-VolumeQuotasAdminTestJSON-1965131442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-d3298793-b88e-4910-a217-eacee151983e" returned: 0 in 0.372s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:58:04 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-6c2f3dd8-2cb5-4ad1-b7b9-fbf367805788 tempest-VolumeQuotasAdminTestJSON-1965131442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-d3298793-b88e-4910-a217-eacee151983e {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:58:04 devstack sudo[94924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-d3298793-b88e-4910-a217-eacee151983e Sep 17 21:58:04 devstack sudo[94924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:58:04 devstack sudo[94924]: pam_unix(sudo:session): session closed for user root Sep 17 21:58:04 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-6c2f3dd8-2cb5-4ad1-b7b9-fbf367805788 tempest-VolumeQuotasAdminTestJSON-1965131442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-d3298793-b88e-4910-a217-eacee151983e" returned: 0 in 0.256s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:58:04 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-6c2f3dd8-2cb5-4ad1-b7b9-fbf367805788 tempest-VolumeQuotasAdminTestJSON-1965131442 None] Lock "cinder-quobyte-d3298793-b88e-4910-a217-eacee151983e" released by "delete_volume" :: held 0.681s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 21:58:04 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-6c2f3dd8-2cb5-4ad1-b7b9-fbf367805788 tempest-VolumeQuotasAdminTestJSON-1965131442 None] Created reservations ['01b1547d-2022-43e2-be04-8f151bd347d7', '2d097cd4-bcb9-4959-9be4-ae4354c045a3', '63d63596-b49d-41a4-a5b6-3659b1b8ae2e', '2ff6e5cb-3c2c-468c-b613-33ffc951573b'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 21:58:04 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-6c2f3dd8-2cb5-4ad1-b7b9-fbf367805788 tempest-VolumeQuotasAdminTestJSON-1965131442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:58:04 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-6c2f3dd8-2cb5-4ad1-b7b9-fbf367805788 tempest-VolumeQuotasAdminTestJSON-1965131442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:58:04 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-6c2f3dd8-2cb5-4ad1-b7b9-fbf367805788 tempest-VolumeQuotasAdminTestJSON-1965131442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 21:58:04 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-6c2f3dd8-2cb5-4ad1-b7b9-fbf367805788 tempest-VolumeQuotasAdminTestJSON-1965131442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 21:58:04 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-6c2f3dd8-2cb5-4ad1-b7b9-fbf367805788 tempest-VolumeQuotasAdminTestJSON-1965131442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:58:04 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-6c2f3dd8-2cb5-4ad1-b7b9-fbf367805788 tempest-VolumeQuotasAdminTestJSON-1965131442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:58:04 devstack sudo[94927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 21:58:04 devstack sudo[94927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:58:04 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-aa8bf8ad-1095-48d0-a36b-3bc9b30d5b1a tempest-GroupSnapshotsTest-809568564 None] Update group completed successfully. Sep 17 21:58:05 devstack sudo[94927]: pam_unix(sudo:session): session closed for user root Sep 17 21:58:05 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-6c2f3dd8-2cb5-4ad1-b7b9-fbf367805788 tempest-VolumeQuotasAdminTestJSON-1965131442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.275s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:58:05 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-6c2f3dd8-2cb5-4ad1-b7b9-fbf367805788 tempest-VolumeQuotasAdminTestJSON-1965131442 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 21:58:05 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-6c2f3dd8-2cb5-4ad1-b7b9-fbf367805788 tempest-VolumeQuotasAdminTestJSON-1965131442 None] Deleted volume successfully. Sep 17 21:58:05 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-6c2f3dd8-2cb5-4ad1-b7b9-fbf367805788 tempest-VolumeQuotasAdminTestJSON-1965131442 None] Lock "cinder-d3298793-b88e-4910-a217-eacee151983e-delete_volume" released by "delete_volume" :: held 1.206s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 21:58:06 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-e441d7df-ab73-4eb1-8678-5456a46b9a67 tempest-GroupSnapshotsTest-809568564 None] Update group completed successfully. Sep 17 21:58:07 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-e7076a3f-332c-492b-9f9e-3a9000308f01 tempest-GroupSnapshotsTest-809568564 None] Update group completed successfully. Sep 17 21:58:07 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-c87e4447-9570-4c6a-bbf6-fa3b7dea73a4 tempest-AttachVolumeNegativeTest-28309225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 21:58:07 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-c87e4447-9570-4c6a-bbf6-fa3b7dea73a4 tempest-AttachVolumeNegativeTest-28309225 None] Flow 'volume_create_manager' (eb640286-00c8-4d85-8faa-a5f6e7cb1efd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 21:58:07 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-c87e4447-9570-4c6a-bbf6-fa3b7dea73a4 tempest-AttachVolumeNegativeTest-28309225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27d50e89-4a24-44b2-ad3c-6c04abb99529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:58:07 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-c87e4447-9570-4c6a-bbf6-fa3b7dea73a4 tempest-AttachVolumeNegativeTest-28309225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27d50e89-4a24-44b2-ad3c-6c04abb99529) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T19:58:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1075083217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfd8826c-100c-4430-a617-b6eb56ff7ec2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec04416ff169406d84ffb9bc4ca1646e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T19:58:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T19:58:07Z,use_quota=True,user_id='fd944f203df44249aaf302f096d6a77d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:58:07 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-c87e4447-9570-4c6a-bbf6-fa3b7dea73a4 tempest-AttachVolumeNegativeTest-28309225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af30828f-d31a-4579-b95c-18af39461665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:58:07 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-c87e4447-9570-4c6a-bbf6-fa3b7dea73a4 tempest-AttachVolumeNegativeTest-28309225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af30828f-d31a-4579-b95c-18af39461665) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:58:07 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-c87e4447-9570-4c6a-bbf6-fa3b7dea73a4 tempest-AttachVolumeNegativeTest-28309225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbc1fd00-df27-4613-a101-2c49136d039a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:58:07 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-c87e4447-9570-4c6a-bbf6-fa3b7dea73a4 tempest-AttachVolumeNegativeTest-28309225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbc1fd00-df27-4613-a101-2c49136d039a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfd8826c-100c-4430-a617-b6eb56ff7ec2', 'volume_name': 'volume-dfd8826c-100c-4430-a617-b6eb56ff7ec2', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:58:07 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-c87e4447-9570-4c6a-bbf6-fa3b7dea73a4 tempest-AttachVolumeNegativeTest-28309225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ebac889-f812-4e8c-85eb-e4c0714276fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:58:07 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-c87e4447-9570-4c6a-bbf6-fa3b7dea73a4 tempest-AttachVolumeNegativeTest-28309225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ebac889-f812-4e8c-85eb-e4c0714276fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:58:07 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-c87e4447-9570-4c6a-bbf6-fa3b7dea73a4 tempest-AttachVolumeNegativeTest-28309225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64516073-e594-4dec-98c9-b9165d1e6ae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:58:07 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-c87e4447-9570-4c6a-bbf6-fa3b7dea73a4 tempest-AttachVolumeNegativeTest-28309225 None] Volume dfd8826c-100c-4430-a617-b6eb56ff7ec2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfd8826c-100c-4430-a617-b6eb56ff7ec2', 'volume_size': 1} Sep 17 21:58:07 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-c87e4447-9570-4c6a-bbf6-fa3b7dea73a4 tempest-AttachVolumeNegativeTest-28309225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:58:07 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-c87e4447-9570-4c6a-bbf6-fa3b7dea73a4 tempest-AttachVolumeNegativeTest-28309225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:58:07 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-c87e4447-9570-4c6a-bbf6-fa3b7dea73a4 tempest-AttachVolumeNegativeTest-28309225 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T19:58:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1075083217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfd8826c-100c-4430-a617-b6eb56ff7ec2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec04416ff169406d84ffb9bc4ca1646e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T19:58:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T19:58:07Z,use_quota=True,user_id='fd944f203df44249aaf302f096d6a77d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 21:58:07 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-c87e4447-9570-4c6a-bbf6-fa3b7dea73a4 tempest-AttachVolumeNegativeTest-28309225 None] Creating volume dfd8826c-100c-4430-a617-b6eb56ff7ec2 {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 21:58:07 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-c87e4447-9570-4c6a-bbf6-fa3b7dea73a4 tempest-AttachVolumeNegativeTest-28309225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:58:07 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-c87e4447-9570-4c6a-bbf6-fa3b7dea73a4 tempest-AttachVolumeNegativeTest-28309225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:58:07 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-c87e4447-9570-4c6a-bbf6-fa3b7dea73a4 tempest-AttachVolumeNegativeTest-28309225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 21:58:07 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-c87e4447-9570-4c6a-bbf6-fa3b7dea73a4 tempest-AttachVolumeNegativeTest-28309225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 21:58:07 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-c87e4447-9570-4c6a-bbf6-fa3b7dea73a4 tempest-AttachVolumeNegativeTest-28309225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:58:07 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-c87e4447-9570-4c6a-bbf6-fa3b7dea73a4 tempest-AttachVolumeNegativeTest-28309225 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 21:58:07 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-c87e4447-9570-4c6a-bbf6-fa3b7dea73a4 tempest-AttachVolumeNegativeTest-28309225 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 21:58:07 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-c87e4447-9570-4c6a-bbf6-fa3b7dea73a4 tempest-AttachVolumeNegativeTest-28309225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-dfd8826c-100c-4430-a617-b6eb56ff7ec2 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:58:07 devstack sudo[94932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-dfd8826c-100c-4430-a617-b6eb56ff7ec2 1073741824 Sep 17 21:58:07 devstack sudo[94932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:58:08 devstack sudo[94932]: pam_unix(sudo:session): session closed for user root Sep 17 21:58:08 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-c87e4447-9570-4c6a-bbf6-fa3b7dea73a4 tempest-AttachVolumeNegativeTest-28309225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-dfd8826c-100c-4430-a617-b6eb56ff7ec2 1073741824" returned: 0 in 0.592s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:58:08 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-c87e4447-9570-4c6a-bbf6-fa3b7dea73a4 tempest-AttachVolumeNegativeTest-28309225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-dfd8826c-100c-4430-a617-b6eb56ff7ec2 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:58:08 devstack sudo[94938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-dfd8826c-100c-4430-a617-b6eb56ff7ec2 Sep 17 21:58:08 devstack sudo[94938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:58:08 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-9ce31a45-3063-46f8-bb9b-17945288d110 tempest-GroupSnapshotsTest-809568564 None] Update group completed successfully. Sep 17 21:58:08 devstack sudo[94938]: pam_unix(sudo:session): session closed for user root Sep 17 21:58:08 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-c87e4447-9570-4c6a-bbf6-fa3b7dea73a4 tempest-AttachVolumeNegativeTest-28309225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-dfd8826c-100c-4430-a617-b6eb56ff7ec2" returned: 0 in 0.307s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:58:08 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-c87e4447-9570-4c6a-bbf6-fa3b7dea73a4 tempest-AttachVolumeNegativeTest-28309225 None] <== create_volume: return (986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 21:58:08 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-c87e4447-9570-4c6a-bbf6-fa3b7dea73a4 tempest-AttachVolumeNegativeTest-28309225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.988s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:58:08 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-c87e4447-9570-4c6a-bbf6-fa3b7dea73a4 tempest-AttachVolumeNegativeTest-28309225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64516073-e594-4dec-98c9-b9165d1e6ae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfd8826c-100c-4430-a617-b6eb56ff7ec2', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:58:08 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-c87e4447-9570-4c6a-bbf6-fa3b7dea73a4 tempest-AttachVolumeNegativeTest-28309225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96a31121-f565-4c96-9f84-7b3a2d870549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:58:08 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-c87e4447-9570-4c6a-bbf6-fa3b7dea73a4 tempest-AttachVolumeNegativeTest-28309225 None] Volume volume-dfd8826c-100c-4430-a617-b6eb56ff7ec2 (dfd8826c-100c-4430-a617-b6eb56ff7ec2): created successfully Sep 17 21:58:08 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-c87e4447-9570-4c6a-bbf6-fa3b7dea73a4 tempest-AttachVolumeNegativeTest-28309225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96a31121-f565-4c96-9f84-7b3a2d870549) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:58:08 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-c87e4447-9570-4c6a-bbf6-fa3b7dea73a4 tempest-AttachVolumeNegativeTest-28309225 None] Flow 'volume_create_manager' (eb640286-00c8-4d85-8faa-a5f6e7cb1efd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 21:58:08 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-c87e4447-9570-4c6a-bbf6-fa3b7dea73a4 tempest-AttachVolumeNegativeTest-28309225 None] Created volume successfully. Sep 17 21:58:10 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-f464df8c-91e2-4579-9088-9ca23d226bb5 tempest-GroupSnapshotsTest-809568564 None] GroupSnapshot db86231d-4690-4edc-96c4-708cdf51c827: creating. Sep 17 21:58:10 devstack cinder-volume[85458]: DEBUG dbcounter [-] [85458] Writing DB stats cinder:SELECT=152,cinder:INSERT=43,cinder:UPDATE=169,cinder:DELETE=8 {{(pid=85458) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 21:58:10 devstack cinder-volume[85458]: DEBUG dbcounter [-] [85458] Writing DB stats cinder:SELECT=150,cinder:INSERT=48,cinder:UPDATE=164,cinder:DELETE=13 {{(pid=85458) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 21:58:10 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-f464df8c-91e2-4579-9088-9ca23d226bb5 tempest-GroupSnapshotsTest-809568564 None] Group snapshot db86231d-4690-4edc-96c4-708cdf51c827: creating. {{(pid=85458) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 17 21:58:10 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-f464df8c-91e2-4579-9088-9ca23d226bb5 tempest-GroupSnapshotsTest-809568564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:58:10 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-f464df8c-91e2-4579-9088-9ca23d226bb5 tempest-GroupSnapshotsTest-809568564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:58:10 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-f464df8c-91e2-4579-9088-9ca23d226bb5 tempest-GroupSnapshotsTest-809568564 None] Creating offline snapshot d24b7c4e-ca74-414d-b85d-2d58ba194324 of volume e19dcfe4-39f2-45a4-a0f1-da9d01ca6521 {{(pid=85458) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 21:58:10 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[78d6c786-0ec9-4590-bd1e-6c63b5d5280c]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 21:58:10 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-f464df8c-91e2-4579-9088-9ca23d226bb5 tempest-GroupSnapshotsTest-809568564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e19dcfe4-39f2-45a4-a0f1-da9d01ca6521 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:58:10 devstack sudo[94945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e19dcfe4-39f2-45a4-a0f1-da9d01ca6521 Sep 17 21:58:10 devstack sudo[94945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:58:11 devstack sudo[94945]: pam_unix(sudo:session): session closed for user root Sep 17 21:58:11 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-f464df8c-91e2-4579-9088-9ca23d226bb5 tempest-GroupSnapshotsTest-809568564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e19dcfe4-39f2-45a4-a0f1-da9d01ca6521" returned: 0 in 0.741s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:58:11 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-f464df8c-91e2-4579-9088-9ca23d226bb5 tempest-GroupSnapshotsTest-809568564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e19dcfe4-39f2-45a4-a0f1-da9d01ca6521,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e19dcfe4-39f2-45a4-a0f1-da9d01ca6521.d24b7c4e-ca74-414d-b85d-2d58ba194324 1G {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:58:11 devstack sudo[94950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e19dcfe4-39f2-45a4-a0f1-da9d01ca6521,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e19dcfe4-39f2-45a4-a0f1-da9d01ca6521.d24b7c4e-ca74-414d-b85d-2d58ba194324 1G Sep 17 21:58:11 devstack sudo[94950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:58:11 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [req-bd422760-2f5a-4c84-9fda-eab7fd8be233 req-ca47c43f-5f5e-44bc-b57a-d3f095627b68 tempest-AttachVolumeNegativeTest-28309225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:58:11 devstack sudo[94950]: pam_unix(sudo:session): session closed for user root Sep 17 21:58:11 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-f464df8c-91e2-4579-9088-9ca23d226bb5 tempest-GroupSnapshotsTest-809568564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e19dcfe4-39f2-45a4-a0f1-da9d01ca6521,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e19dcfe4-39f2-45a4-a0f1-da9d01ca6521.d24b7c4e-ca74-414d-b85d-2d58ba194324 1G" returned: 0 in 0.591s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:58:11 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-f464df8c-91e2-4579-9088-9ca23d226bb5 tempest-GroupSnapshotsTest-809568564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e19dcfe4-39f2-45a4-a0f1-da9d01ca6521 -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e19dcfe4-39f2-45a4-a0f1-da9d01ca6521.d24b7c4e-ca74-414d-b85d-2d58ba194324 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:58:11 devstack sudo[94964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e19dcfe4-39f2-45a4-a0f1-da9d01ca6521 -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e19dcfe4-39f2-45a4-a0f1-da9d01ca6521.d24b7c4e-ca74-414d-b85d-2d58ba194324 Sep 17 21:58:11 devstack sudo[94964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:58:12 devstack sudo[94964]: pam_unix(sudo:session): session closed for user root Sep 17 21:58:12 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-f464df8c-91e2-4579-9088-9ca23d226bb5 tempest-GroupSnapshotsTest-809568564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e19dcfe4-39f2-45a4-a0f1-da9d01ca6521 -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e19dcfe4-39f2-45a4-a0f1-da9d01ca6521.d24b7c4e-ca74-414d-b85d-2d58ba194324" returned: 0 in 0.401s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:58:12 devstack cinder-volume[85458]: WARNING cinder.volume.drivers.remotefs [None req-f464df8c-91e2-4579-9088-9ca23d226bb5 tempest-GroupSnapshotsTest-809568564 None] /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e19dcfe4-39f2-45a4-a0f1-da9d01ca6521.d24b7c4e-ca74-414d-b85d-2d58ba194324 is being set with open permissions: ugo+rw: NotImplementedError Sep 17 21:58:12 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-f464df8c-91e2-4579-9088-9ca23d226bb5 tempest-GroupSnapshotsTest-809568564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e19dcfe4-39f2-45a4-a0f1-da9d01ca6521.d24b7c4e-ca74-414d-b85d-2d58ba194324 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:58:12 devstack sudo[94969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e19dcfe4-39f2-45a4-a0f1-da9d01ca6521.d24b7c4e-ca74-414d-b85d-2d58ba194324 Sep 17 21:58:12 devstack sudo[94969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:58:12 devstack sudo[94969]: pam_unix(sudo:session): session closed for user root Sep 17 21:58:12 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-f464df8c-91e2-4579-9088-9ca23d226bb5 tempest-GroupSnapshotsTest-809568564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e19dcfe4-39f2-45a4-a0f1-da9d01ca6521.d24b7c4e-ca74-414d-b85d-2d58ba194324" returned: 0 in 0.276s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:58:12 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-f464df8c-91e2-4579-9088-9ca23d226bb5 tempest-GroupSnapshotsTest-809568564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e19dcfe4-39f2-45a4-a0f1-da9d01ca6521.info {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:58:12 devstack sudo[94972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e19dcfe4-39f2-45a4-a0f1-da9d01ca6521.info Sep 17 21:58:12 devstack sudo[94972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:58:12 devstack sudo[94972]: pam_unix(sudo:session): session closed for user root Sep 17 21:58:12 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-f464df8c-91e2-4579-9088-9ca23d226bb5 tempest-GroupSnapshotsTest-809568564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e19dcfe4-39f2-45a4-a0f1-da9d01ca6521.info" returned: 0 in 0.287s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:58:12 devstack cinder-volume[85458]: WARNING cinder.volume.drivers.remotefs [None req-f464df8c-91e2-4579-9088-9ca23d226bb5 tempest-GroupSnapshotsTest-809568564 None] /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e19dcfe4-39f2-45a4-a0f1-da9d01ca6521.info is being set with open permissions: ugo+rw: NotImplementedError Sep 17 21:58:12 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-f464df8c-91e2-4579-9088-9ca23d226bb5 tempest-GroupSnapshotsTest-809568564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e19dcfe4-39f2-45a4-a0f1-da9d01ca6521.info {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:58:12 devstack sudo[94975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e19dcfe4-39f2-45a4-a0f1-da9d01ca6521.info Sep 17 21:58:12 devstack sudo[94975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:58:12 devstack sudo[94975]: pam_unix(sudo:session): session closed for user root Sep 17 21:58:12 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-f464df8c-91e2-4579-9088-9ca23d226bb5 tempest-GroupSnapshotsTest-809568564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e19dcfe4-39f2-45a4-a0f1-da9d01ca6521.info" returned: 0 in 0.285s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:58:12 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-f464df8c-91e2-4579-9088-9ca23d226bb5 tempest-GroupSnapshotsTest-809568564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.695s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:58:12 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-f464df8c-91e2-4579-9088-9ca23d226bb5 tempest-GroupSnapshotsTest-809568564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:58:12 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-f464df8c-91e2-4579-9088-9ca23d226bb5 tempest-GroupSnapshotsTest-809568564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:58:12 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-f464df8c-91e2-4579-9088-9ca23d226bb5 tempest-GroupSnapshotsTest-809568564 None] Creating offline snapshot df08d9f0-d7fe-4d51-a8d4-838e51a8532d of volume c8dce848-37aa-44b4-813f-3478957d1f34 {{(pid=85458) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 21:58:13 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b4ad673-e3e1-4ae4-a004-a0e6e0c98fce]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 21:58:13 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-f464df8c-91e2-4579-9088-9ca23d226bb5 tempest-GroupSnapshotsTest-809568564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c8dce848-37aa-44b4-813f-3478957d1f34 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:58:13 devstack sudo[94978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c8dce848-37aa-44b4-813f-3478957d1f34 Sep 17 21:58:13 devstack sudo[94978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:58:13 devstack sudo[94978]: pam_unix(sudo:session): session closed for user root Sep 17 21:58:13 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-f464df8c-91e2-4579-9088-9ca23d226bb5 tempest-GroupSnapshotsTest-809568564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c8dce848-37aa-44b4-813f-3478957d1f34" returned: 0 in 0.465s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:58:13 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-f464df8c-91e2-4579-9088-9ca23d226bb5 tempest-GroupSnapshotsTest-809568564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c8dce848-37aa-44b4-813f-3478957d1f34,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c8dce848-37aa-44b4-813f-3478957d1f34.df08d9f0-d7fe-4d51-a8d4-838e51a8532d 1G {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:58:13 devstack sudo[94983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c8dce848-37aa-44b4-813f-3478957d1f34,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c8dce848-37aa-44b4-813f-3478957d1f34.df08d9f0-d7fe-4d51-a8d4-838e51a8532d 1G Sep 17 21:58:13 devstack sudo[94983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:58:14 devstack sudo[94983]: pam_unix(sudo:session): session closed for user root Sep 17 21:58:14 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-f464df8c-91e2-4579-9088-9ca23d226bb5 tempest-GroupSnapshotsTest-809568564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c8dce848-37aa-44b4-813f-3478957d1f34,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c8dce848-37aa-44b4-813f-3478957d1f34.df08d9f0-d7fe-4d51-a8d4-838e51a8532d 1G" returned: 0 in 0.568s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:58:14 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-f464df8c-91e2-4579-9088-9ca23d226bb5 tempest-GroupSnapshotsTest-809568564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c8dce848-37aa-44b4-813f-3478957d1f34 -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c8dce848-37aa-44b4-813f-3478957d1f34.df08d9f0-d7fe-4d51-a8d4-838e51a8532d {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:58:14 devstack sudo[94989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c8dce848-37aa-44b4-813f-3478957d1f34 -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c8dce848-37aa-44b4-813f-3478957d1f34.df08d9f0-d7fe-4d51-a8d4-838e51a8532d Sep 17 21:58:14 devstack sudo[94989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:58:14 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c23c9bc-d07f-443b-becf-f473d90525b8 tempest-VolumeQuotasNegativeTestJSON-1083771821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 21:58:14 devstack sudo[94989]: pam_unix(sudo:session): session closed for user root Sep 17 21:58:14 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-8c23c9bc-d07f-443b-becf-f473d90525b8 tempest-VolumeQuotasNegativeTestJSON-1083771821 None] Flow 'volume_create_manager' (0819af05-7337-48dd-a6ef-b0fa4e61e56f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 21:58:14 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-8c23c9bc-d07f-443b-becf-f473d90525b8 tempest-VolumeQuotasNegativeTestJSON-1083771821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18fa5318-7343-453f-8671-73e29d204386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:58:14 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-f464df8c-91e2-4579-9088-9ca23d226bb5 tempest-GroupSnapshotsTest-809568564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c8dce848-37aa-44b4-813f-3478957d1f34 -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c8dce848-37aa-44b4-813f-3478957d1f34.df08d9f0-d7fe-4d51-a8d4-838e51a8532d" returned: 0 in 0.467s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:58:14 devstack cinder-volume[85458]: WARNING cinder.volume.drivers.remotefs [None req-f464df8c-91e2-4579-9088-9ca23d226bb5 tempest-GroupSnapshotsTest-809568564 None] /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c8dce848-37aa-44b4-813f-3478957d1f34.df08d9f0-d7fe-4d51-a8d4-838e51a8532d is being set with open permissions: ugo+rw: NotImplementedError Sep 17 21:58:14 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-f464df8c-91e2-4579-9088-9ca23d226bb5 tempest-GroupSnapshotsTest-809568564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c8dce848-37aa-44b4-813f-3478957d1f34.df08d9f0-d7fe-4d51-a8d4-838e51a8532d {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:58:14 devstack sudo[94995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c8dce848-37aa-44b4-813f-3478957d1f34.df08d9f0-d7fe-4d51-a8d4-838e51a8532d Sep 17 21:58:14 devstack sudo[94995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:58:14 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-8c23c9bc-d07f-443b-becf-f473d90525b8 tempest-VolumeQuotasNegativeTestJSON-1083771821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18fa5318-7343-453f-8671-73e29d204386) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T19:58:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1059135207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1610b126-c74b-48e5-bd09-58918a67bc61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c79a191967e4d7f89d0f2552a0c47b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T19:58:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T19:58:14Z,use_quota=True,user_id='46f4b69a29f64fcf81e2440af11ea4e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:58:14 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-8c23c9bc-d07f-443b-becf-f473d90525b8 tempest-VolumeQuotasNegativeTestJSON-1083771821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6817df49-9309-4010-8cfb-d1dd499f7a51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:58:14 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-8c23c9bc-d07f-443b-becf-f473d90525b8 tempest-VolumeQuotasNegativeTestJSON-1083771821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6817df49-9309-4010-8cfb-d1dd499f7a51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:58:14 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-8c23c9bc-d07f-443b-becf-f473d90525b8 tempest-VolumeQuotasNegativeTestJSON-1083771821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddf83d83-7ea5-41a1-933d-6cc0c15755ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:58:14 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-8c23c9bc-d07f-443b-becf-f473d90525b8 tempest-VolumeQuotasNegativeTestJSON-1083771821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddf83d83-7ea5-41a1-933d-6cc0c15755ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1610b126-c74b-48e5-bd09-58918a67bc61', 'volume_name': 'volume-1610b126-c74b-48e5-bd09-58918a67bc61', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:58:14 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-8c23c9bc-d07f-443b-becf-f473d90525b8 tempest-VolumeQuotasNegativeTestJSON-1083771821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b7d4a60-5550-4624-b1fb-857fac35887c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:58:14 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-8c23c9bc-d07f-443b-becf-f473d90525b8 tempest-VolumeQuotasNegativeTestJSON-1083771821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b7d4a60-5550-4624-b1fb-857fac35887c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:58:14 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-8c23c9bc-d07f-443b-becf-f473d90525b8 tempest-VolumeQuotasNegativeTestJSON-1083771821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41841660-9055-4e40-8f1c-7568370fe1c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:58:14 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-8c23c9bc-d07f-443b-becf-f473d90525b8 tempest-VolumeQuotasNegativeTestJSON-1083771821 None] Volume 1610b126-c74b-48e5-bd09-58918a67bc61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1610b126-c74b-48e5-bd09-58918a67bc61', 'volume_size': 1} Sep 17 21:58:14 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-8c23c9bc-d07f-443b-becf-f473d90525b8 tempest-VolumeQuotasNegativeTestJSON-1083771821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:58:14 devstack sudo[94995]: pam_unix(sudo:session): session closed for user root Sep 17 21:58:14 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-f464df8c-91e2-4579-9088-9ca23d226bb5 tempest-GroupSnapshotsTest-809568564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c8dce848-37aa-44b4-813f-3478957d1f34.df08d9f0-d7fe-4d51-a8d4-838e51a8532d" returned: 0 in 0.336s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:58:14 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-f464df8c-91e2-4579-9088-9ca23d226bb5 tempest-GroupSnapshotsTest-809568564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c8dce848-37aa-44b4-813f-3478957d1f34.info {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:58:14 devstack sudo[95032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c8dce848-37aa-44b4-813f-3478957d1f34.info Sep 17 21:58:14 devstack sudo[95032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:58:15 devstack sudo[95032]: pam_unix(sudo:session): session closed for user root Sep 17 21:58:15 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-f464df8c-91e2-4579-9088-9ca23d226bb5 tempest-GroupSnapshotsTest-809568564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c8dce848-37aa-44b4-813f-3478957d1f34.info" returned: 0 in 0.320s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:58:15 devstack cinder-volume[85458]: WARNING cinder.volume.drivers.remotefs [None req-f464df8c-91e2-4579-9088-9ca23d226bb5 tempest-GroupSnapshotsTest-809568564 None] /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c8dce848-37aa-44b4-813f-3478957d1f34.info is being set with open permissions: ugo+rw: NotImplementedError Sep 17 21:58:15 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-f464df8c-91e2-4579-9088-9ca23d226bb5 tempest-GroupSnapshotsTest-809568564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c8dce848-37aa-44b4-813f-3478957d1f34.info {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:58:15 devstack sudo[95037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c8dce848-37aa-44b4-813f-3478957d1f34.info Sep 17 21:58:15 devstack sudo[95037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:58:15 devstack sudo[95037]: pam_unix(sudo:session): session closed for user root Sep 17 21:58:15 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-f464df8c-91e2-4579-9088-9ca23d226bb5 tempest-GroupSnapshotsTest-809568564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c8dce848-37aa-44b4-813f-3478957d1f34.info" returned: 0 in 0.250s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:58:15 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-f464df8c-91e2-4579-9088-9ca23d226bb5 tempest-GroupSnapshotsTest-809568564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.527s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:58:15 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [req-bd422760-2f5a-4c84-9fda-eab7fd8be233 req-ca47c43f-5f5e-44bc-b57a-d3f095627b68 tempest-AttachVolumeNegativeTest-28309225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 4.047s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:58:15 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [req-bd422760-2f5a-4c84-9fda-eab7fd8be233 req-ca47c43f-5f5e-44bc-b57a-d3f095627b68 tempest-AttachVolumeNegativeTest-28309225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:58:15 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-8c23c9bc-d07f-443b-becf-f473d90525b8 tempest-VolumeQuotasNegativeTestJSON-1083771821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.901s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:58:15 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-8c23c9bc-d07f-443b-becf-f473d90525b8 tempest-VolumeQuotasNegativeTestJSON-1083771821 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T19:58:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1059135207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1610b126-c74b-48e5-bd09-58918a67bc61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c79a191967e4d7f89d0f2552a0c47b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T19:58:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T19:58:14Z,use_quota=True,user_id='46f4b69a29f64fcf81e2440af11ea4e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 21:58:15 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-8c23c9bc-d07f-443b-becf-f473d90525b8 tempest-VolumeQuotasNegativeTestJSON-1083771821 None] Creating volume 1610b126-c74b-48e5-bd09-58918a67bc61 {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 21:58:15 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-8c23c9bc-d07f-443b-becf-f473d90525b8 tempest-VolumeQuotasNegativeTestJSON-1083771821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:58:15 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-8c23c9bc-d07f-443b-becf-f473d90525b8 tempest-VolumeQuotasNegativeTestJSON-1083771821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:58:15 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-8c23c9bc-d07f-443b-becf-f473d90525b8 tempest-VolumeQuotasNegativeTestJSON-1083771821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 21:58:15 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-8c23c9bc-d07f-443b-becf-f473d90525b8 tempest-VolumeQuotasNegativeTestJSON-1083771821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 21:58:15 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-8c23c9bc-d07f-443b-becf-f473d90525b8 tempest-VolumeQuotasNegativeTestJSON-1083771821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:58:15 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-8c23c9bc-d07f-443b-becf-f473d90525b8 tempest-VolumeQuotasNegativeTestJSON-1083771821 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 21:58:15 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-8c23c9bc-d07f-443b-becf-f473d90525b8 tempest-VolumeQuotasNegativeTestJSON-1083771821 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 21:58:15 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-8c23c9bc-d07f-443b-becf-f473d90525b8 tempest-VolumeQuotasNegativeTestJSON-1083771821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-1610b126-c74b-48e5-bd09-58918a67bc61 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:58:15 devstack sudo[95040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-1610b126-c74b-48e5-bd09-58918a67bc61 1073741824 Sep 17 21:58:15 devstack sudo[95040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:58:15 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [req-bd422760-2f5a-4c84-9fda-eab7fd8be233 req-ca47c43f-5f5e-44bc-b57a-d3f095627b68 tempest-AttachVolumeNegativeTest-28309225 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5', 'name': 'volume-dfd8826c-100c-4430-a617-b6eb56ff7ec2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '54393e1b-5297-4244-97ce-26f477ccd49a', 'enforce_multipath': True} {{(pid=85458) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 21:58:15 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-f464df8c-91e2-4579-9088-9ca23d226bb5 tempest-GroupSnapshotsTest-809568564 None] group_snapshot db86231d-4690-4edc-96c4-708cdf51c827: created successfully Sep 17 21:58:15 devstack cinder-volume[85458]: INFO cinder.volume.manager [req-bd422760-2f5a-4c84-9fda-eab7fd8be233 req-ca47c43f-5f5e-44bc-b57a-d3f095627b68 tempest-AttachVolumeNegativeTest-28309225 None] attachment_update completed successfully. Sep 17 21:58:16 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-07b06243-7dbb-44ef-ac8d-c51dc0240a27 tempest-GroupSnapshotsTest-809568564 None] group_snapshot db86231d-4690-4edc-96c4-708cdf51c827: deleting Sep 17 21:58:16 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-07b06243-7dbb-44ef-ac8d-c51dc0240a27 tempest-GroupSnapshotsTest-809568564 None] group_snapshot db86231d-4690-4edc-96c4-708cdf51c827: deleting {{(pid=85458) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 17 21:58:16 devstack sudo[95040]: pam_unix(sudo:session): session closed for user root Sep 17 21:58:16 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-07b06243-7dbb-44ef-ac8d-c51dc0240a27 tempest-GroupSnapshotsTest-809568564 None] Acquiring lock "cinder-quobyte-e19dcfe4-39f2-45a4-a0f1-da9d01ca6521" by "delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 21:58:16 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-8c23c9bc-d07f-443b-becf-f473d90525b8 tempest-VolumeQuotasNegativeTestJSON-1083771821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-1610b126-c74b-48e5-bd09-58918a67bc61 1073741824" returned: 0 in 0.690s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:58:16 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-07b06243-7dbb-44ef-ac8d-c51dc0240a27 tempest-GroupSnapshotsTest-809568564 None] Lock "cinder-quobyte-e19dcfe4-39f2-45a4-a0f1-da9d01ca6521" acquired by "delete_snapshot" :: waited 0.030s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 21:58:16 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-07b06243-7dbb-44ef-ac8d-c51dc0240a27 tempest-GroupSnapshotsTest-809568564 None] Acquiring lock "cinder-quobyte-d24b7c4e-ca74-414d-b85d-2d58ba194324" by "_delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 21:58:16 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-07b06243-7dbb-44ef-ac8d-c51dc0240a27 tempest-GroupSnapshotsTest-809568564 None] Lock "cinder-quobyte-d24b7c4e-ca74-414d-b85d-2d58ba194324" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 21:58:16 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-07b06243-7dbb-44ef-ac8d-c51dc0240a27 tempest-GroupSnapshotsTest-809568564 None] Deleting offline snapshot d24b7c4e-ca74-414d-b85d-2d58ba194324 of volume e19dcfe4-39f2-45a4-a0f1-da9d01ca6521 {{(pid=85458) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 21:58:16 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-07b06243-7dbb-44ef-ac8d-c51dc0240a27 tempest-GroupSnapshotsTest-809568564 None] snapshot_file for this snap is: volume-e19dcfe4-39f2-45a4-a0f1-da9d01ca6521.d24b7c4e-ca74-414d-b85d-2d58ba194324 {{(pid=85458) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 21:58:16 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-8c23c9bc-d07f-443b-becf-f473d90525b8 tempest-VolumeQuotasNegativeTestJSON-1083771821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-1610b126-c74b-48e5-bd09-58918a67bc61 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:58:16 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5783241-2b9a-4b1a-a02b-882980c2de38]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 21:58:16 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-07b06243-7dbb-44ef-ac8d-c51dc0240a27 tempest-GroupSnapshotsTest-809568564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e19dcfe4-39f2-45a4-a0f1-da9d01ca6521.d24b7c4e-ca74-414d-b85d-2d58ba194324 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:58:16 devstack sudo[95458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-1610b126-c74b-48e5-bd09-58918a67bc61 Sep 17 21:58:16 devstack sudo[95458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:58:16 devstack sudo[95459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e19dcfe4-39f2-45a4-a0f1-da9d01ca6521.d24b7c4e-ca74-414d-b85d-2d58ba194324 Sep 17 21:58:16 devstack sudo[95459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:58:16 devstack sudo[95458]: pam_unix(sudo:session): session closed for user root Sep 17 21:58:16 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-8c23c9bc-d07f-443b-becf-f473d90525b8 tempest-VolumeQuotasNegativeTestJSON-1083771821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-1610b126-c74b-48e5-bd09-58918a67bc61" returned: 0 in 0.521s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:58:16 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-8c23c9bc-d07f-443b-becf-f473d90525b8 tempest-VolumeQuotasNegativeTestJSON-1083771821 None] <== create_volume: return (1324ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 21:58:16 devstack sudo[95459]: pam_unix(sudo:session): session closed for user root Sep 17 21:58:16 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-8c23c9bc-d07f-443b-becf-f473d90525b8 tempest-VolumeQuotasNegativeTestJSON-1083771821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.326s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:58:16 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-07b06243-7dbb-44ef-ac8d-c51dc0240a27 tempest-GroupSnapshotsTest-809568564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e19dcfe4-39f2-45a4-a0f1-da9d01ca6521.d24b7c4e-ca74-414d-b85d-2d58ba194324" returned: 0 in 0.505s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:58:16 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-07b06243-7dbb-44ef-ac8d-c51dc0240a27 tempest-GroupSnapshotsTest-809568564 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e19dcfe4-39f2-45a4-a0f1-da9d01ca6521(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85458) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 21:58:16 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-8c23c9bc-d07f-443b-becf-f473d90525b8 tempest-VolumeQuotasNegativeTestJSON-1083771821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41841660-9055-4e40-8f1c-7568370fe1c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1610b126-c74b-48e5-bd09-58918a67bc61', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:58:16 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-8c23c9bc-d07f-443b-becf-f473d90525b8 tempest-VolumeQuotasNegativeTestJSON-1083771821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90d26c5f-7cac-4df7-85f9-3f9cad3cf635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:58:16 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[187c1e27-26d3-4787-b99b-499c27f81173]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 21:58:16 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-07b06243-7dbb-44ef-ac8d-c51dc0240a27 tempest-GroupSnapshotsTest-809568564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e19dcfe4-39f2-45a4-a0f1-da9d01ca6521 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:58:16 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-8c23c9bc-d07f-443b-becf-f473d90525b8 tempest-VolumeQuotasNegativeTestJSON-1083771821 None] Volume volume-1610b126-c74b-48e5-bd09-58918a67bc61 (1610b126-c74b-48e5-bd09-58918a67bc61): created successfully Sep 17 21:58:16 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-8c23c9bc-d07f-443b-becf-f473d90525b8 tempest-VolumeQuotasNegativeTestJSON-1083771821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90d26c5f-7cac-4df7-85f9-3f9cad3cf635) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:58:16 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-8c23c9bc-d07f-443b-becf-f473d90525b8 tempest-VolumeQuotasNegativeTestJSON-1083771821 None] Flow 'volume_create_manager' (0819af05-7337-48dd-a6ef-b0fa4e61e56f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 21:58:17 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-8c23c9bc-d07f-443b-becf-f473d90525b8 tempest-VolumeQuotasNegativeTestJSON-1083771821 None] Created volume successfully. Sep 17 21:58:17 devstack sudo[95467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e19dcfe4-39f2-45a4-a0f1-da9d01ca6521 Sep 17 21:58:17 devstack sudo[95467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:58:17 devstack sudo[95467]: pam_unix(sudo:session): session closed for user root Sep 17 21:58:17 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-07b06243-7dbb-44ef-ac8d-c51dc0240a27 tempest-GroupSnapshotsTest-809568564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e19dcfe4-39f2-45a4-a0f1-da9d01ca6521" returned: 0 in 0.396s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:58:17 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-07b06243-7dbb-44ef-ac8d-c51dc0240a27 tempest-GroupSnapshotsTest-809568564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e19dcfe4-39f2-45a4-a0f1-da9d01ca6521.d24b7c4e-ca74-414d-b85d-2d58ba194324 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:58:17 devstack sudo[95472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e19dcfe4-39f2-45a4-a0f1-da9d01ca6521.d24b7c4e-ca74-414d-b85d-2d58ba194324 Sep 17 21:58:17 devstack sudo[95472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:58:17 devstack sudo[95472]: pam_unix(sudo:session): session closed for user root Sep 17 21:58:17 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-07b06243-7dbb-44ef-ac8d-c51dc0240a27 tempest-GroupSnapshotsTest-809568564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e19dcfe4-39f2-45a4-a0f1-da9d01ca6521.d24b7c4e-ca74-414d-b85d-2d58ba194324" returned: 0 in 0.423s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:58:17 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-07b06243-7dbb-44ef-ac8d-c51dc0240a27 tempest-GroupSnapshotsTest-809568564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e19dcfe4-39f2-45a4-a0f1-da9d01ca6521.d24b7c4e-ca74-414d-b85d-2d58ba194324 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:58:17 devstack sudo[95478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e19dcfe4-39f2-45a4-a0f1-da9d01ca6521.d24b7c4e-ca74-414d-b85d-2d58ba194324 Sep 17 21:58:17 devstack sudo[95478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:58:18 devstack sudo[95478]: pam_unix(sudo:session): session closed for user root Sep 17 21:58:18 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-07b06243-7dbb-44ef-ac8d-c51dc0240a27 tempest-GroupSnapshotsTest-809568564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e19dcfe4-39f2-45a4-a0f1-da9d01ca6521.d24b7c4e-ca74-414d-b85d-2d58ba194324" returned: 0 in 0.366s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:58:18 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-07b06243-7dbb-44ef-ac8d-c51dc0240a27 tempest-GroupSnapshotsTest-809568564 None] Lock "cinder-quobyte-d24b7c4e-ca74-414d-b85d-2d58ba194324" released by "_delete_snapshot" :: held 1.957s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 21:58:18 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-07b06243-7dbb-44ef-ac8d-c51dc0240a27 tempest-GroupSnapshotsTest-809568564 None] Lock "cinder-quobyte-e19dcfe4-39f2-45a4-a0f1-da9d01ca6521" released by "delete_snapshot" :: held 2.010s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 21:58:18 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-07b06243-7dbb-44ef-ac8d-c51dc0240a27 tempest-GroupSnapshotsTest-809568564 None] Acquiring lock "cinder-quobyte-c8dce848-37aa-44b4-813f-3478957d1f34" by "delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 21:58:18 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-07b06243-7dbb-44ef-ac8d-c51dc0240a27 tempest-GroupSnapshotsTest-809568564 None] Lock "cinder-quobyte-c8dce848-37aa-44b4-813f-3478957d1f34" acquired by "delete_snapshot" :: waited 0.031s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 21:58:18 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-07b06243-7dbb-44ef-ac8d-c51dc0240a27 tempest-GroupSnapshotsTest-809568564 None] Acquiring lock "cinder-quobyte-df08d9f0-d7fe-4d51-a8d4-838e51a8532d" by "_delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 21:58:18 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-07b06243-7dbb-44ef-ac8d-c51dc0240a27 tempest-GroupSnapshotsTest-809568564 None] Lock "cinder-quobyte-df08d9f0-d7fe-4d51-a8d4-838e51a8532d" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 21:58:18 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-07b06243-7dbb-44ef-ac8d-c51dc0240a27 tempest-GroupSnapshotsTest-809568564 None] Deleting offline snapshot df08d9f0-d7fe-4d51-a8d4-838e51a8532d of volume c8dce848-37aa-44b4-813f-3478957d1f34 {{(pid=85458) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 21:58:18 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-07b06243-7dbb-44ef-ac8d-c51dc0240a27 tempest-GroupSnapshotsTest-809568564 None] snapshot_file for this snap is: volume-c8dce848-37aa-44b4-813f-3478957d1f34.df08d9f0-d7fe-4d51-a8d4-838e51a8532d {{(pid=85458) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 21:58:18 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e9b6d04-fa19-4520-904b-c510441e4935]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 21:58:18 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-07b06243-7dbb-44ef-ac8d-c51dc0240a27 tempest-GroupSnapshotsTest-809568564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c8dce848-37aa-44b4-813f-3478957d1f34.df08d9f0-d7fe-4d51-a8d4-838e51a8532d {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:58:18 devstack sudo[95481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c8dce848-37aa-44b4-813f-3478957d1f34.df08d9f0-d7fe-4d51-a8d4-838e51a8532d Sep 17 21:58:18 devstack sudo[95481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:58:18 devstack sudo[95481]: pam_unix(sudo:session): session closed for user root Sep 17 21:58:18 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-07b06243-7dbb-44ef-ac8d-c51dc0240a27 tempest-GroupSnapshotsTest-809568564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c8dce848-37aa-44b4-813f-3478957d1f34.df08d9f0-d7fe-4d51-a8d4-838e51a8532d" returned: 0 in 0.590s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:58:18 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-07b06243-7dbb-44ef-ac8d-c51dc0240a27 tempest-GroupSnapshotsTest-809568564 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c8dce848-37aa-44b4-813f-3478957d1f34(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85458) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 21:58:19 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[d18ed2bc-6247-4d0d-bc60-458dfb162c3b]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 21:58:19 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-07b06243-7dbb-44ef-ac8d-c51dc0240a27 tempest-GroupSnapshotsTest-809568564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c8dce848-37aa-44b4-813f-3478957d1f34 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:58:19 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-ada46cf9-9479-46f0-aaf2-ced0ac892920 tempest-VolumeQuotasNegativeTestJSON-1083771821 None] Acquiring lock "cinder-1610b126-c74b-48e5-bd09-58918a67bc61-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 21:58:19 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-ada46cf9-9479-46f0-aaf2-ced0ac892920 tempest-VolumeQuotasNegativeTestJSON-1083771821 None] Lock "cinder-1610b126-c74b-48e5-bd09-58918a67bc61-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 21:58:19 devstack sudo[95488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c8dce848-37aa-44b4-813f-3478957d1f34 Sep 17 21:58:19 devstack sudo[95488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:58:19 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-ada46cf9-9479-46f0-aaf2-ced0ac892920 tempest-VolumeQuotasNegativeTestJSON-1083771821 None] Acquiring lock "cinder-quobyte-1610b126-c74b-48e5-bd09-58918a67bc61" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 21:58:19 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-ada46cf9-9479-46f0-aaf2-ced0ac892920 tempest-VolumeQuotasNegativeTestJSON-1083771821 None] Lock "cinder-quobyte-1610b126-c74b-48e5-bd09-58918a67bc61" acquired by "delete_volume" :: waited 0.034s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 21:58:19 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[3630212d-86f0-4554-86ba-11dd6cf408dc]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 21:58:19 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-ada46cf9-9479-46f0-aaf2-ced0ac892920 tempest-VolumeQuotasNegativeTestJSON-1083771821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-1610b126-c74b-48e5-bd09-58918a67bc61 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:58:19 devstack cinder-volume[85458]: INFO cinder.volume.manager [req-ba481a6d-d02b-4ee8-8d4a-f4079e9dc587 req-ceaeeb06-fa2c-4924-ae80-2543ebf7cf8d tempest-AttachVolumeNegativeTest-28309225 None] Terminate volume connection completed successfully. Sep 17 21:58:19 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [req-ba481a6d-d02b-4ee8-8d4a-f4079e9dc587 req-ceaeeb06-fa2c-4924-ae80-2543ebf7cf8d tempest-AttachVolumeNegativeTest-28309225 None] Deleting attachment 54393e1b-5297-4244-97ce-26f477ccd49a. {{(pid=85458) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 21:58:19 devstack sudo[95517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-1610b126-c74b-48e5-bd09-58918a67bc61 Sep 17 21:58:19 devstack sudo[95517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:58:19 devstack sudo[95488]: pam_unix(sudo:session): session closed for user root Sep 17 21:58:19 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-07b06243-7dbb-44ef-ac8d-c51dc0240a27 tempest-GroupSnapshotsTest-809568564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c8dce848-37aa-44b4-813f-3478957d1f34" returned: 0 in 0.530s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:58:19 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-07b06243-7dbb-44ef-ac8d-c51dc0240a27 tempest-GroupSnapshotsTest-809568564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c8dce848-37aa-44b4-813f-3478957d1f34.df08d9f0-d7fe-4d51-a8d4-838e51a8532d {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:58:19 devstack sudo[95522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c8dce848-37aa-44b4-813f-3478957d1f34.df08d9f0-d7fe-4d51-a8d4-838e51a8532d Sep 17 21:58:19 devstack sudo[95522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:58:19 devstack sudo[95517]: pam_unix(sudo:session): session closed for user root Sep 17 21:58:19 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-ada46cf9-9479-46f0-aaf2-ced0ac892920 tempest-VolumeQuotasNegativeTestJSON-1083771821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-1610b126-c74b-48e5-bd09-58918a67bc61" returned: 0 in 0.428s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:58:19 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-ada46cf9-9479-46f0-aaf2-ced0ac892920 tempest-VolumeQuotasNegativeTestJSON-1083771821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-1610b126-c74b-48e5-bd09-58918a67bc61 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:58:19 devstack sudo[95527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-1610b126-c74b-48e5-bd09-58918a67bc61 Sep 17 21:58:19 devstack sudo[95527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:58:20 devstack sudo[95527]: pam_unix(sudo:session): session closed for user root Sep 17 21:58:20 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-ada46cf9-9479-46f0-aaf2-ced0ac892920 tempest-VolumeQuotasNegativeTestJSON-1083771821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-1610b126-c74b-48e5-bd09-58918a67bc61" returned: 0 in 0.266s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:58:20 devstack sudo[95522]: pam_unix(sudo:session): session closed for user root Sep 17 21:58:20 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-07b06243-7dbb-44ef-ac8d-c51dc0240a27 tempest-GroupSnapshotsTest-809568564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c8dce848-37aa-44b4-813f-3478957d1f34.df08d9f0-d7fe-4d51-a8d4-838e51a8532d" returned: 0 in 0.472s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:58:20 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-07b06243-7dbb-44ef-ac8d-c51dc0240a27 tempest-GroupSnapshotsTest-809568564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c8dce848-37aa-44b4-813f-3478957d1f34.df08d9f0-d7fe-4d51-a8d4-838e51a8532d {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:58:20 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-ada46cf9-9479-46f0-aaf2-ced0ac892920 tempest-VolumeQuotasNegativeTestJSON-1083771821 None] Lock "cinder-quobyte-1610b126-c74b-48e5-bd09-58918a67bc61" released by "delete_volume" :: held 0.790s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 21:58:20 devstack sudo[95534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c8dce848-37aa-44b4-813f-3478957d1f34.df08d9f0-d7fe-4d51-a8d4-838e51a8532d Sep 17 21:58:20 devstack sudo[95534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:58:20 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-ada46cf9-9479-46f0-aaf2-ced0ac892920 tempest-VolumeQuotasNegativeTestJSON-1083771821 None] Created reservations ['10050368-e2a5-47d3-9096-2a95bfc37cec', 'df0ac3f1-8951-4157-84d0-0fd79b72804c', '9edc13a3-244c-4a61-8eeb-9afb2b4ff1bd', 'd9ca14e5-3562-4d51-b167-6b17af8f0313'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 21:58:20 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-ada46cf9-9479-46f0-aaf2-ced0ac892920 tempest-VolumeQuotasNegativeTestJSON-1083771821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:58:20 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-ada46cf9-9479-46f0-aaf2-ced0ac892920 tempest-VolumeQuotasNegativeTestJSON-1083771821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:58:20 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-ada46cf9-9479-46f0-aaf2-ced0ac892920 tempest-VolumeQuotasNegativeTestJSON-1083771821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 21:58:20 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-ada46cf9-9479-46f0-aaf2-ced0ac892920 tempest-VolumeQuotasNegativeTestJSON-1083771821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 21:58:20 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-ada46cf9-9479-46f0-aaf2-ced0ac892920 tempest-VolumeQuotasNegativeTestJSON-1083771821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:58:20 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-ada46cf9-9479-46f0-aaf2-ced0ac892920 tempest-VolumeQuotasNegativeTestJSON-1083771821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:58:20 devstack sudo[95536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 21:58:20 devstack sudo[95536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:58:20 devstack sudo[95534]: pam_unix(sudo:session): session closed for user root Sep 17 21:58:20 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-07b06243-7dbb-44ef-ac8d-c51dc0240a27 tempest-GroupSnapshotsTest-809568564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c8dce848-37aa-44b4-813f-3478957d1f34.df08d9f0-d7fe-4d51-a8d4-838e51a8532d" returned: 0 in 0.361s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:58:20 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-07b06243-7dbb-44ef-ac8d-c51dc0240a27 tempest-GroupSnapshotsTest-809568564 None] Lock "cinder-quobyte-df08d9f0-d7fe-4d51-a8d4-838e51a8532d" released by "_delete_snapshot" :: held 2.138s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 21:58:20 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-07b06243-7dbb-44ef-ac8d-c51dc0240a27 tempest-GroupSnapshotsTest-809568564 None] Lock "cinder-quobyte-c8dce848-37aa-44b4-813f-3478957d1f34" released by "delete_snapshot" :: held 2.174s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 21:58:20 devstack cinder-volume[85458]: WARNING cinder.quota [None req-07b06243-7dbb-44ef-ac8d-c51dc0240a27 tempest-GroupSnapshotsTest-809568564 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1953019562 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1953019562, it is now deprecated. Please use the default quota class for default quota. Sep 17 21:58:20 devstack cinder-volume[85458]: WARNING cinder.quota [None req-07b06243-7dbb-44ef-ac8d-c51dc0240a27 tempest-GroupSnapshotsTest-809568564 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1953019562 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1953019562, it is now deprecated. Please use the default quota class for default quota. Sep 17 21:58:20 devstack sudo[95536]: pam_unix(sudo:session): session closed for user root Sep 17 21:58:20 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-ada46cf9-9479-46f0-aaf2-ced0ac892920 tempest-VolumeQuotasNegativeTestJSON-1083771821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.558s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:58:20 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-ada46cf9-9479-46f0-aaf2-ced0ac892920 tempest-VolumeQuotasNegativeTestJSON-1083771821 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 21:58:20 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-07b06243-7dbb-44ef-ac8d-c51dc0240a27 tempest-GroupSnapshotsTest-809568564 None] Created reservations ['34521743-11f5-4bdf-a5b8-293ac1901792', 'e5762337-89a9-4199-8571-9d5870db8ec1', '908dd252-21e8-4700-a618-2299187b726e', 'cd09b949-5c6e-435d-8d30-97734b89b067'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 21:58:20 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-ada46cf9-9479-46f0-aaf2-ced0ac892920 tempest-VolumeQuotasNegativeTestJSON-1083771821 None] Deleted volume successfully. Sep 17 21:58:20 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-ada46cf9-9479-46f0-aaf2-ced0ac892920 tempest-VolumeQuotasNegativeTestJSON-1083771821 None] Lock "cinder-1610b126-c74b-48e5-bd09-58918a67bc61-delete_volume" released by "delete_volume" :: held 1.715s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 21:58:21 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-07b06243-7dbb-44ef-ac8d-c51dc0240a27 tempest-GroupSnapshotsTest-809568564 None] Created reservations ['be131d05-5a56-4521-b410-b5f8f21b9965', '766259f3-d079-4649-9e87-cc8abc154095', '459c6c57-c005-4888-81f6-f9b5d143ab44', 'b3a28d2d-8adc-4212-b1ee-17408fcc5913'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 21:58:21 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-f68ffba6-3a7c-4ba2-ac3d-c0bcd6fee24b tempest-VolumesActionsTest-1538864328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 21:58:21 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-f68ffba6-3a7c-4ba2-ac3d-c0bcd6fee24b tempest-VolumesActionsTest-1538864328 None] Flow 'volume_create_manager' (a37af79b-8252-48c2-adc8-91145ba7e6d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 21:58:21 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-f68ffba6-3a7c-4ba2-ac3d-c0bcd6fee24b tempest-VolumesActionsTest-1538864328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f94be5db-8e42-4ab2-9631-1b3e5093639f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:58:21 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-f68ffba6-3a7c-4ba2-ac3d-c0bcd6fee24b tempest-VolumesActionsTest-1538864328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f94be5db-8e42-4ab2-9631-1b3e5093639f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T19:58:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1311447953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03e10b16-20c7-4383-b992-eb1dbadf793c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6555200c2b1d436ba33ede26c68d1723',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T19:58:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T19:58:21Z,use_quota=True,user_id='a640cf71b55a4ac9ae3f7ab45bf518a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:58:21 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-f68ffba6-3a7c-4ba2-ac3d-c0bcd6fee24b tempest-VolumesActionsTest-1538864328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63309282-efa6-4154-975b-98b85f77d70b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:58:21 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-f68ffba6-3a7c-4ba2-ac3d-c0bcd6fee24b tempest-VolumesActionsTest-1538864328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63309282-efa6-4154-975b-98b85f77d70b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:58:21 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-f68ffba6-3a7c-4ba2-ac3d-c0bcd6fee24b tempest-VolumesActionsTest-1538864328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5dc79ef1-87dd-4562-adff-c64f8df64217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:58:21 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-f68ffba6-3a7c-4ba2-ac3d-c0bcd6fee24b tempest-VolumesActionsTest-1538864328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5dc79ef1-87dd-4562-adff-c64f8df64217) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03e10b16-20c7-4383-b992-eb1dbadf793c', 'volume_name': 'volume-03e10b16-20c7-4383-b992-eb1dbadf793c', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:58:21 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-f68ffba6-3a7c-4ba2-ac3d-c0bcd6fee24b tempest-VolumesActionsTest-1538864328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (421e09b1-3e24-4044-a133-de32a7530572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:58:21 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-f68ffba6-3a7c-4ba2-ac3d-c0bcd6fee24b tempest-VolumesActionsTest-1538864328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (421e09b1-3e24-4044-a133-de32a7530572) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:58:21 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-f68ffba6-3a7c-4ba2-ac3d-c0bcd6fee24b tempest-VolumesActionsTest-1538864328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1274788-29e1-4001-965c-dc7fb684ddcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:58:21 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-f68ffba6-3a7c-4ba2-ac3d-c0bcd6fee24b tempest-VolumesActionsTest-1538864328 None] Volume 03e10b16-20c7-4383-b992-eb1dbadf793c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03e10b16-20c7-4383-b992-eb1dbadf793c', 'volume_size': 1} Sep 17 21:58:21 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-f68ffba6-3a7c-4ba2-ac3d-c0bcd6fee24b tempest-VolumesActionsTest-1538864328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:58:21 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-f68ffba6-3a7c-4ba2-ac3d-c0bcd6fee24b tempest-VolumesActionsTest-1538864328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:58:21 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-f68ffba6-3a7c-4ba2-ac3d-c0bcd6fee24b tempest-VolumesActionsTest-1538864328 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T19:58:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1311447953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03e10b16-20c7-4383-b992-eb1dbadf793c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6555200c2b1d436ba33ede26c68d1723',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T19:58:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T19:58:21Z,use_quota=True,user_id='a640cf71b55a4ac9ae3f7ab45bf518a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 21:58:21 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-f68ffba6-3a7c-4ba2-ac3d-c0bcd6fee24b tempest-VolumesActionsTest-1538864328 None] Creating volume 03e10b16-20c7-4383-b992-eb1dbadf793c {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 21:58:21 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-f68ffba6-3a7c-4ba2-ac3d-c0bcd6fee24b tempest-VolumesActionsTest-1538864328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:58:21 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-f68ffba6-3a7c-4ba2-ac3d-c0bcd6fee24b tempest-VolumesActionsTest-1538864328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:58:21 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-f68ffba6-3a7c-4ba2-ac3d-c0bcd6fee24b tempest-VolumesActionsTest-1538864328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 21:58:21 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-f68ffba6-3a7c-4ba2-ac3d-c0bcd6fee24b tempest-VolumesActionsTest-1538864328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 21:58:21 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-f68ffba6-3a7c-4ba2-ac3d-c0bcd6fee24b tempest-VolumesActionsTest-1538864328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:58:21 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-f68ffba6-3a7c-4ba2-ac3d-c0bcd6fee24b tempest-VolumesActionsTest-1538864328 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 21:58:21 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-f68ffba6-3a7c-4ba2-ac3d-c0bcd6fee24b tempest-VolumesActionsTest-1538864328 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 21:58:21 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-f68ffba6-3a7c-4ba2-ac3d-c0bcd6fee24b tempest-VolumesActionsTest-1538864328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-03e10b16-20c7-4383-b992-eb1dbadf793c 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:58:21 devstack sudo[95560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-03e10b16-20c7-4383-b992-eb1dbadf793c 1073741824 Sep 17 21:58:21 devstack sudo[95560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:58:21 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-07b06243-7dbb-44ef-ac8d-c51dc0240a27 tempest-GroupSnapshotsTest-809568564 None] group_snapshot db86231d-4690-4edc-96c4-708cdf51c827: deleted successfully Sep 17 21:58:21 devstack sudo[95560]: pam_unix(sudo:session): session closed for user root Sep 17 21:58:21 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-f68ffba6-3a7c-4ba2-ac3d-c0bcd6fee24b tempest-VolumesActionsTest-1538864328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-03e10b16-20c7-4383-b992-eb1dbadf793c 1073741824" returned: 0 in 0.616s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:58:21 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-f68ffba6-3a7c-4ba2-ac3d-c0bcd6fee24b tempest-VolumesActionsTest-1538864328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-03e10b16-20c7-4383-b992-eb1dbadf793c {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:58:21 devstack sudo[95565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-03e10b16-20c7-4383-b992-eb1dbadf793c Sep 17 21:58:21 devstack sudo[95565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:58:22 devstack sudo[95565]: pam_unix(sudo:session): session closed for user root Sep 17 21:58:22 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-f68ffba6-3a7c-4ba2-ac3d-c0bcd6fee24b tempest-VolumesActionsTest-1538864328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-03e10b16-20c7-4383-b992-eb1dbadf793c" returned: 0 in 0.330s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:58:22 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-f68ffba6-3a7c-4ba2-ac3d-c0bcd6fee24b tempest-VolumesActionsTest-1538864328 None] <== create_volume: return (1001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 21:58:22 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-f68ffba6-3a7c-4ba2-ac3d-c0bcd6fee24b tempest-VolumesActionsTest-1538864328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.005s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:58:22 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-f68ffba6-3a7c-4ba2-ac3d-c0bcd6fee24b tempest-VolumesActionsTest-1538864328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1274788-29e1-4001-965c-dc7fb684ddcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03e10b16-20c7-4383-b992-eb1dbadf793c', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:58:22 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-f68ffba6-3a7c-4ba2-ac3d-c0bcd6fee24b tempest-VolumesActionsTest-1538864328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (daac9707-0cb3-4b59-bc78-033fe9ae3f9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:58:22 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-f68ffba6-3a7c-4ba2-ac3d-c0bcd6fee24b tempest-VolumesActionsTest-1538864328 None] Volume volume-03e10b16-20c7-4383-b992-eb1dbadf793c (03e10b16-20c7-4383-b992-eb1dbadf793c): created successfully Sep 17 21:58:22 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-f68ffba6-3a7c-4ba2-ac3d-c0bcd6fee24b tempest-VolumesActionsTest-1538864328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (daac9707-0cb3-4b59-bc78-033fe9ae3f9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:58:22 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-f68ffba6-3a7c-4ba2-ac3d-c0bcd6fee24b tempest-VolumesActionsTest-1538864328 None] Flow 'volume_create_manager' (a37af79b-8252-48c2-adc8-91145ba7e6d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 21:58:22 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-f68ffba6-3a7c-4ba2-ac3d-c0bcd6fee24b tempest-VolumesActionsTest-1538864328 None] Created volume successfully. Sep 17 21:58:22 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-cc0c307d-9dad-4a1b-af54-41dfce08c3d9 tempest-GroupSnapshotsTest-809568564 None] Acquiring lock "cinder-quobyte-c8dce848-37aa-44b4-813f-3478957d1f34" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 21:58:22 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-cc0c307d-9dad-4a1b-af54-41dfce08c3d9 tempest-GroupSnapshotsTest-809568564 None] Lock "cinder-quobyte-c8dce848-37aa-44b4-813f-3478957d1f34" acquired by "delete_volume" :: waited 0.031s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 21:58:22 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0bd3c27-22d9-4f69-8c03-ef19641af9bf]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 21:58:22 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-cc0c307d-9dad-4a1b-af54-41dfce08c3d9 tempest-GroupSnapshotsTest-809568564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c8dce848-37aa-44b4-813f-3478957d1f34 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:58:22 devstack sudo[95571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c8dce848-37aa-44b4-813f-3478957d1f34 Sep 17 21:58:22 devstack sudo[95571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:58:23 devstack sudo[95571]: pam_unix(sudo:session): session closed for user root Sep 17 21:58:23 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-cc0c307d-9dad-4a1b-af54-41dfce08c3d9 tempest-GroupSnapshotsTest-809568564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c8dce848-37aa-44b4-813f-3478957d1f34" returned: 0 in 0.581s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:58:23 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-cc0c307d-9dad-4a1b-af54-41dfce08c3d9 tempest-GroupSnapshotsTest-809568564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c8dce848-37aa-44b4-813f-3478957d1f34 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:58:23 devstack sudo[95576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c8dce848-37aa-44b4-813f-3478957d1f34 Sep 17 21:58:23 devstack sudo[95576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:58:23 devstack sudo[95576]: pam_unix(sudo:session): session closed for user root Sep 17 21:58:23 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-cc0c307d-9dad-4a1b-af54-41dfce08c3d9 tempest-GroupSnapshotsTest-809568564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c8dce848-37aa-44b4-813f-3478957d1f34" returned: 0 in 0.400s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:58:23 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-cc0c307d-9dad-4a1b-af54-41dfce08c3d9 tempest-GroupSnapshotsTest-809568564 None] Lock "cinder-quobyte-c8dce848-37aa-44b4-813f-3478957d1f34" released by "delete_volume" :: held 1.070s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 21:58:23 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-cc0c307d-9dad-4a1b-af54-41dfce08c3d9 tempest-GroupSnapshotsTest-809568564 None] Acquiring lock "cinder-quobyte-e19dcfe4-39f2-45a4-a0f1-da9d01ca6521" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 21:58:23 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-cc0c307d-9dad-4a1b-af54-41dfce08c3d9 tempest-GroupSnapshotsTest-809568564 None] Lock "cinder-quobyte-e19dcfe4-39f2-45a4-a0f1-da9d01ca6521" acquired by "delete_volume" :: waited 0.017s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 21:58:23 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[799aa43c-3508-49a8-b3f6-897f4582b9c2]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 21:58:23 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-cc0c307d-9dad-4a1b-af54-41dfce08c3d9 tempest-GroupSnapshotsTest-809568564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e19dcfe4-39f2-45a4-a0f1-da9d01ca6521 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:58:23 devstack sudo[95579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e19dcfe4-39f2-45a4-a0f1-da9d01ca6521 Sep 17 21:58:23 devstack sudo[95579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:58:24 devstack sudo[95579]: pam_unix(sudo:session): session closed for user root Sep 17 21:58:24 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-cc0c307d-9dad-4a1b-af54-41dfce08c3d9 tempest-GroupSnapshotsTest-809568564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e19dcfe4-39f2-45a4-a0f1-da9d01ca6521" returned: 0 in 0.534s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:58:24 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-cc0c307d-9dad-4a1b-af54-41dfce08c3d9 tempest-GroupSnapshotsTest-809568564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e19dcfe4-39f2-45a4-a0f1-da9d01ca6521 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:58:24 devstack sudo[95587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e19dcfe4-39f2-45a4-a0f1-da9d01ca6521 Sep 17 21:58:24 devstack sudo[95587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:58:24 devstack sudo[95587]: pam_unix(sudo:session): session closed for user root Sep 17 21:58:24 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-cc0c307d-9dad-4a1b-af54-41dfce08c3d9 tempest-GroupSnapshotsTest-809568564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e19dcfe4-39f2-45a4-a0f1-da9d01ca6521" returned: 0 in 0.319s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:58:24 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-cc0c307d-9dad-4a1b-af54-41dfce08c3d9 tempest-GroupSnapshotsTest-809568564 None] Lock "cinder-quobyte-e19dcfe4-39f2-45a4-a0f1-da9d01ca6521" released by "delete_volume" :: held 0.955s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 21:58:24 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-cc0c307d-9dad-4a1b-af54-41dfce08c3d9 tempest-GroupSnapshotsTest-809568564 None] Created reservations ['caea3ea0-7d7e-45c4-94c6-67df01cc2bba'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 21:58:24 devstack cinder-volume[85458]: WARNING cinder.quota [None req-cc0c307d-9dad-4a1b-af54-41dfce08c3d9 tempest-GroupSnapshotsTest-809568564 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1953019562 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1953019562, it is now deprecated. Please use the default quota class for default quota. Sep 17 21:58:24 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-cc0c307d-9dad-4a1b-af54-41dfce08c3d9 tempest-GroupSnapshotsTest-809568564 None] Created reservations ['bd6464db-c2df-4b3c-a674-58bf715a77d8', 'f4e84ca9-ff9c-43c1-bb30-0c29bc370dfa', '82a18806-aa83-4c2d-8e20-0c07e9e465d6', '627e59f2-5574-47bf-8291-4bd723cedf30'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 21:58:24 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-cc0c307d-9dad-4a1b-af54-41dfce08c3d9 tempest-GroupSnapshotsTest-809568564 None] Created reservations ['ac67a651-83a7-47de-9861-2f3d21c06376', 'a2f9f218-eedb-4956-9869-ffe8bdaf98c0', '3cad0a5f-7486-46e6-ad81-069d553967ac', '21571291-5427-4f4b-8502-cab68a46fe15'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 21:58:25 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-cc0c307d-9dad-4a1b-af54-41dfce08c3d9 tempest-GroupSnapshotsTest-809568564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:58:25 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-cc0c307d-9dad-4a1b-af54-41dfce08c3d9 tempest-GroupSnapshotsTest-809568564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:58:25 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-cc0c307d-9dad-4a1b-af54-41dfce08c3d9 tempest-GroupSnapshotsTest-809568564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 21:58:25 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-cc0c307d-9dad-4a1b-af54-41dfce08c3d9 tempest-GroupSnapshotsTest-809568564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 21:58:25 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-cc0c307d-9dad-4a1b-af54-41dfce08c3d9 tempest-GroupSnapshotsTest-809568564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:58:25 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-cc0c307d-9dad-4a1b-af54-41dfce08c3d9 tempest-GroupSnapshotsTest-809568564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:58:25 devstack sudo[95590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 21:58:25 devstack sudo[95590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:58:25 devstack sudo[95590]: pam_unix(sudo:session): session closed for user root Sep 17 21:58:25 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-cc0c307d-9dad-4a1b-af54-41dfce08c3d9 tempest-GroupSnapshotsTest-809568564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.404s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:58:25 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-cc0c307d-9dad-4a1b-af54-41dfce08c3d9 tempest-GroupSnapshotsTest-809568564 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 21:58:25 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-cc0c307d-9dad-4a1b-af54-41dfce08c3d9 tempest-GroupSnapshotsTest-809568564 None] Delete group completed successfully. Sep 17 21:58:25 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-8b4db728-049d-4478-aca8-bd6c774d6ed8 tempest-AttachVolumeNegativeTest-28309225 None] Acquiring lock "cinder-dfd8826c-100c-4430-a617-b6eb56ff7ec2-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 21:58:25 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-8b4db728-049d-4478-aca8-bd6c774d6ed8 tempest-AttachVolumeNegativeTest-28309225 None] Lock "cinder-dfd8826c-100c-4430-a617-b6eb56ff7ec2-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 21:58:25 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-8b4db728-049d-4478-aca8-bd6c774d6ed8 tempest-AttachVolumeNegativeTest-28309225 None] Acquiring lock "cinder-quobyte-dfd8826c-100c-4430-a617-b6eb56ff7ec2" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 21:58:26 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-8b4db728-049d-4478-aca8-bd6c774d6ed8 tempest-AttachVolumeNegativeTest-28309225 None] Lock "cinder-quobyte-dfd8826c-100c-4430-a617-b6eb56ff7ec2" acquired by "delete_volume" :: waited 0.025s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 21:58:26 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[307931fb-3a18-4771-a1f5-6dc9bd4cf6bd]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 21:58:26 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-8b4db728-049d-4478-aca8-bd6c774d6ed8 tempest-AttachVolumeNegativeTest-28309225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-dfd8826c-100c-4430-a617-b6eb56ff7ec2 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:58:26 devstack sudo[95594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-dfd8826c-100c-4430-a617-b6eb56ff7ec2 Sep 17 21:58:26 devstack sudo[95594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:58:26 devstack sudo[95594]: pam_unix(sudo:session): session closed for user root Sep 17 21:58:26 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-8b4db728-049d-4478-aca8-bd6c774d6ed8 tempest-AttachVolumeNegativeTest-28309225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-dfd8826c-100c-4430-a617-b6eb56ff7ec2" returned: 0 in 0.595s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:58:26 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-8b4db728-049d-4478-aca8-bd6c774d6ed8 tempest-AttachVolumeNegativeTest-28309225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-dfd8826c-100c-4430-a617-b6eb56ff7ec2 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:58:26 devstack sudo[95608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-dfd8826c-100c-4430-a617-b6eb56ff7ec2 Sep 17 21:58:26 devstack sudo[95608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:58:26 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-46ce16bb-dc82-45ee-9236-0c27fb076738 tempest-GroupSnapshotsTest-809568564 None] Group tempest-GroupSnapshotsTest-Group-824753581: creating Sep 17 21:58:26 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-46ce16bb-dc82-45ee-9236-0c27fb076738 tempest-GroupSnapshotsTest-809568564 None] Group tempest-GroupSnapshotsTest-Group-824753581: created successfully Sep 17 21:58:26 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-46ce16bb-dc82-45ee-9236-0c27fb076738 tempest-GroupSnapshotsTest-809568564 None] Create group completed successfully. Sep 17 21:58:27 devstack sudo[95608]: pam_unix(sudo:session): session closed for user root Sep 17 21:58:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-8b4db728-049d-4478-aca8-bd6c774d6ed8 tempest-AttachVolumeNegativeTest-28309225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-dfd8826c-100c-4430-a617-b6eb56ff7ec2" returned: 0 in 0.459s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:58:27 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-8b4db728-049d-4478-aca8-bd6c774d6ed8 tempest-AttachVolumeNegativeTest-28309225 None] Lock "cinder-quobyte-dfd8826c-100c-4430-a617-b6eb56ff7ec2" released by "delete_volume" :: held 1.114s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 21:58:27 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-8b4db728-049d-4478-aca8-bd6c774d6ed8 tempest-AttachVolumeNegativeTest-28309225 None] Created reservations ['0b1ca6d9-098d-4d79-a5eb-385625cf1f89', '71e9e9c3-68f4-454b-b3da-d48b754a16a0', '7a39efb4-65b7-48b1-a28d-41bef22455b8', 'd78c33e6-cc3b-4534-a827-84f890cdf32a'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 21:58:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-8b4db728-049d-4478-aca8-bd6c774d6ed8 tempest-AttachVolumeNegativeTest-28309225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:58:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-8b4db728-049d-4478-aca8-bd6c774d6ed8 tempest-AttachVolumeNegativeTest-28309225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:58:27 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-8b4db728-049d-4478-aca8-bd6c774d6ed8 tempest-AttachVolumeNegativeTest-28309225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 21:58:27 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-8b4db728-049d-4478-aca8-bd6c774d6ed8 tempest-AttachVolumeNegativeTest-28309225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 21:58:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-8b4db728-049d-4478-aca8-bd6c774d6ed8 tempest-AttachVolumeNegativeTest-28309225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:58:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-8b4db728-049d-4478-aca8-bd6c774d6ed8 tempest-AttachVolumeNegativeTest-28309225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:58:27 devstack sudo[95616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 21:58:27 devstack sudo[95616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:58:27 devstack sudo[95616]: pam_unix(sudo:session): session closed for user root Sep 17 21:58:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-8b4db728-049d-4478-aca8-bd6c774d6ed8 tempest-AttachVolumeNegativeTest-28309225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.261s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:58:27 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-8b4db728-049d-4478-aca8-bd6c774d6ed8 tempest-AttachVolumeNegativeTest-28309225 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 21:58:27 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-8b4db728-049d-4478-aca8-bd6c774d6ed8 tempest-AttachVolumeNegativeTest-28309225 None] Deleted volume successfully. Sep 17 21:58:27 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-8b4db728-049d-4478-aca8-bd6c774d6ed8 tempest-AttachVolumeNegativeTest-28309225 None] Lock "cinder-dfd8826c-100c-4430-a617-b6eb56ff7ec2-delete_volume" released by "delete_volume" :: held 1.688s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 21:58:27 devstack cinder-volume[85458]: DEBUG oslo_service.periodic_task [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85458) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 21:58:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:58:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:58:27 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 21:58:27 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 21:58:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:58:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:58:27 devstack sudo[95620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 21:58:27 devstack sudo[95620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:58:28 devstack sudo[95620]: pam_unix(sudo:session): session closed for user root Sep 17 21:58:28 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.431s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:58:28 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 21:58:28 devstack cinder-volume[85458]: DEBUG oslo_service.periodic_task [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Running periodic task VolumeManager._thread_info {{(pid=85458) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 21:58:28 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] thread count: 28 {{(pid=85458) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 21:58:28 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] thread info: [<_MainThread(MainThread, started 127546830999680)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85458) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 21:58:28 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-1c508df8-523a-4530-83eb-b480ab7dbe35 tempest-AttachVolumeNegativeTest-28309225 None] Acquiring lock "cinder-b65d544b-3ffb-4eed-a9d9-51264d87bab9-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 21:58:28 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-1c508df8-523a-4530-83eb-b480ab7dbe35 tempest-AttachVolumeNegativeTest-28309225 None] Lock "cinder-b65d544b-3ffb-4eed-a9d9-51264d87bab9-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 21:58:28 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-1c508df8-523a-4530-83eb-b480ab7dbe35 tempest-AttachVolumeNegativeTest-28309225 None] Acquiring lock "cinder-quobyte-b65d544b-3ffb-4eed-a9d9-51264d87bab9" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 21:58:28 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-1c508df8-523a-4530-83eb-b480ab7dbe35 tempest-AttachVolumeNegativeTest-28309225 None] Lock "cinder-quobyte-b65d544b-3ffb-4eed-a9d9-51264d87bab9" acquired by "delete_volume" :: waited 0.024s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 21:58:28 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[7059c396-82ab-4e76-8f9e-8489560a6da1]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 21:58:28 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-1c508df8-523a-4530-83eb-b480ab7dbe35 tempest-AttachVolumeNegativeTest-28309225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b65d544b-3ffb-4eed-a9d9-51264d87bab9 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:58:28 devstack sudo[95623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b65d544b-3ffb-4eed-a9d9-51264d87bab9 Sep 17 21:58:28 devstack sudo[95623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:58:28 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-e209df21-5464-4575-aab9-2e10a5022aed tempest-GroupSnapshotsTest-809568564 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 21:58:29 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e209df21-5464-4575-aab9-2e10a5022aed tempest-GroupSnapshotsTest-809568564 None] Flow 'volume_create_manager' (ced9be6f-6721-40af-96f2-542d83ea9773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 21:58:29 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e209df21-5464-4575-aab9-2e10a5022aed tempest-GroupSnapshotsTest-809568564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bee56d43-5923-45ed-9846-a56003f3e030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:58:29 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e209df21-5464-4575-aab9-2e10a5022aed tempest-GroupSnapshotsTest-809568564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bee56d43-5923-45ed-9846-a56003f3e030) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T19:58:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1916888194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7d2bf360-b99e-4aff-a0a5-1307c6b99f28,host='devstack@QuobyteHD#QuobyteHD',id=cb1eb2b3-96c4-42e1-b153-4f07b8aa5dce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5addd66fbea4ce983d8868233d58dd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T19:58:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T19:58:29Z,use_quota=True,user_id='32ad7a4fdca249cdb7b4968da545adc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3a035e3-3306-41f2-8c51-b33f10b11ce1),volume_type_id=b3a035e3-3306-41f2-8c51-b33f10b11ce1)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:58:29 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e209df21-5464-4575-aab9-2e10a5022aed tempest-GroupSnapshotsTest-809568564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91148d36-660a-4310-ab32-9359c4063584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:58:29 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e209df21-5464-4575-aab9-2e10a5022aed tempest-GroupSnapshotsTest-809568564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91148d36-660a-4310-ab32-9359c4063584) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:58:29 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e209df21-5464-4575-aab9-2e10a5022aed tempest-GroupSnapshotsTest-809568564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0820367f-54ad-41d0-a7cd-43cae9c54067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:58:29 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e209df21-5464-4575-aab9-2e10a5022aed tempest-GroupSnapshotsTest-809568564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0820367f-54ad-41d0-a7cd-43cae9c54067) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb1eb2b3-96c4-42e1-b153-4f07b8aa5dce', 'volume_name': 'volume-cb1eb2b3-96c4-42e1-b153-4f07b8aa5dce', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:58:29 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e209df21-5464-4575-aab9-2e10a5022aed tempest-GroupSnapshotsTest-809568564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66bdd9e7-9a43-4688-9595-7f25d79c5777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:58:29 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e209df21-5464-4575-aab9-2e10a5022aed tempest-GroupSnapshotsTest-809568564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66bdd9e7-9a43-4688-9595-7f25d79c5777) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:58:29 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e209df21-5464-4575-aab9-2e10a5022aed tempest-GroupSnapshotsTest-809568564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33714363-37c7-46f4-9d36-fe25543d5839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:58:29 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-e209df21-5464-4575-aab9-2e10a5022aed tempest-GroupSnapshotsTest-809568564 None] Volume cb1eb2b3-96c4-42e1-b153-4f07b8aa5dce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb1eb2b3-96c4-42e1-b153-4f07b8aa5dce', 'volume_size': 1} Sep 17 21:58:29 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e209df21-5464-4575-aab9-2e10a5022aed tempest-GroupSnapshotsTest-809568564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:58:29 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e209df21-5464-4575-aab9-2e10a5022aed tempest-GroupSnapshotsTest-809568564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:58:29 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-e209df21-5464-4575-aab9-2e10a5022aed tempest-GroupSnapshotsTest-809568564 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7d2bf360-b99e-4aff-a0a5-1307c6b99f28,created_at=2026-09-17T19:58:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1916888194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7d2bf360-b99e-4aff-a0a5-1307c6b99f28,host='devstack@QuobyteHD#QuobyteHD',id=cb1eb2b3-96c4-42e1-b153-4f07b8aa5dce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5addd66fbea4ce983d8868233d58dd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T19:58:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T19:58:29Z,use_quota=True,user_id='32ad7a4fdca249cdb7b4968da545adc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3a035e3-3306-41f2-8c51-b33f10b11ce1),volume_type_id=b3a035e3-3306-41f2-8c51-b33f10b11ce1)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 21:58:29 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-e209df21-5464-4575-aab9-2e10a5022aed tempest-GroupSnapshotsTest-809568564 None] Creating volume cb1eb2b3-96c4-42e1-b153-4f07b8aa5dce {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 21:58:29 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e209df21-5464-4575-aab9-2e10a5022aed tempest-GroupSnapshotsTest-809568564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:58:29 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e209df21-5464-4575-aab9-2e10a5022aed tempest-GroupSnapshotsTest-809568564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:58:29 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-e209df21-5464-4575-aab9-2e10a5022aed tempest-GroupSnapshotsTest-809568564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 21:58:29 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-e209df21-5464-4575-aab9-2e10a5022aed tempest-GroupSnapshotsTest-809568564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 21:58:29 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e209df21-5464-4575-aab9-2e10a5022aed tempest-GroupSnapshotsTest-809568564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:58:29 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-e209df21-5464-4575-aab9-2e10a5022aed tempest-GroupSnapshotsTest-809568564 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 21:58:29 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-e209df21-5464-4575-aab9-2e10a5022aed tempest-GroupSnapshotsTest-809568564 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 21:58:29 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e209df21-5464-4575-aab9-2e10a5022aed tempest-GroupSnapshotsTest-809568564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb1eb2b3-96c4-42e1-b153-4f07b8aa5dce 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:58:29 devstack sudo[95623]: pam_unix(sudo:session): session closed for user root Sep 17 21:58:29 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-1c508df8-523a-4530-83eb-b480ab7dbe35 tempest-AttachVolumeNegativeTest-28309225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b65d544b-3ffb-4eed-a9d9-51264d87bab9" returned: 0 in 0.568s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:58:29 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-1c508df8-523a-4530-83eb-b480ab7dbe35 tempest-AttachVolumeNegativeTest-28309225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b65d544b-3ffb-4eed-a9d9-51264d87bab9 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:58:29 devstack sudo[95630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb1eb2b3-96c4-42e1-b153-4f07b8aa5dce 1073741824 Sep 17 21:58:29 devstack sudo[95630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:58:29 devstack sudo[95631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b65d544b-3ffb-4eed-a9d9-51264d87bab9 Sep 17 21:58:29 devstack sudo[95631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:58:29 devstack sudo[95631]: pam_unix(sudo:session): session closed for user root Sep 17 21:58:29 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-1c508df8-523a-4530-83eb-b480ab7dbe35 tempest-AttachVolumeNegativeTest-28309225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b65d544b-3ffb-4eed-a9d9-51264d87bab9" returned: 0 in 0.513s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:58:29 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-1c508df8-523a-4530-83eb-b480ab7dbe35 tempest-AttachVolumeNegativeTest-28309225 None] Lock "cinder-quobyte-b65d544b-3ffb-4eed-a9d9-51264d87bab9" released by "delete_volume" :: held 1.162s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 21:58:29 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-1c508df8-523a-4530-83eb-b480ab7dbe35 tempest-AttachVolumeNegativeTest-28309225 None] Created reservations ['f098c7ee-5de2-42b8-8179-9f195efa8e22', '4d365250-8807-421b-9140-9f064557e811', '2ec36222-ba80-405c-baff-e26173c69d4c', 'ea7ab205-c254-4c34-a917-95d84012d7b0'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 21:58:30 devstack sudo[95630]: pam_unix(sudo:session): session closed for user root Sep 17 21:58:30 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e209df21-5464-4575-aab9-2e10a5022aed tempest-GroupSnapshotsTest-809568564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb1eb2b3-96c4-42e1-b153-4f07b8aa5dce 1073741824" returned: 0 in 0.937s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:58:30 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-1c508df8-523a-4530-83eb-b480ab7dbe35 tempest-AttachVolumeNegativeTest-28309225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:58:30 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-1c508df8-523a-4530-83eb-b480ab7dbe35 tempest-AttachVolumeNegativeTest-28309225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:58:30 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-1c508df8-523a-4530-83eb-b480ab7dbe35 tempest-AttachVolumeNegativeTest-28309225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 21:58:30 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-1c508df8-523a-4530-83eb-b480ab7dbe35 tempest-AttachVolumeNegativeTest-28309225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 21:58:30 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-1c508df8-523a-4530-83eb-b480ab7dbe35 tempest-AttachVolumeNegativeTest-28309225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:58:30 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-1c508df8-523a-4530-83eb-b480ab7dbe35 tempest-AttachVolumeNegativeTest-28309225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:58:30 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e209df21-5464-4575-aab9-2e10a5022aed tempest-GroupSnapshotsTest-809568564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb1eb2b3-96c4-42e1-b153-4f07b8aa5dce {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:58:30 devstack sudo[95694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 21:58:30 devstack sudo[95694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:58:30 devstack sudo[95700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb1eb2b3-96c4-42e1-b153-4f07b8aa5dce Sep 17 21:58:30 devstack sudo[95700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:58:30 devstack sudo[95694]: pam_unix(sudo:session): session closed for user root Sep 17 21:58:30 devstack sudo[95700]: pam_unix(sudo:session): session closed for user root Sep 17 21:58:30 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e209df21-5464-4575-aab9-2e10a5022aed tempest-GroupSnapshotsTest-809568564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb1eb2b3-96c4-42e1-b153-4f07b8aa5dce" returned: 0 in 0.751s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:58:30 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-e209df21-5464-4575-aab9-2e10a5022aed tempest-GroupSnapshotsTest-809568564 None] <== create_volume: return (1883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 21:58:30 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e209df21-5464-4575-aab9-2e10a5022aed tempest-GroupSnapshotsTest-809568564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.890s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:58:30 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-1c508df8-523a-4530-83eb-b480ab7dbe35 tempest-AttachVolumeNegativeTest-28309225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.850s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:58:30 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-1c508df8-523a-4530-83eb-b480ab7dbe35 tempest-AttachVolumeNegativeTest-28309225 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 21:58:31 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-1c508df8-523a-4530-83eb-b480ab7dbe35 tempest-AttachVolumeNegativeTest-28309225 None] Deleted volume successfully. Sep 17 21:58:31 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e209df21-5464-4575-aab9-2e10a5022aed tempest-GroupSnapshotsTest-809568564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33714363-37c7-46f4-9d36-fe25543d5839) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb1eb2b3-96c4-42e1-b153-4f07b8aa5dce', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:58:31 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e209df21-5464-4575-aab9-2e10a5022aed tempest-GroupSnapshotsTest-809568564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e422a45-d220-4ef4-bde2-59d8d9247521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:58:31 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-1c508df8-523a-4530-83eb-b480ab7dbe35 tempest-AttachVolumeNegativeTest-28309225 None] Lock "cinder-b65d544b-3ffb-4eed-a9d9-51264d87bab9-delete_volume" released by "delete_volume" :: held 2.670s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 21:58:31 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-e209df21-5464-4575-aab9-2e10a5022aed tempest-GroupSnapshotsTest-809568564 None] Volume volume-cb1eb2b3-96c4-42e1-b153-4f07b8aa5dce (cb1eb2b3-96c4-42e1-b153-4f07b8aa5dce): created successfully Sep 17 21:58:31 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e209df21-5464-4575-aab9-2e10a5022aed tempest-GroupSnapshotsTest-809568564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e422a45-d220-4ef4-bde2-59d8d9247521) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:58:31 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e209df21-5464-4575-aab9-2e10a5022aed tempest-GroupSnapshotsTest-809568564 None] Flow 'volume_create_manager' (ced9be6f-6721-40af-96f2-542d83ea9773) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 21:58:31 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-e209df21-5464-4575-aab9-2e10a5022aed tempest-GroupSnapshotsTest-809568564 None] Created volume successfully. Sep 17 21:58:31 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-fd7d9488-ee2d-467b-89c5-b97957935232 tempest-AttachVolumeNegativeTest-28309225 None] Acquiring lock "cinder-59d6d975-33c3-4693-affa-fadb162f9f7e-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 21:58:31 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf0c17fb-e666-46de-8326-da8f2d684b7c tempest-VolumeSnapshotQuotasNegativeTestJSON-1485610004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 21:58:31 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-cf0c17fb-e666-46de-8326-da8f2d684b7c tempest-VolumeSnapshotQuotasNegativeTestJSON-1485610004 None] Flow 'volume_create_manager' (86f635db-3af2-420d-97fd-a39b13179c4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 21:58:31 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-cf0c17fb-e666-46de-8326-da8f2d684b7c tempest-VolumeSnapshotQuotasNegativeTestJSON-1485610004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78e48cad-fd1b-48a6-b22c-e64414c16088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:58:31 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-fd7d9488-ee2d-467b-89c5-b97957935232 tempest-AttachVolumeNegativeTest-28309225 None] Lock "cinder-59d6d975-33c3-4693-affa-fadb162f9f7e-delete_volume" acquired by "delete_volume" :: waited 0.086s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 21:58:31 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-cf0c17fb-e666-46de-8326-da8f2d684b7c tempest-VolumeSnapshotQuotasNegativeTestJSON-1485610004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78e48cad-fd1b-48a6-b22c-e64414c16088) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T19:58:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1347376674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fa34491-bb6a-4979-8ec5-bdcedb7b2b0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1573a086f038424fb798fa1bc20b4ef2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T19:58:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T19:58:31Z,use_quota=True,user_id='d797043c96f44227a68bd4352ea2fdaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:58:31 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-cf0c17fb-e666-46de-8326-da8f2d684b7c tempest-VolumeSnapshotQuotasNegativeTestJSON-1485610004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5653fc89-ea77-4b72-ad8a-6ee0175a77a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:58:31 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-cf0c17fb-e666-46de-8326-da8f2d684b7c tempest-VolumeSnapshotQuotasNegativeTestJSON-1485610004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5653fc89-ea77-4b72-ad8a-6ee0175a77a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:58:31 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-cf0c17fb-e666-46de-8326-da8f2d684b7c tempest-VolumeSnapshotQuotasNegativeTestJSON-1485610004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d282ded-5b81-440d-ab58-1162226a49e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:58:31 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-cf0c17fb-e666-46de-8326-da8f2d684b7c tempest-VolumeSnapshotQuotasNegativeTestJSON-1485610004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d282ded-5b81-440d-ab58-1162226a49e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6fa34491-bb6a-4979-8ec5-bdcedb7b2b0b', 'volume_name': 'volume-6fa34491-bb6a-4979-8ec5-bdcedb7b2b0b', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:58:31 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-cf0c17fb-e666-46de-8326-da8f2d684b7c tempest-VolumeSnapshotQuotasNegativeTestJSON-1485610004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6acfc90f-beef-4d82-98df-54b223f6bdda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:58:31 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-cf0c17fb-e666-46de-8326-da8f2d684b7c tempest-VolumeSnapshotQuotasNegativeTestJSON-1485610004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6acfc90f-beef-4d82-98df-54b223f6bdda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:58:31 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-cf0c17fb-e666-46de-8326-da8f2d684b7c tempest-VolumeSnapshotQuotasNegativeTestJSON-1485610004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0efd385-5223-43a0-a64a-980fddf8b7ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:58:31 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-cf0c17fb-e666-46de-8326-da8f2d684b7c tempest-VolumeSnapshotQuotasNegativeTestJSON-1485610004 None] Volume 6fa34491-bb6a-4979-8ec5-bdcedb7b2b0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6fa34491-bb6a-4979-8ec5-bdcedb7b2b0b', 'volume_size': 1} Sep 17 21:58:31 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-cf0c17fb-e666-46de-8326-da8f2d684b7c tempest-VolumeSnapshotQuotasNegativeTestJSON-1485610004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:58:31 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-cf0c17fb-e666-46de-8326-da8f2d684b7c tempest-VolumeSnapshotQuotasNegativeTestJSON-1485610004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:58:31 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-cf0c17fb-e666-46de-8326-da8f2d684b7c tempest-VolumeSnapshotQuotasNegativeTestJSON-1485610004 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T19:58:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1347376674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fa34491-bb6a-4979-8ec5-bdcedb7b2b0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1573a086f038424fb798fa1bc20b4ef2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T19:58:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T19:58:31Z,use_quota=True,user_id='d797043c96f44227a68bd4352ea2fdaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 21:58:31 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-cf0c17fb-e666-46de-8326-da8f2d684b7c tempest-VolumeSnapshotQuotasNegativeTestJSON-1485610004 None] Creating volume 6fa34491-bb6a-4979-8ec5-bdcedb7b2b0b {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 21:58:31 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-cf0c17fb-e666-46de-8326-da8f2d684b7c tempest-VolumeSnapshotQuotasNegativeTestJSON-1485610004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:58:31 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-cf0c17fb-e666-46de-8326-da8f2d684b7c tempest-VolumeSnapshotQuotasNegativeTestJSON-1485610004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:58:31 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-cf0c17fb-e666-46de-8326-da8f2d684b7c tempest-VolumeSnapshotQuotasNegativeTestJSON-1485610004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 21:58:31 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-cf0c17fb-e666-46de-8326-da8f2d684b7c tempest-VolumeSnapshotQuotasNegativeTestJSON-1485610004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 21:58:31 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-cf0c17fb-e666-46de-8326-da8f2d684b7c tempest-VolumeSnapshotQuotasNegativeTestJSON-1485610004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:58:31 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-cf0c17fb-e666-46de-8326-da8f2d684b7c tempest-VolumeSnapshotQuotasNegativeTestJSON-1485610004 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 21:58:31 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-cf0c17fb-e666-46de-8326-da8f2d684b7c tempest-VolumeSnapshotQuotasNegativeTestJSON-1485610004 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 21:58:31 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-cf0c17fb-e666-46de-8326-da8f2d684b7c tempest-VolumeSnapshotQuotasNegativeTestJSON-1485610004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-6fa34491-bb6a-4979-8ec5-bdcedb7b2b0b 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:58:31 devstack sudo[95719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-6fa34491-bb6a-4979-8ec5-bdcedb7b2b0b 1073741824 Sep 17 21:58:31 devstack sudo[95719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:58:31 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-fd7d9488-ee2d-467b-89c5-b97957935232 tempest-AttachVolumeNegativeTest-28309225 None] Acquiring lock "cinder-quobyte-59d6d975-33c3-4693-affa-fadb162f9f7e" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 21:58:31 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-fd7d9488-ee2d-467b-89c5-b97957935232 tempest-AttachVolumeNegativeTest-28309225 None] Lock "cinder-quobyte-59d6d975-33c3-4693-affa-fadb162f9f7e" acquired by "delete_volume" :: waited 0.027s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 21:58:31 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b0d9a51-20c1-4dbf-8bcc-8b91ef7988a5]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 21:58:31 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-fd7d9488-ee2d-467b-89c5-b97957935232 tempest-AttachVolumeNegativeTest-28309225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-59d6d975-33c3-4693-affa-fadb162f9f7e {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:58:31 devstack sudo[95724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-59d6d975-33c3-4693-affa-fadb162f9f7e Sep 17 21:58:31 devstack sudo[95724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:58:32 devstack sudo[95724]: pam_unix(sudo:session): session closed for user root Sep 17 21:58:32 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-fd7d9488-ee2d-467b-89c5-b97957935232 tempest-AttachVolumeNegativeTest-28309225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-59d6d975-33c3-4693-affa-fadb162f9f7e" returned: 0 in 0.588s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:58:32 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-fd7d9488-ee2d-467b-89c5-b97957935232 tempest-AttachVolumeNegativeTest-28309225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-59d6d975-33c3-4693-affa-fadb162f9f7e {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:58:32 devstack sudo[95719]: pam_unix(sudo:session): session closed for user root Sep 17 21:58:32 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-cf0c17fb-e666-46de-8326-da8f2d684b7c tempest-VolumeSnapshotQuotasNegativeTestJSON-1485610004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-6fa34491-bb6a-4979-8ec5-bdcedb7b2b0b 1073741824" returned: 0 in 0.736s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:58:32 devstack sudo[95734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-59d6d975-33c3-4693-affa-fadb162f9f7e Sep 17 21:58:32 devstack sudo[95734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:58:32 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-cf0c17fb-e666-46de-8326-da8f2d684b7c tempest-VolumeSnapshotQuotasNegativeTestJSON-1485610004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-6fa34491-bb6a-4979-8ec5-bdcedb7b2b0b {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:58:32 devstack sudo[95736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-6fa34491-bb6a-4979-8ec5-bdcedb7b2b0b Sep 17 21:58:32 devstack sudo[95736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:58:32 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-96a16b73-9ea9-4382-bb49-b67cb9c0f45d tempest-GroupSnapshotsTest-809568564 None] GroupSnapshot dd3ebe5f-577d-494c-8665-c30b138bb57e: creating. Sep 17 21:58:32 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-96a16b73-9ea9-4382-bb49-b67cb9c0f45d tempest-GroupSnapshotsTest-809568564 None] Group snapshot dd3ebe5f-577d-494c-8665-c30b138bb57e: creating. {{(pid=85458) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 17 21:58:32 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-96a16b73-9ea9-4382-bb49-b67cb9c0f45d tempest-GroupSnapshotsTest-809568564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:58:32 devstack sudo[95734]: pam_unix(sudo:session): session closed for user root Sep 17 21:58:32 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-fd7d9488-ee2d-467b-89c5-b97957935232 tempest-AttachVolumeNegativeTest-28309225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-59d6d975-33c3-4693-affa-fadb162f9f7e" returned: 0 in 0.386s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:58:32 devstack sudo[95736]: pam_unix(sudo:session): session closed for user root Sep 17 21:58:32 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-fd7d9488-ee2d-467b-89c5-b97957935232 tempest-AttachVolumeNegativeTest-28309225 None] Lock "cinder-quobyte-59d6d975-33c3-4693-affa-fadb162f9f7e" released by "delete_volume" :: held 1.057s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 21:58:32 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-cf0c17fb-e666-46de-8326-da8f2d684b7c tempest-VolumeSnapshotQuotasNegativeTestJSON-1485610004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-6fa34491-bb6a-4979-8ec5-bdcedb7b2b0b" returned: 0 in 0.346s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:58:32 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-cf0c17fb-e666-46de-8326-da8f2d684b7c tempest-VolumeSnapshotQuotasNegativeTestJSON-1485610004 None] <== create_volume: return (1155ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 21:58:32 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-cf0c17fb-e666-46de-8326-da8f2d684b7c tempest-VolumeSnapshotQuotasNegativeTestJSON-1485610004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.158s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:58:32 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-96a16b73-9ea9-4382-bb49-b67cb9c0f45d tempest-GroupSnapshotsTest-809568564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.164s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:58:32 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-cf0c17fb-e666-46de-8326-da8f2d684b7c tempest-VolumeSnapshotQuotasNegativeTestJSON-1485610004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0efd385-5223-43a0-a64a-980fddf8b7ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fa34491-bb6a-4979-8ec5-bdcedb7b2b0b', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:58:32 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-cf0c17fb-e666-46de-8326-da8f2d684b7c tempest-VolumeSnapshotQuotasNegativeTestJSON-1485610004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dee32455-8c98-4fd6-a743-c81a8070f28b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:58:32 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-cf0c17fb-e666-46de-8326-da8f2d684b7c tempest-VolumeSnapshotQuotasNegativeTestJSON-1485610004 None] Volume volume-6fa34491-bb6a-4979-8ec5-bdcedb7b2b0b (6fa34491-bb6a-4979-8ec5-bdcedb7b2b0b): created successfully Sep 17 21:58:32 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-cf0c17fb-e666-46de-8326-da8f2d684b7c tempest-VolumeSnapshotQuotasNegativeTestJSON-1485610004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dee32455-8c98-4fd6-a743-c81a8070f28b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:58:32 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-cf0c17fb-e666-46de-8326-da8f2d684b7c tempest-VolumeSnapshotQuotasNegativeTestJSON-1485610004 None] Flow 'volume_create_manager' (86f635db-3af2-420d-97fd-a39b13179c4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 21:58:32 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-96a16b73-9ea9-4382-bb49-b67cb9c0f45d tempest-GroupSnapshotsTest-809568564 None] Creating offline snapshot d6286ff1-1ea8-4a88-b5a6-616e29ef7d90 of volume cb1eb2b3-96c4-42e1-b153-4f07b8aa5dce {{(pid=85458) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 21:58:32 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-76b8907d-8911-465e-9f0f-514e711f24ab tempest-VolumesActionsTest-1538864328 None] Acquiring lock "cinder-03e10b16-20c7-4383-b992-eb1dbadf793c" by "attach_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 21:58:32 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef18ee46-60a1-4d16-aebe-59d193f710aa]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 21:58:32 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-96a16b73-9ea9-4382-bb49-b67cb9c0f45d tempest-GroupSnapshotsTest-809568564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb1eb2b3-96c4-42e1-b153-4f07b8aa5dce {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:58:32 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-cf0c17fb-e666-46de-8326-da8f2d684b7c tempest-VolumeSnapshotQuotasNegativeTestJSON-1485610004 None] Created volume successfully. Sep 17 21:58:32 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-fd7d9488-ee2d-467b-89c5-b97957935232 tempest-AttachVolumeNegativeTest-28309225 None] Created reservations ['2018f639-4b30-4630-a059-9f8f1983d7f1', '2efb145b-c6e6-4d5b-b49a-782de7d75e1c', '5f50177f-1943-4ede-b62e-e5fffc47fe8c', '16171dca-0b1c-4d41-8e57-cce555978e18'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 21:58:32 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-76b8907d-8911-465e-9f0f-514e711f24ab tempest-VolumesActionsTest-1538864328 None] Lock "cinder-03e10b16-20c7-4383-b992-eb1dbadf793c" acquired by "attach_volume" :: waited 0.049s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 21:58:32 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-76b8907d-8911-465e-9f0f-514e711f24ab tempest-VolumesActionsTest-1538864328 None] Attaching volume 03e10b16-20c7-4383-b992-eb1dbadf793c to instance aefd27f6-bee5-4a87-ac90-447ecfdd8da9 at mountpoint /dev/vdb on host None. Sep 17 21:58:32 devstack sudo[95741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb1eb2b3-96c4-42e1-b153-4f07b8aa5dce Sep 17 21:58:32 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-fd7d9488-ee2d-467b-89c5-b97957935232 tempest-AttachVolumeNegativeTest-28309225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:58:32 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-fd7d9488-ee2d-467b-89c5-b97957935232 tempest-AttachVolumeNegativeTest-28309225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:58:32 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-fd7d9488-ee2d-467b-89c5-b97957935232 tempest-AttachVolumeNegativeTest-28309225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 21:58:32 devstack sudo[95741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:58:32 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-fd7d9488-ee2d-467b-89c5-b97957935232 tempest-AttachVolumeNegativeTest-28309225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 21:58:32 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-fd7d9488-ee2d-467b-89c5-b97957935232 tempest-AttachVolumeNegativeTest-28309225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:58:32 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-fd7d9488-ee2d-467b-89c5-b97957935232 tempest-AttachVolumeNegativeTest-28309225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:58:32 devstack sudo[95743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 21:58:32 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-76b8907d-8911-465e-9f0f-514e711f24ab tempest-VolumesActionsTest-1538864328 None] Attach volume completed successfully. Sep 17 21:58:32 devstack sudo[95743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:58:32 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-76b8907d-8911-465e-9f0f-514e711f24ab tempest-VolumesActionsTest-1538864328 None] Lock "cinder-03e10b16-20c7-4383-b992-eb1dbadf793c" released by "attach_volume" :: held 0.183s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 21:58:33 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-90264b54-3d9e-42d3-ab76-4e1f806350da tempest-VolumesActionsTest-1538864328 None] Acquiring lock "cinder-03e10b16-20c7-4383-b992-eb1dbadf793c-detach_volume" by "detach_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 21:58:33 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-90264b54-3d9e-42d3-ab76-4e1f806350da tempest-VolumesActionsTest-1538864328 None] Lock "cinder-03e10b16-20c7-4383-b992-eb1dbadf793c-detach_volume" acquired by "detach_volume" :: waited 0.049s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 21:58:33 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-90264b54-3d9e-42d3-ab76-4e1f806350da tempest-VolumesActionsTest-1538864328 None] Detaching volume 03e10b16-20c7-4383-b992-eb1dbadf793c from instance aefd27f6-bee5-4a87-ac90-447ecfdd8da9. Sep 17 21:58:33 devstack sudo[95743]: pam_unix(sudo:session): session closed for user root Sep 17 21:58:33 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-fd7d9488-ee2d-467b-89c5-b97957935232 tempest-AttachVolumeNegativeTest-28309225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.422s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:58:33 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-fd7d9488-ee2d-467b-89c5-b97957935232 tempest-AttachVolumeNegativeTest-28309225 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 21:58:33 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-fd7d9488-ee2d-467b-89c5-b97957935232 tempest-AttachVolumeNegativeTest-28309225 None] Deleted volume successfully. Sep 17 21:58:33 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-fd7d9488-ee2d-467b-89c5-b97957935232 tempest-AttachVolumeNegativeTest-28309225 None] Lock "cinder-59d6d975-33c3-4693-affa-fadb162f9f7e-delete_volume" released by "delete_volume" :: held 2.035s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 21:58:33 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-90264b54-3d9e-42d3-ab76-4e1f806350da tempest-VolumesActionsTest-1538864328 None] Detach volume completed successfully. Sep 17 21:58:33 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-90264b54-3d9e-42d3-ab76-4e1f806350da tempest-VolumesActionsTest-1538864328 None] Lock "cinder-03e10b16-20c7-4383-b992-eb1dbadf793c-detach_volume" released by "detach_volume" :: held 0.141s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 21:58:33 devstack sudo[95741]: pam_unix(sudo:session): session closed for user root Sep 17 21:58:33 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-96a16b73-9ea9-4382-bb49-b67cb9c0f45d tempest-GroupSnapshotsTest-809568564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb1eb2b3-96c4-42e1-b153-4f07b8aa5dce" returned: 0 in 0.715s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:58:33 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-96a16b73-9ea9-4382-bb49-b67cb9c0f45d tempest-GroupSnapshotsTest-809568564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb1eb2b3-96c4-42e1-b153-4f07b8aa5dce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb1eb2b3-96c4-42e1-b153-4f07b8aa5dce.d6286ff1-1ea8-4a88-b5a6-616e29ef7d90 1G {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:58:33 devstack sudo[95753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb1eb2b3-96c4-42e1-b153-4f07b8aa5dce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb1eb2b3-96c4-42e1-b153-4f07b8aa5dce.d6286ff1-1ea8-4a88-b5a6-616e29ef7d90 1G Sep 17 21:58:33 devstack sudo[95753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:58:33 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-ed94347a-db9d-49af-8e4c-2d84b4815016 tempest-VolumeSnapshotQuotasNegativeTestJSON-1485610004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:58:34 devstack sudo[95753]: pam_unix(sudo:session): session closed for user root Sep 17 21:58:34 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-96a16b73-9ea9-4382-bb49-b67cb9c0f45d tempest-GroupSnapshotsTest-809568564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb1eb2b3-96c4-42e1-b153-4f07b8aa5dce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb1eb2b3-96c4-42e1-b153-4f07b8aa5dce.d6286ff1-1ea8-4a88-b5a6-616e29ef7d90 1G" returned: 0 in 0.883s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:58:34 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-96a16b73-9ea9-4382-bb49-b67cb9c0f45d tempest-GroupSnapshotsTest-809568564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb1eb2b3-96c4-42e1-b153-4f07b8aa5dce -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb1eb2b3-96c4-42e1-b153-4f07b8aa5dce.d6286ff1-1ea8-4a88-b5a6-616e29ef7d90 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:58:34 devstack sudo[95769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb1eb2b3-96c4-42e1-b153-4f07b8aa5dce -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb1eb2b3-96c4-42e1-b153-4f07b8aa5dce.d6286ff1-1ea8-4a88-b5a6-616e29ef7d90 Sep 17 21:58:34 devstack sudo[95769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:58:34 devstack sudo[95769]: pam_unix(sudo:session): session closed for user root Sep 17 21:58:34 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-96a16b73-9ea9-4382-bb49-b67cb9c0f45d tempest-GroupSnapshotsTest-809568564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb1eb2b3-96c4-42e1-b153-4f07b8aa5dce -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb1eb2b3-96c4-42e1-b153-4f07b8aa5dce.d6286ff1-1ea8-4a88-b5a6-616e29ef7d90" returned: 0 in 0.484s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:58:34 devstack cinder-volume[85458]: WARNING cinder.volume.drivers.remotefs [None req-96a16b73-9ea9-4382-bb49-b67cb9c0f45d tempest-GroupSnapshotsTest-809568564 None] /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb1eb2b3-96c4-42e1-b153-4f07b8aa5dce.d6286ff1-1ea8-4a88-b5a6-616e29ef7d90 is being set with open permissions: ugo+rw: NotImplementedError Sep 17 21:58:34 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-96a16b73-9ea9-4382-bb49-b67cb9c0f45d tempest-GroupSnapshotsTest-809568564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb1eb2b3-96c4-42e1-b153-4f07b8aa5dce.d6286ff1-1ea8-4a88-b5a6-616e29ef7d90 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:58:34 devstack sudo[95794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb1eb2b3-96c4-42e1-b153-4f07b8aa5dce.d6286ff1-1ea8-4a88-b5a6-616e29ef7d90 Sep 17 21:58:34 devstack sudo[95794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:58:35 devstack sudo[95794]: pam_unix(sudo:session): session closed for user root Sep 17 21:58:35 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-96a16b73-9ea9-4382-bb49-b67cb9c0f45d tempest-GroupSnapshotsTest-809568564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb1eb2b3-96c4-42e1-b153-4f07b8aa5dce.d6286ff1-1ea8-4a88-b5a6-616e29ef7d90" returned: 0 in 0.312s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:58:35 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-96a16b73-9ea9-4382-bb49-b67cb9c0f45d tempest-GroupSnapshotsTest-809568564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb1eb2b3-96c4-42e1-b153-4f07b8aa5dce.info {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:58:35 devstack sudo[95798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb1eb2b3-96c4-42e1-b153-4f07b8aa5dce.info Sep 17 21:58:35 devstack sudo[95798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:58:35 devstack sudo[95798]: pam_unix(sudo:session): session closed for user root Sep 17 21:58:35 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-96a16b73-9ea9-4382-bb49-b67cb9c0f45d tempest-GroupSnapshotsTest-809568564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb1eb2b3-96c4-42e1-b153-4f07b8aa5dce.info" returned: 0 in 0.329s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:58:35 devstack cinder-volume[85458]: WARNING cinder.volume.drivers.remotefs [None req-96a16b73-9ea9-4382-bb49-b67cb9c0f45d tempest-GroupSnapshotsTest-809568564 None] /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb1eb2b3-96c4-42e1-b153-4f07b8aa5dce.info is being set with open permissions: ugo+rw: NotImplementedError Sep 17 21:58:35 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-96a16b73-9ea9-4382-bb49-b67cb9c0f45d tempest-GroupSnapshotsTest-809568564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb1eb2b3-96c4-42e1-b153-4f07b8aa5dce.info {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:58:35 devstack sudo[95801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb1eb2b3-96c4-42e1-b153-4f07b8aa5dce.info Sep 17 21:58:35 devstack sudo[95801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:58:35 devstack sudo[95801]: pam_unix(sudo:session): session closed for user root Sep 17 21:58:35 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-96a16b73-9ea9-4382-bb49-b67cb9c0f45d tempest-GroupSnapshotsTest-809568564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb1eb2b3-96c4-42e1-b153-4f07b8aa5dce.info" returned: 0 in 0.340s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:58:35 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-96a16b73-9ea9-4382-bb49-b67cb9c0f45d tempest-GroupSnapshotsTest-809568564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.339s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:58:35 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-ed94347a-db9d-49af-8e4c-2d84b4815016 tempest-VolumeSnapshotQuotasNegativeTestJSON-1485610004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.948s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:58:35 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-ed94347a-db9d-49af-8e4c-2d84b4815016 tempest-VolumeSnapshotQuotasNegativeTestJSON-1485610004 None] Creating offline snapshot 7395fbb1-e54b-4eeb-bac9-e97e2905c18b of volume 6fa34491-bb6a-4979-8ec5-bdcedb7b2b0b {{(pid=85458) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 21:58:35 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5c3d8c4-06f9-4313-b3df-7bc2f6a19675]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 21:58:35 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-ed94347a-db9d-49af-8e4c-2d84b4815016 tempest-VolumeSnapshotQuotasNegativeTestJSON-1485610004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-6fa34491-bb6a-4979-8ec5-bdcedb7b2b0b {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:58:35 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-96a16b73-9ea9-4382-bb49-b67cb9c0f45d tempest-GroupSnapshotsTest-809568564 None] group_snapshot dd3ebe5f-577d-494c-8665-c30b138bb57e: created successfully Sep 17 21:58:36 devstack sudo[95806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-6fa34491-bb6a-4979-8ec5-bdcedb7b2b0b Sep 17 21:58:36 devstack sudo[95806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:58:36 devstack sudo[95806]: pam_unix(sudo:session): session closed for user root Sep 17 21:58:36 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-ed94347a-db9d-49af-8e4c-2d84b4815016 tempest-VolumeSnapshotQuotasNegativeTestJSON-1485610004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-6fa34491-bb6a-4979-8ec5-bdcedb7b2b0b" returned: 0 in 0.458s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:58:36 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-ed94347a-db9d-49af-8e4c-2d84b4815016 tempest-VolumeSnapshotQuotasNegativeTestJSON-1485610004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-6fa34491-bb6a-4979-8ec5-bdcedb7b2b0b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-6fa34491-bb6a-4979-8ec5-bdcedb7b2b0b.7395fbb1-e54b-4eeb-bac9-e97e2905c18b 1G {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:58:36 devstack sudo[95812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-6fa34491-bb6a-4979-8ec5-bdcedb7b2b0b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-6fa34491-bb6a-4979-8ec5-bdcedb7b2b0b.7395fbb1-e54b-4eeb-bac9-e97e2905c18b 1G Sep 17 21:58:36 devstack sudo[95812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:58:36 devstack sudo[95812]: pam_unix(sudo:session): session closed for user root Sep 17 21:58:36 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-ed94347a-db9d-49af-8e4c-2d84b4815016 tempest-VolumeSnapshotQuotasNegativeTestJSON-1485610004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-6fa34491-bb6a-4979-8ec5-bdcedb7b2b0b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-6fa34491-bb6a-4979-8ec5-bdcedb7b2b0b.7395fbb1-e54b-4eeb-bac9-e97e2905c18b 1G" returned: 0 in 0.515s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:58:36 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-ed94347a-db9d-49af-8e4c-2d84b4815016 tempest-VolumeSnapshotQuotasNegativeTestJSON-1485610004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6fa34491-bb6a-4979-8ec5-bdcedb7b2b0b -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-6fa34491-bb6a-4979-8ec5-bdcedb7b2b0b.7395fbb1-e54b-4eeb-bac9-e97e2905c18b {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:58:36 devstack sudo[95818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6fa34491-bb6a-4979-8ec5-bdcedb7b2b0b -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-6fa34491-bb6a-4979-8ec5-bdcedb7b2b0b.7395fbb1-e54b-4eeb-bac9-e97e2905c18b Sep 17 21:58:36 devstack sudo[95818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:58:37 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-2fbf92fe-a619-4669-a0f8-d6c3ff869119 tempest-GroupSnapshotsTest-809568564 None] group_snapshot dd3ebe5f-577d-494c-8665-c30b138bb57e: deleting Sep 17 21:58:37 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-2fbf92fe-a619-4669-a0f8-d6c3ff869119 tempest-GroupSnapshotsTest-809568564 None] group_snapshot dd3ebe5f-577d-494c-8665-c30b138bb57e: deleting {{(pid=85458) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 17 21:58:37 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-2fbf92fe-a619-4669-a0f8-d6c3ff869119 tempest-GroupSnapshotsTest-809568564 None] Acquiring lock "cinder-quobyte-cb1eb2b3-96c4-42e1-b153-4f07b8aa5dce" by "delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 21:58:37 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-2fbf92fe-a619-4669-a0f8-d6c3ff869119 tempest-GroupSnapshotsTest-809568564 None] Lock "cinder-quobyte-cb1eb2b3-96c4-42e1-b153-4f07b8aa5dce" acquired by "delete_snapshot" :: waited 0.027s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 21:58:37 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-2fbf92fe-a619-4669-a0f8-d6c3ff869119 tempest-GroupSnapshotsTest-809568564 None] Acquiring lock "cinder-quobyte-d6286ff1-1ea8-4a88-b5a6-616e29ef7d90" by "_delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 21:58:37 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-2fbf92fe-a619-4669-a0f8-d6c3ff869119 tempest-GroupSnapshotsTest-809568564 None] Lock "cinder-quobyte-d6286ff1-1ea8-4a88-b5a6-616e29ef7d90" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 21:58:37 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-2fbf92fe-a619-4669-a0f8-d6c3ff869119 tempest-GroupSnapshotsTest-809568564 None] Deleting offline snapshot d6286ff1-1ea8-4a88-b5a6-616e29ef7d90 of volume cb1eb2b3-96c4-42e1-b153-4f07b8aa5dce {{(pid=85458) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 21:58:37 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-2fbf92fe-a619-4669-a0f8-d6c3ff869119 tempest-GroupSnapshotsTest-809568564 None] snapshot_file for this snap is: volume-cb1eb2b3-96c4-42e1-b153-4f07b8aa5dce.d6286ff1-1ea8-4a88-b5a6-616e29ef7d90 {{(pid=85458) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 21:58:37 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[2afa48df-e926-43ee-b6c4-898a104bf0fc]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 21:58:37 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-2fbf92fe-a619-4669-a0f8-d6c3ff869119 tempest-GroupSnapshotsTest-809568564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb1eb2b3-96c4-42e1-b153-4f07b8aa5dce.d6286ff1-1ea8-4a88-b5a6-616e29ef7d90 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:58:37 devstack sudo[95818]: pam_unix(sudo:session): session closed for user root Sep 17 21:58:37 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-ed94347a-db9d-49af-8e4c-2d84b4815016 tempest-VolumeSnapshotQuotasNegativeTestJSON-1485610004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6fa34491-bb6a-4979-8ec5-bdcedb7b2b0b -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-6fa34491-bb6a-4979-8ec5-bdcedb7b2b0b.7395fbb1-e54b-4eeb-bac9-e97e2905c18b" returned: 0 in 0.447s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:58:37 devstack cinder-volume[85458]: WARNING cinder.volume.drivers.remotefs [None req-ed94347a-db9d-49af-8e4c-2d84b4815016 tempest-VolumeSnapshotQuotasNegativeTestJSON-1485610004 None] /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-6fa34491-bb6a-4979-8ec5-bdcedb7b2b0b.7395fbb1-e54b-4eeb-bac9-e97e2905c18b is being set with open permissions: ugo+rw Sep 17 21:58:37 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-ed94347a-db9d-49af-8e4c-2d84b4815016 tempest-VolumeSnapshotQuotasNegativeTestJSON-1485610004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-6fa34491-bb6a-4979-8ec5-bdcedb7b2b0b.7395fbb1-e54b-4eeb-bac9-e97e2905c18b {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:58:37 devstack sudo[95824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-6fa34491-bb6a-4979-8ec5-bdcedb7b2b0b.7395fbb1-e54b-4eeb-bac9-e97e2905c18b Sep 17 21:58:37 devstack sudo[95824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:58:37 devstack sudo[95823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb1eb2b3-96c4-42e1-b153-4f07b8aa5dce.d6286ff1-1ea8-4a88-b5a6-616e29ef7d90 Sep 17 21:58:37 devstack sudo[95823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:58:37 devstack sudo[95824]: pam_unix(sudo:session): session closed for user root Sep 17 21:58:37 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-ed94347a-db9d-49af-8e4c-2d84b4815016 tempest-VolumeSnapshotQuotasNegativeTestJSON-1485610004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-6fa34491-bb6a-4979-8ec5-bdcedb7b2b0b.7395fbb1-e54b-4eeb-bac9-e97e2905c18b" returned: 0 in 0.275s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:58:37 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-ed94347a-db9d-49af-8e4c-2d84b4815016 tempest-VolumeSnapshotQuotasNegativeTestJSON-1485610004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-6fa34491-bb6a-4979-8ec5-bdcedb7b2b0b.info {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:58:37 devstack sudo[95830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-6fa34491-bb6a-4979-8ec5-bdcedb7b2b0b.info Sep 17 21:58:37 devstack sudo[95830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:58:37 devstack sudo[95823]: pam_unix(sudo:session): session closed for user root Sep 17 21:58:37 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-2fbf92fe-a619-4669-a0f8-d6c3ff869119 tempest-GroupSnapshotsTest-809568564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb1eb2b3-96c4-42e1-b153-4f07b8aa5dce.d6286ff1-1ea8-4a88-b5a6-616e29ef7d90" returned: 0 in 0.489s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:58:37 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-2fbf92fe-a619-4669-a0f8-d6c3ff869119 tempest-GroupSnapshotsTest-809568564 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb1eb2b3-96c4-42e1-b153-4f07b8aa5dce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85458) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 21:58:37 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb1edf17-cba5-4c3b-aa8d-540f3a8670d0]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 21:58:37 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-2fbf92fe-a619-4669-a0f8-d6c3ff869119 tempest-GroupSnapshotsTest-809568564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb1eb2b3-96c4-42e1-b153-4f07b8aa5dce {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:58:37 devstack sudo[95830]: pam_unix(sudo:session): session closed for user root Sep 17 21:58:37 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-ed94347a-db9d-49af-8e4c-2d84b4815016 tempest-VolumeSnapshotQuotasNegativeTestJSON-1485610004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-6fa34491-bb6a-4979-8ec5-bdcedb7b2b0b.info" returned: 0 in 0.283s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:58:37 devstack cinder-volume[85458]: WARNING cinder.volume.drivers.remotefs [None req-ed94347a-db9d-49af-8e4c-2d84b4815016 tempest-VolumeSnapshotQuotasNegativeTestJSON-1485610004 None] /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-6fa34491-bb6a-4979-8ec5-bdcedb7b2b0b.info is being set with open permissions: ugo+rw Sep 17 21:58:37 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-ed94347a-db9d-49af-8e4c-2d84b4815016 tempest-VolumeSnapshotQuotasNegativeTestJSON-1485610004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-6fa34491-bb6a-4979-8ec5-bdcedb7b2b0b.info {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:58:37 devstack sudo[95833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb1eb2b3-96c4-42e1-b153-4f07b8aa5dce Sep 17 21:58:37 devstack sudo[95833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:58:37 devstack sudo[95836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-6fa34491-bb6a-4979-8ec5-bdcedb7b2b0b.info Sep 17 21:58:37 devstack sudo[95836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:58:38 devstack sudo[95836]: pam_unix(sudo:session): session closed for user root Sep 17 21:58:38 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-ed94347a-db9d-49af-8e4c-2d84b4815016 tempest-VolumeSnapshotQuotasNegativeTestJSON-1485610004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-6fa34491-bb6a-4979-8ec5-bdcedb7b2b0b.info" returned: 0 in 0.296s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:58:38 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-ed94347a-db9d-49af-8e4c-2d84b4815016 tempest-VolumeSnapshotQuotasNegativeTestJSON-1485610004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.404s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:58:38 devstack sudo[95833]: pam_unix(sudo:session): session closed for user root Sep 17 21:58:38 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-ed94347a-db9d-49af-8e4c-2d84b4815016 tempest-VolumeSnapshotQuotasNegativeTestJSON-1485610004 None] Create snapshot completed successfully Sep 17 21:58:38 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-2fbf92fe-a619-4669-a0f8-d6c3ff869119 tempest-GroupSnapshotsTest-809568564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb1eb2b3-96c4-42e1-b153-4f07b8aa5dce" returned: 0 in 0.518s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:58:38 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-2fbf92fe-a619-4669-a0f8-d6c3ff869119 tempest-GroupSnapshotsTest-809568564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb1eb2b3-96c4-42e1-b153-4f07b8aa5dce.d6286ff1-1ea8-4a88-b5a6-616e29ef7d90 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:58:38 devstack sudo[95845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb1eb2b3-96c4-42e1-b153-4f07b8aa5dce.d6286ff1-1ea8-4a88-b5a6-616e29ef7d90 Sep 17 21:58:38 devstack sudo[95845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:58:38 devstack sudo[95845]: pam_unix(sudo:session): session closed for user root Sep 17 21:58:38 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-2fbf92fe-a619-4669-a0f8-d6c3ff869119 tempest-GroupSnapshotsTest-809568564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb1eb2b3-96c4-42e1-b153-4f07b8aa5dce.d6286ff1-1ea8-4a88-b5a6-616e29ef7d90" returned: 0 in 0.448s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:58:38 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-2fbf92fe-a619-4669-a0f8-d6c3ff869119 tempest-GroupSnapshotsTest-809568564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb1eb2b3-96c4-42e1-b153-4f07b8aa5dce.d6286ff1-1ea8-4a88-b5a6-616e29ef7d90 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:58:38 devstack sudo[95851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb1eb2b3-96c4-42e1-b153-4f07b8aa5dce.d6286ff1-1ea8-4a88-b5a6-616e29ef7d90 Sep 17 21:58:38 devstack sudo[95851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:58:39 devstack sudo[95851]: pam_unix(sudo:session): session closed for user root Sep 17 21:58:39 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-2fbf92fe-a619-4669-a0f8-d6c3ff869119 tempest-GroupSnapshotsTest-809568564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb1eb2b3-96c4-42e1-b153-4f07b8aa5dce.d6286ff1-1ea8-4a88-b5a6-616e29ef7d90" returned: 0 in 0.328s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:58:39 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-2fbf92fe-a619-4669-a0f8-d6c3ff869119 tempest-GroupSnapshotsTest-809568564 None] Lock "cinder-quobyte-d6286ff1-1ea8-4a88-b5a6-616e29ef7d90" released by "_delete_snapshot" :: held 1.962s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 21:58:39 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-2fbf92fe-a619-4669-a0f8-d6c3ff869119 tempest-GroupSnapshotsTest-809568564 None] Lock "cinder-quobyte-cb1eb2b3-96c4-42e1-b153-4f07b8aa5dce" released by "delete_snapshot" :: held 2.001s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 21:58:39 devstack cinder-volume[85458]: WARNING cinder.quota [None req-2fbf92fe-a619-4669-a0f8-d6c3ff869119 tempest-GroupSnapshotsTest-809568564 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-601372039 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-601372039, it is now deprecated. Please use the default quota class for default quota. Sep 17 21:58:39 devstack cinder-volume[85458]: WARNING cinder.quota [None req-2fbf92fe-a619-4669-a0f8-d6c3ff869119 tempest-GroupSnapshotsTest-809568564 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-601372039 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-601372039, it is now deprecated. Please use the default quota class for default quota. Sep 17 21:58:39 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-2fbf92fe-a619-4669-a0f8-d6c3ff869119 tempest-GroupSnapshotsTest-809568564 None] Created reservations ['f5f7cf5d-f5d5-4ccd-9929-013d395b8be1', '4f0f6c6d-0786-4f65-a02c-1cab1aece3f4', '663b6c4b-e6c5-4b1f-8dc3-98185df601d9', '06279659-1e43-4f7a-a11c-96bfe3a344e8'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 21:58:39 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-2fbf92fe-a619-4669-a0f8-d6c3ff869119 tempest-GroupSnapshotsTest-809568564 None] group_snapshot dd3ebe5f-577d-494c-8665-c30b138bb57e: deleted successfully Sep 17 21:58:39 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-e9690cb0-2976-4151-952c-4e21e961d921 tempest-VolumeSnapshotQuotasNegativeTestJSON-1485610004 None] Acquiring lock "cinder-7395fbb1-e54b-4eeb-bac9-e97e2905c18b-delete_snapshot" by "delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 21:58:39 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-e9690cb0-2976-4151-952c-4e21e961d921 tempest-VolumeSnapshotQuotasNegativeTestJSON-1485610004 None] Lock "cinder-7395fbb1-e54b-4eeb-bac9-e97e2905c18b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.052s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 21:58:39 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-e9690cb0-2976-4151-952c-4e21e961d921 tempest-VolumeSnapshotQuotasNegativeTestJSON-1485610004 None] Acquiring lock "cinder-quobyte-6fa34491-bb6a-4979-8ec5-bdcedb7b2b0b" by "delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 21:58:39 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-e9690cb0-2976-4151-952c-4e21e961d921 tempest-VolumeSnapshotQuotasNegativeTestJSON-1485610004 None] Lock "cinder-quobyte-6fa34491-bb6a-4979-8ec5-bdcedb7b2b0b" acquired by "delete_snapshot" :: waited 0.034s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 21:58:39 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-e9690cb0-2976-4151-952c-4e21e961d921 tempest-VolumeSnapshotQuotasNegativeTestJSON-1485610004 None] Acquiring lock "cinder-quobyte-7395fbb1-e54b-4eeb-bac9-e97e2905c18b" by "_delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 21:58:39 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-e9690cb0-2976-4151-952c-4e21e961d921 tempest-VolumeSnapshotQuotasNegativeTestJSON-1485610004 None] Lock "cinder-quobyte-7395fbb1-e54b-4eeb-bac9-e97e2905c18b" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 21:58:39 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-e9690cb0-2976-4151-952c-4e21e961d921 tempest-VolumeSnapshotQuotasNegativeTestJSON-1485610004 None] Deleting offline snapshot 7395fbb1-e54b-4eeb-bac9-e97e2905c18b of volume 6fa34491-bb6a-4979-8ec5-bdcedb7b2b0b {{(pid=85458) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 21:58:40 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-e9690cb0-2976-4151-952c-4e21e961d921 tempest-VolumeSnapshotQuotasNegativeTestJSON-1485610004 None] snapshot_file for this snap is: volume-6fa34491-bb6a-4979-8ec5-bdcedb7b2b0b.7395fbb1-e54b-4eeb-bac9-e97e2905c18b {{(pid=85458) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 21:58:40 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[3210cb6c-a397-4df7-9981-b354fd8813b8]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 21:58:40 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e9690cb0-2976-4151-952c-4e21e961d921 tempest-VolumeSnapshotQuotasNegativeTestJSON-1485610004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-6fa34491-bb6a-4979-8ec5-bdcedb7b2b0b.7395fbb1-e54b-4eeb-bac9-e97e2905c18b {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:58:40 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-0dbd9511-c43f-4f36-9cef-7214224aa5f5 tempest-GroupSnapshotsTest-809568564 None] Acquiring lock "cinder-quobyte-cb1eb2b3-96c4-42e1-b153-4f07b8aa5dce" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 21:58:40 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-0dbd9511-c43f-4f36-9cef-7214224aa5f5 tempest-GroupSnapshotsTest-809568564 None] Lock "cinder-quobyte-cb1eb2b3-96c4-42e1-b153-4f07b8aa5dce" acquired by "delete_volume" :: waited 0.039s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 21:58:40 devstack sudo[95856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-6fa34491-bb6a-4979-8ec5-bdcedb7b2b0b.7395fbb1-e54b-4eeb-bac9-e97e2905c18b Sep 17 21:58:40 devstack sudo[95856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:58:40 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[a42a577c-6f8c-419e-81e9-5630323336c7]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 21:58:40 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-0dbd9511-c43f-4f36-9cef-7214224aa5f5 tempest-GroupSnapshotsTest-809568564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb1eb2b3-96c4-42e1-b153-4f07b8aa5dce {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:58:40 devstack sudo[95859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb1eb2b3-96c4-42e1-b153-4f07b8aa5dce Sep 17 21:58:40 devstack sudo[95859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:58:40 devstack sudo[95856]: pam_unix(sudo:session): session closed for user root Sep 17 21:58:40 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e9690cb0-2976-4151-952c-4e21e961d921 tempest-VolumeSnapshotQuotasNegativeTestJSON-1485610004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-6fa34491-bb6a-4979-8ec5-bdcedb7b2b0b.7395fbb1-e54b-4eeb-bac9-e97e2905c18b" returned: 0 in 0.823s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:58:40 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-e9690cb0-2976-4151-952c-4e21e961d921 tempest-VolumeSnapshotQuotasNegativeTestJSON-1485610004 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6fa34491-bb6a-4979-8ec5-bdcedb7b2b0b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85458) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 21:58:40 devstack sudo[95859]: pam_unix(sudo:session): session closed for user root Sep 17 21:58:40 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-0dbd9511-c43f-4f36-9cef-7214224aa5f5 tempest-GroupSnapshotsTest-809568564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb1eb2b3-96c4-42e1-b153-4f07b8aa5dce" returned: 0 in 0.626s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:58:40 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-0dbd9511-c43f-4f36-9cef-7214224aa5f5 tempest-GroupSnapshotsTest-809568564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb1eb2b3-96c4-42e1-b153-4f07b8aa5dce {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:58:40 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dd0f9c1-2e1c-4bd6-ba7b-bc38055b2786]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 21:58:40 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e9690cb0-2976-4151-952c-4e21e961d921 tempest-VolumeSnapshotQuotasNegativeTestJSON-1485610004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-6fa34491-bb6a-4979-8ec5-bdcedb7b2b0b {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:58:40 devstack sudo[95883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb1eb2b3-96c4-42e1-b153-4f07b8aa5dce Sep 17 21:58:40 devstack sudo[95883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:58:41 devstack sudo[95884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-6fa34491-bb6a-4979-8ec5-bdcedb7b2b0b Sep 17 21:58:41 devstack sudo[95884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:58:41 devstack sudo[95883]: pam_unix(sudo:session): session closed for user root Sep 17 21:58:41 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-0dbd9511-c43f-4f36-9cef-7214224aa5f5 tempest-GroupSnapshotsTest-809568564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb1eb2b3-96c4-42e1-b153-4f07b8aa5dce" returned: 0 in 0.394s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:58:41 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-0dbd9511-c43f-4f36-9cef-7214224aa5f5 tempest-GroupSnapshotsTest-809568564 None] Lock "cinder-quobyte-cb1eb2b3-96c4-42e1-b153-4f07b8aa5dce" released by "delete_volume" :: held 1.180s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 21:58:41 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-0dbd9511-c43f-4f36-9cef-7214224aa5f5 tempest-GroupSnapshotsTest-809568564 None] Created reservations ['be3e2a14-2f7b-4ac8-83d3-a95dd4d6cc0e'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 21:58:41 devstack cinder-volume[85458]: WARNING cinder.quota [None req-0dbd9511-c43f-4f36-9cef-7214224aa5f5 tempest-GroupSnapshotsTest-809568564 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-601372039 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-601372039, it is now deprecated. Please use the default quota class for default quota. Sep 17 21:58:41 devstack sudo[95884]: pam_unix(sudo:session): session closed for user root Sep 17 21:58:41 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e9690cb0-2976-4151-952c-4e21e961d921 tempest-VolumeSnapshotQuotasNegativeTestJSON-1485610004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-6fa34491-bb6a-4979-8ec5-bdcedb7b2b0b" returned: 0 in 0.566s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:58:41 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e9690cb0-2976-4151-952c-4e21e961d921 tempest-VolumeSnapshotQuotasNegativeTestJSON-1485610004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-6fa34491-bb6a-4979-8ec5-bdcedb7b2b0b.7395fbb1-e54b-4eeb-bac9-e97e2905c18b {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:58:41 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-0dbd9511-c43f-4f36-9cef-7214224aa5f5 tempest-GroupSnapshotsTest-809568564 None] Created reservations ['14673cd4-5179-44f1-bb9c-0c1096a5b68e', '06c85ddb-1162-46c0-b5d4-614368001b0c', '1a838e20-937e-4968-9a46-7b08f01768c0', '0ec6cc16-37a9-4304-81fc-3a3303dd628f'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 21:58:41 devstack sudo[95891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-6fa34491-bb6a-4979-8ec5-bdcedb7b2b0b.7395fbb1-e54b-4eeb-bac9-e97e2905c18b Sep 17 21:58:41 devstack sudo[95891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:58:41 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-0dbd9511-c43f-4f36-9cef-7214224aa5f5 tempest-GroupSnapshotsTest-809568564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:58:41 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-0dbd9511-c43f-4f36-9cef-7214224aa5f5 tempest-GroupSnapshotsTest-809568564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:58:41 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-0dbd9511-c43f-4f36-9cef-7214224aa5f5 tempest-GroupSnapshotsTest-809568564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 21:58:41 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-0dbd9511-c43f-4f36-9cef-7214224aa5f5 tempest-GroupSnapshotsTest-809568564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 21:58:41 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-0dbd9511-c43f-4f36-9cef-7214224aa5f5 tempest-GroupSnapshotsTest-809568564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:58:41 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-0dbd9511-c43f-4f36-9cef-7214224aa5f5 tempest-GroupSnapshotsTest-809568564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:58:41 devstack sudo[95893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 21:58:41 devstack sudo[95893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:58:42 devstack sudo[95891]: pam_unix(sudo:session): session closed for user root Sep 17 21:58:42 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e9690cb0-2976-4151-952c-4e21e961d921 tempest-VolumeSnapshotQuotasNegativeTestJSON-1485610004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-6fa34491-bb6a-4979-8ec5-bdcedb7b2b0b.7395fbb1-e54b-4eeb-bac9-e97e2905c18b" returned: 0 in 0.505s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:58:42 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e9690cb0-2976-4151-952c-4e21e961d921 tempest-VolumeSnapshotQuotasNegativeTestJSON-1485610004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-6fa34491-bb6a-4979-8ec5-bdcedb7b2b0b.7395fbb1-e54b-4eeb-bac9-e97e2905c18b {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:58:42 devstack sudo[95893]: pam_unix(sudo:session): session closed for user root Sep 17 21:58:42 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-0dbd9511-c43f-4f36-9cef-7214224aa5f5 tempest-GroupSnapshotsTest-809568564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.342s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:58:42 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-0dbd9511-c43f-4f36-9cef-7214224aa5f5 tempest-GroupSnapshotsTest-809568564 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 21:58:42 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-0dbd9511-c43f-4f36-9cef-7214224aa5f5 tempest-GroupSnapshotsTest-809568564 None] Delete group completed successfully. Sep 17 21:58:42 devstack sudo[95899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-6fa34491-bb6a-4979-8ec5-bdcedb7b2b0b.7395fbb1-e54b-4eeb-bac9-e97e2905c18b Sep 17 21:58:42 devstack sudo[95899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:58:42 devstack sudo[95899]: pam_unix(sudo:session): session closed for user root Sep 17 21:58:42 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e9690cb0-2976-4151-952c-4e21e961d921 tempest-VolumeSnapshotQuotasNegativeTestJSON-1485610004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-6fa34491-bb6a-4979-8ec5-bdcedb7b2b0b.7395fbb1-e54b-4eeb-bac9-e97e2905c18b" returned: 0 in 0.330s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:58:42 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-e9690cb0-2976-4151-952c-4e21e961d921 tempest-VolumeSnapshotQuotasNegativeTestJSON-1485610004 None] Lock "cinder-quobyte-7395fbb1-e54b-4eeb-bac9-e97e2905c18b" released by "_delete_snapshot" :: held 2.429s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 21:58:42 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-e9690cb0-2976-4151-952c-4e21e961d921 tempest-VolumeSnapshotQuotasNegativeTestJSON-1485610004 None] Lock "cinder-quobyte-6fa34491-bb6a-4979-8ec5-bdcedb7b2b0b" released by "delete_snapshot" :: held 2.469s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 21:58:42 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-e9690cb0-2976-4151-952c-4e21e961d921 tempest-VolumeSnapshotQuotasNegativeTestJSON-1485610004 None] Created reservations ['dc450bd7-1824-428b-8bc4-843a8f90fbe2', 'fae1a951-7d6c-45fc-865f-e986450f05e2', '75f82e1d-bc9d-4a4a-a00e-5a60a0e929a0', 'd250beb4-05bc-49b7-8298-caca8978fd81'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 21:58:42 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-e9690cb0-2976-4151-952c-4e21e961d921 tempest-VolumeSnapshotQuotasNegativeTestJSON-1485610004 None] Delete snapshot completed successfully. Sep 17 21:58:42 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-e9690cb0-2976-4151-952c-4e21e961d921 tempest-VolumeSnapshotQuotasNegativeTestJSON-1485610004 None] Lock "cinder-7395fbb1-e54b-4eeb-bac9-e97e2905c18b-delete_snapshot" released by "delete_snapshot" :: held 2.640s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 21:58:43 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-4a47fd3c-9f4c-4260-9455-a21d133413dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1485610004 None] Acquiring lock "cinder-6fa34491-bb6a-4979-8ec5-bdcedb7b2b0b-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 21:58:43 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-4a47fd3c-9f4c-4260-9455-a21d133413dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1485610004 None] Lock "cinder-6fa34491-bb6a-4979-8ec5-bdcedb7b2b0b-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 21:58:43 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-4a47fd3c-9f4c-4260-9455-a21d133413dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1485610004 None] Acquiring lock "cinder-quobyte-6fa34491-bb6a-4979-8ec5-bdcedb7b2b0b" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 21:58:43 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-4a47fd3c-9f4c-4260-9455-a21d133413dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1485610004 None] Lock "cinder-quobyte-6fa34491-bb6a-4979-8ec5-bdcedb7b2b0b" acquired by "delete_volume" :: waited 0.044s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 21:58:43 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[86fc753c-6e02-4aea-b1b1-807de281d858]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 21:58:43 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-4a47fd3c-9f4c-4260-9455-a21d133413dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1485610004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-6fa34491-bb6a-4979-8ec5-bdcedb7b2b0b {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:58:43 devstack sudo[95903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-6fa34491-bb6a-4979-8ec5-bdcedb7b2b0b Sep 17 21:58:43 devstack sudo[95903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:58:44 devstack sudo[95903]: pam_unix(sudo:session): session closed for user root Sep 17 21:58:44 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-4a47fd3c-9f4c-4260-9455-a21d133413dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1485610004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-6fa34491-bb6a-4979-8ec5-bdcedb7b2b0b" returned: 0 in 0.980s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:58:44 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-4a47fd3c-9f4c-4260-9455-a21d133413dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1485610004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-6fa34491-bb6a-4979-8ec5-bdcedb7b2b0b {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:58:44 devstack sudo[95963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-6fa34491-bb6a-4979-8ec5-bdcedb7b2b0b Sep 17 21:58:44 devstack sudo[95963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:58:45 devstack sudo[95963]: pam_unix(sudo:session): session closed for user root Sep 17 21:58:45 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-4a47fd3c-9f4c-4260-9455-a21d133413dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1485610004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-6fa34491-bb6a-4979-8ec5-bdcedb7b2b0b" returned: 0 in 0.699s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:58:45 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-4a47fd3c-9f4c-4260-9455-a21d133413dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1485610004 None] Lock "cinder-quobyte-6fa34491-bb6a-4979-8ec5-bdcedb7b2b0b" released by "delete_volume" :: held 1.834s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 21:58:45 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-4a47fd3c-9f4c-4260-9455-a21d133413dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1485610004 None] Created reservations ['4023a7ce-fe10-4ede-8135-af589be273e8', 'e411dc09-895b-44cc-86cb-6c1112d8c3bc', 'f9eec2a7-e1cd-42d3-9829-6b13fd8b545b', '230d82d9-13d5-4e02-ba98-a8035f51dd74'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 21:58:45 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-4a47fd3c-9f4c-4260-9455-a21d133413dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1485610004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:58:45 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-4a47fd3c-9f4c-4260-9455-a21d133413dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1485610004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:58:45 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-4a47fd3c-9f4c-4260-9455-a21d133413dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1485610004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 21:58:45 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-4a47fd3c-9f4c-4260-9455-a21d133413dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1485610004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 21:58:45 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-4a47fd3c-9f4c-4260-9455-a21d133413dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1485610004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:58:45 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-4a47fd3c-9f4c-4260-9455-a21d133413dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1485610004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:58:45 devstack sudo[95979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 21:58:45 devstack sudo[95979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:58:45 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [req-6b8295f5-9961-4059-994a-a110ed4fc774 req-16420740-8749-48b1-b554-e119d6f9d86b tempest-VolumesSnapshotsTestJSON-12901790 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 21:58:45 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [req-6b8295f5-9961-4059-994a-a110ed4fc774 req-16420740-8749-48b1-b554-e119d6f9d86b tempest-VolumesSnapshotsTestJSON-12901790 None] Flow 'volume_create_manager' (643525c7-4173-4f30-b4f2-2ca8fb56a459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 21:58:45 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [req-6b8295f5-9961-4059-994a-a110ed4fc774 req-16420740-8749-48b1-b554-e119d6f9d86b tempest-VolumesSnapshotsTestJSON-12901790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e07ad0ed-d8b1-4c07-a504-b22246870976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:58:45 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [req-6b8295f5-9961-4059-994a-a110ed4fc774 req-16420740-8749-48b1-b554-e119d6f9d86b tempest-VolumesSnapshotsTestJSON-12901790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e07ad0ed-d8b1-4c07-a504-b22246870976) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T19:58:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-216256255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f9c8004-1c11-49ec-a025-f4a513216dcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7729ddb788534f7a9f66736b3f686b2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T19:58:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T19:58:46Z,use_quota=True,user_id='7cb32afbeb7f44a8a8962817062e526f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:58:45 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [req-6b8295f5-9961-4059-994a-a110ed4fc774 req-16420740-8749-48b1-b554-e119d6f9d86b tempest-VolumesSnapshotsTestJSON-12901790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4ff61a7-6c19-4eb0-b783-ccd94246b7a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:58:45 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [req-6b8295f5-9961-4059-994a-a110ed4fc774 req-16420740-8749-48b1-b554-e119d6f9d86b tempest-VolumesSnapshotsTestJSON-12901790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4ff61a7-6c19-4eb0-b783-ccd94246b7a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:58:45 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [req-6b8295f5-9961-4059-994a-a110ed4fc774 req-16420740-8749-48b1-b554-e119d6f9d86b tempest-VolumesSnapshotsTestJSON-12901790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd8b0089-fbf5-434d-8a38-174bdca78d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:58:45 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [req-6b8295f5-9961-4059-994a-a110ed4fc774 req-16420740-8749-48b1-b554-e119d6f9d86b tempest-VolumesSnapshotsTestJSON-12901790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd8b0089-fbf5-434d-8a38-174bdca78d1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f9c8004-1c11-49ec-a025-f4a513216dcf', 'volume_name': 'volume-5f9c8004-1c11-49ec-a025-f4a513216dcf', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:58:45 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [req-6b8295f5-9961-4059-994a-a110ed4fc774 req-16420740-8749-48b1-b554-e119d6f9d86b tempest-VolumesSnapshotsTestJSON-12901790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ad9b432-4414-420f-a802-c10e5ccc0aea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:58:45 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [req-6b8295f5-9961-4059-994a-a110ed4fc774 req-16420740-8749-48b1-b554-e119d6f9d86b tempest-VolumesSnapshotsTestJSON-12901790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ad9b432-4414-420f-a802-c10e5ccc0aea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:58:45 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [req-6b8295f5-9961-4059-994a-a110ed4fc774 req-16420740-8749-48b1-b554-e119d6f9d86b tempest-VolumesSnapshotsTestJSON-12901790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9380f8d-4dbd-4b8b-b2eb-8eddc184d896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:58:45 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [req-6b8295f5-9961-4059-994a-a110ed4fc774 req-16420740-8749-48b1-b554-e119d6f9d86b tempest-VolumesSnapshotsTestJSON-12901790 None] Volume 5f9c8004-1c11-49ec-a025-f4a513216dcf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f9c8004-1c11-49ec-a025-f4a513216dcf', 'volume_size': 1} Sep 17 21:58:45 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [req-6b8295f5-9961-4059-994a-a110ed4fc774 req-16420740-8749-48b1-b554-e119d6f9d86b tempest-VolumesSnapshotsTestJSON-12901790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:58:45 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [req-6b8295f5-9961-4059-994a-a110ed4fc774 req-16420740-8749-48b1-b554-e119d6f9d86b tempest-VolumesSnapshotsTestJSON-12901790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:58:45 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [req-6b8295f5-9961-4059-994a-a110ed4fc774 req-16420740-8749-48b1-b554-e119d6f9d86b tempest-VolumesSnapshotsTestJSON-12901790 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T19:58:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-216256255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f9c8004-1c11-49ec-a025-f4a513216dcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7729ddb788534f7a9f66736b3f686b2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T19:58:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T19:58:46Z,use_quota=True,user_id='7cb32afbeb7f44a8a8962817062e526f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 21:58:45 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [req-6b8295f5-9961-4059-994a-a110ed4fc774 req-16420740-8749-48b1-b554-e119d6f9d86b tempest-VolumesSnapshotsTestJSON-12901790 None] Creating volume 5f9c8004-1c11-49ec-a025-f4a513216dcf {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 21:58:45 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [req-6b8295f5-9961-4059-994a-a110ed4fc774 req-16420740-8749-48b1-b554-e119d6f9d86b tempest-VolumesSnapshotsTestJSON-12901790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:58:45 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [req-6b8295f5-9961-4059-994a-a110ed4fc774 req-16420740-8749-48b1-b554-e119d6f9d86b tempest-VolumesSnapshotsTestJSON-12901790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:58:45 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [req-6b8295f5-9961-4059-994a-a110ed4fc774 req-16420740-8749-48b1-b554-e119d6f9d86b tempest-VolumesSnapshotsTestJSON-12901790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 21:58:45 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [req-6b8295f5-9961-4059-994a-a110ed4fc774 req-16420740-8749-48b1-b554-e119d6f9d86b tempest-VolumesSnapshotsTestJSON-12901790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 21:58:45 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [req-6b8295f5-9961-4059-994a-a110ed4fc774 req-16420740-8749-48b1-b554-e119d6f9d86b tempest-VolumesSnapshotsTestJSON-12901790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:58:45 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [req-6b8295f5-9961-4059-994a-a110ed4fc774 req-16420740-8749-48b1-b554-e119d6f9d86b tempest-VolumesSnapshotsTestJSON-12901790 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 21:58:45 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [req-6b8295f5-9961-4059-994a-a110ed4fc774 req-16420740-8749-48b1-b554-e119d6f9d86b tempest-VolumesSnapshotsTestJSON-12901790 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 21:58:45 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [req-6b8295f5-9961-4059-994a-a110ed4fc774 req-16420740-8749-48b1-b554-e119d6f9d86b tempest-VolumesSnapshotsTestJSON-12901790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-5f9c8004-1c11-49ec-a025-f4a513216dcf 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:58:45 devstack sudo[95983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-5f9c8004-1c11-49ec-a025-f4a513216dcf 1073741824 Sep 17 21:58:45 devstack sudo[95983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:58:46 devstack sudo[95979]: pam_unix(sudo:session): session closed for user root Sep 17 21:58:46 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-4a47fd3c-9f4c-4260-9455-a21d133413dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1485610004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.652s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:58:46 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-4a47fd3c-9f4c-4260-9455-a21d133413dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1485610004 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 21:58:46 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-4a47fd3c-9f4c-4260-9455-a21d133413dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1485610004 None] Deleted volume successfully. Sep 17 21:58:46 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-4a47fd3c-9f4c-4260-9455-a21d133413dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1485610004 None] Lock "cinder-6fa34491-bb6a-4979-8ec5-bdcedb7b2b0b-delete_volume" released by "delete_volume" :: held 2.976s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 21:58:46 devstack sudo[95983]: pam_unix(sudo:session): session closed for user root Sep 17 21:58:46 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [req-6b8295f5-9961-4059-994a-a110ed4fc774 req-16420740-8749-48b1-b554-e119d6f9d86b tempest-VolumesSnapshotsTestJSON-12901790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-5f9c8004-1c11-49ec-a025-f4a513216dcf 1073741824" returned: 0 in 0.740s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:58:46 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [req-6b8295f5-9961-4059-994a-a110ed4fc774 req-16420740-8749-48b1-b554-e119d6f9d86b tempest-VolumesSnapshotsTestJSON-12901790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-5f9c8004-1c11-49ec-a025-f4a513216dcf {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:58:46 devstack sudo[95989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-5f9c8004-1c11-49ec-a025-f4a513216dcf Sep 17 21:58:46 devstack sudo[95989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:58:46 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-632db228-e1af-451a-a563-6eaa6b4370ab tempest-VolumesActionsTest-1538864328 None] Acquiring lock "cinder-03e10b16-20c7-4383-b992-eb1dbadf793c" by "attach_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 21:58:47 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-632db228-e1af-451a-a563-6eaa6b4370ab tempest-VolumesActionsTest-1538864328 None] Lock "cinder-03e10b16-20c7-4383-b992-eb1dbadf793c" acquired by "attach_volume" :: waited 0.038s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 21:58:47 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-632db228-e1af-451a-a563-6eaa6b4370ab tempest-VolumesActionsTest-1538864328 None] Attaching volume 03e10b16-20c7-4383-b992-eb1dbadf793c to instance 99c14ce6-4b10-4f11-aeec-13a4afdf996c at mountpoint /dev/vdb on host None. Sep 17 21:58:47 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-632db228-e1af-451a-a563-6eaa6b4370ab tempest-VolumesActionsTest-1538864328 None] Attach volume completed successfully. Sep 17 21:58:47 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-632db228-e1af-451a-a563-6eaa6b4370ab tempest-VolumesActionsTest-1538864328 None] Lock "cinder-03e10b16-20c7-4383-b992-eb1dbadf793c" released by "attach_volume" :: held 0.161s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 21:58:47 devstack sudo[95989]: pam_unix(sudo:session): session closed for user root Sep 17 21:58:47 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [req-6b8295f5-9961-4059-994a-a110ed4fc774 req-16420740-8749-48b1-b554-e119d6f9d86b tempest-VolumesSnapshotsTestJSON-12901790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-5f9c8004-1c11-49ec-a025-f4a513216dcf" returned: 0 in 0.563s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:58:47 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [req-6b8295f5-9961-4059-994a-a110ed4fc774 req-16420740-8749-48b1-b554-e119d6f9d86b tempest-VolumesSnapshotsTestJSON-12901790 None] <== create_volume: return (1410ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 21:58:47 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [req-6b8295f5-9961-4059-994a-a110ed4fc774 req-16420740-8749-48b1-b554-e119d6f9d86b tempest-VolumesSnapshotsTestJSON-12901790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.415s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:58:47 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [req-6b8295f5-9961-4059-994a-a110ed4fc774 req-16420740-8749-48b1-b554-e119d6f9d86b tempest-VolumesSnapshotsTestJSON-12901790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9380f8d-4dbd-4b8b-b2eb-8eddc184d896) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f9c8004-1c11-49ec-a025-f4a513216dcf', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:58:47 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [req-6b8295f5-9961-4059-994a-a110ed4fc774 req-16420740-8749-48b1-b554-e119d6f9d86b tempest-VolumesSnapshotsTestJSON-12901790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (304acddb-e448-4e4e-94b1-fa90416b3933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:58:47 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [req-6b8295f5-9961-4059-994a-a110ed4fc774 req-16420740-8749-48b1-b554-e119d6f9d86b tempest-VolumesSnapshotsTestJSON-12901790 None] Volume volume-5f9c8004-1c11-49ec-a025-f4a513216dcf (5f9c8004-1c11-49ec-a025-f4a513216dcf): created successfully Sep 17 21:58:47 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [req-6b8295f5-9961-4059-994a-a110ed4fc774 req-16420740-8749-48b1-b554-e119d6f9d86b tempest-VolumesSnapshotsTestJSON-12901790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (304acddb-e448-4e4e-94b1-fa90416b3933) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:58:47 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [req-6b8295f5-9961-4059-994a-a110ed4fc774 req-16420740-8749-48b1-b554-e119d6f9d86b tempest-VolumesSnapshotsTestJSON-12901790 None] Flow 'volume_create_manager' (643525c7-4173-4f30-b4f2-2ca8fb56a459) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 21:58:47 devstack cinder-volume[85458]: INFO cinder.volume.manager [req-6b8295f5-9961-4059-994a-a110ed4fc774 req-16420740-8749-48b1-b554-e119d6f9d86b tempest-VolumesSnapshotsTestJSON-12901790 None] Created volume successfully. Sep 17 21:58:47 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-97b79947-d766-4010-85f3-559180aaba7b tempest-VolumesActionsTest-1538864328 None] Acquiring lock "cinder-03e10b16-20c7-4383-b992-eb1dbadf793c-detach_volume" by "detach_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 21:58:47 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-97b79947-d766-4010-85f3-559180aaba7b tempest-VolumesActionsTest-1538864328 None] Lock "cinder-03e10b16-20c7-4383-b992-eb1dbadf793c-detach_volume" acquired by "detach_volume" :: waited 0.039s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 21:58:47 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-97b79947-d766-4010-85f3-559180aaba7b tempest-VolumesActionsTest-1538864328 None] Detaching volume 03e10b16-20c7-4383-b992-eb1dbadf793c from instance 99c14ce6-4b10-4f11-aeec-13a4afdf996c. Sep 17 21:58:48 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-97b79947-d766-4010-85f3-559180aaba7b tempest-VolumesActionsTest-1538864328 None] Detach volume completed successfully. Sep 17 21:58:48 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-97b79947-d766-4010-85f3-559180aaba7b tempest-VolumesActionsTest-1538864328 None] Lock "cinder-03e10b16-20c7-4383-b992-eb1dbadf793c-detach_volume" released by "detach_volume" :: held 0.108s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 21:58:48 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [req-1385e916-7224-4f38-a328-9a34473d1882 req-e2bcede2-37cb-4c00-aa46-7a6e04c42207 tempest-VolumesSnapshotsTestJSON-12901790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:58:48 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [req-1385e916-7224-4f38-a328-9a34473d1882 req-e2bcede2-37cb-4c00-aa46-7a6e04c42207 tempest-VolumesSnapshotsTestJSON-12901790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.006s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:58:48 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [req-1385e916-7224-4f38-a328-9a34473d1882 req-e2bcede2-37cb-4c00-aa46-7a6e04c42207 tempest-VolumesSnapshotsTestJSON-12901790 None] Creating offline snapshot 49c3eead-6315-436b-88d2-7ba4e8337f96 of volume 5f9c8004-1c11-49ec-a025-f4a513216dcf {{(pid=85458) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 21:58:48 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6eea307-a5c4-49f3-b210-fe3306c5de6f]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 21:58:48 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [req-1385e916-7224-4f38-a328-9a34473d1882 req-e2bcede2-37cb-4c00-aa46-7a6e04c42207 tempest-VolumesSnapshotsTestJSON-12901790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-5f9c8004-1c11-49ec-a025-f4a513216dcf {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:58:48 devstack sudo[95993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-5f9c8004-1c11-49ec-a025-f4a513216dcf Sep 17 21:58:48 devstack sudo[95993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:58:49 devstack sudo[95993]: pam_unix(sudo:session): session closed for user root Sep 17 21:58:49 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [req-1385e916-7224-4f38-a328-9a34473d1882 req-e2bcede2-37cb-4c00-aa46-7a6e04c42207 tempest-VolumesSnapshotsTestJSON-12901790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-5f9c8004-1c11-49ec-a025-f4a513216dcf" returned: 0 in 0.730s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:58:49 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [req-1385e916-7224-4f38-a328-9a34473d1882 req-e2bcede2-37cb-4c00-aa46-7a6e04c42207 tempest-VolumesSnapshotsTestJSON-12901790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-5f9c8004-1c11-49ec-a025-f4a513216dcf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-5f9c8004-1c11-49ec-a025-f4a513216dcf.49c3eead-6315-436b-88d2-7ba4e8337f96 1G {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:58:49 devstack sudo[96020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-5f9c8004-1c11-49ec-a025-f4a513216dcf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-5f9c8004-1c11-49ec-a025-f4a513216dcf.49c3eead-6315-436b-88d2-7ba4e8337f96 1G Sep 17 21:58:49 devstack sudo[96020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:58:50 devstack sudo[96020]: pam_unix(sudo:session): session closed for user root Sep 17 21:58:50 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [req-1385e916-7224-4f38-a328-9a34473d1882 req-e2bcede2-37cb-4c00-aa46-7a6e04c42207 tempest-VolumesSnapshotsTestJSON-12901790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-5f9c8004-1c11-49ec-a025-f4a513216dcf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-5f9c8004-1c11-49ec-a025-f4a513216dcf.49c3eead-6315-436b-88d2-7ba4e8337f96 1G" returned: 0 in 0.713s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:58:50 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [req-1385e916-7224-4f38-a328-9a34473d1882 req-e2bcede2-37cb-4c00-aa46-7a6e04c42207 tempest-VolumesSnapshotsTestJSON-12901790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f9c8004-1c11-49ec-a025-f4a513216dcf -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-5f9c8004-1c11-49ec-a025-f4a513216dcf.49c3eead-6315-436b-88d2-7ba4e8337f96 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:58:50 devstack sudo[96028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f9c8004-1c11-49ec-a025-f4a513216dcf -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-5f9c8004-1c11-49ec-a025-f4a513216dcf.49c3eead-6315-436b-88d2-7ba4e8337f96 Sep 17 21:58:50 devstack sudo[96028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:58:50 devstack sudo[96028]: pam_unix(sudo:session): session closed for user root Sep 17 21:58:50 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [req-1385e916-7224-4f38-a328-9a34473d1882 req-e2bcede2-37cb-4c00-aa46-7a6e04c42207 tempest-VolumesSnapshotsTestJSON-12901790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f9c8004-1c11-49ec-a025-f4a513216dcf -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-5f9c8004-1c11-49ec-a025-f4a513216dcf.49c3eead-6315-436b-88d2-7ba4e8337f96" returned: 0 in 0.422s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:58:50 devstack cinder-volume[85458]: WARNING cinder.volume.drivers.remotefs [req-1385e916-7224-4f38-a328-9a34473d1882 req-e2bcede2-37cb-4c00-aa46-7a6e04c42207 tempest-VolumesSnapshotsTestJSON-12901790 None] /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-5f9c8004-1c11-49ec-a025-f4a513216dcf.49c3eead-6315-436b-88d2-7ba4e8337f96 is being set with open permissions: ugo+rw Sep 17 21:58:50 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [req-1385e916-7224-4f38-a328-9a34473d1882 req-e2bcede2-37cb-4c00-aa46-7a6e04c42207 tempest-VolumesSnapshotsTestJSON-12901790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-5f9c8004-1c11-49ec-a025-f4a513216dcf.49c3eead-6315-436b-88d2-7ba4e8337f96 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:58:50 devstack sudo[96035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-5f9c8004-1c11-49ec-a025-f4a513216dcf.49c3eead-6315-436b-88d2-7ba4e8337f96 Sep 17 21:58:50 devstack sudo[96035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:58:50 devstack sudo[96035]: pam_unix(sudo:session): session closed for user root Sep 17 21:58:50 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [req-1385e916-7224-4f38-a328-9a34473d1882 req-e2bcede2-37cb-4c00-aa46-7a6e04c42207 tempest-VolumesSnapshotsTestJSON-12901790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-5f9c8004-1c11-49ec-a025-f4a513216dcf.49c3eead-6315-436b-88d2-7ba4e8337f96" returned: 0 in 0.302s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:58:50 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [req-1385e916-7224-4f38-a328-9a34473d1882 req-e2bcede2-37cb-4c00-aa46-7a6e04c42207 tempest-VolumesSnapshotsTestJSON-12901790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-5f9c8004-1c11-49ec-a025-f4a513216dcf.info {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:58:50 devstack sudo[96038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-5f9c8004-1c11-49ec-a025-f4a513216dcf.info Sep 17 21:58:50 devstack sudo[96038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:58:51 devstack sudo[96038]: pam_unix(sudo:session): session closed for user root Sep 17 21:58:51 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [req-1385e916-7224-4f38-a328-9a34473d1882 req-e2bcede2-37cb-4c00-aa46-7a6e04c42207 tempest-VolumesSnapshotsTestJSON-12901790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-5f9c8004-1c11-49ec-a025-f4a513216dcf.info" returned: 0 in 0.336s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:58:51 devstack cinder-volume[85458]: WARNING cinder.volume.drivers.remotefs [req-1385e916-7224-4f38-a328-9a34473d1882 req-e2bcede2-37cb-4c00-aa46-7a6e04c42207 tempest-VolumesSnapshotsTestJSON-12901790 None] /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-5f9c8004-1c11-49ec-a025-f4a513216dcf.info is being set with open permissions: ugo+rw Sep 17 21:58:51 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [req-1385e916-7224-4f38-a328-9a34473d1882 req-e2bcede2-37cb-4c00-aa46-7a6e04c42207 tempest-VolumesSnapshotsTestJSON-12901790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-5f9c8004-1c11-49ec-a025-f4a513216dcf.info {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:58:51 devstack sudo[96041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-5f9c8004-1c11-49ec-a025-f4a513216dcf.info Sep 17 21:58:51 devstack sudo[96041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:58:51 devstack sudo[96041]: pam_unix(sudo:session): session closed for user root Sep 17 21:58:51 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [req-1385e916-7224-4f38-a328-9a34473d1882 req-e2bcede2-37cb-4c00-aa46-7a6e04c42207 tempest-VolumesSnapshotsTestJSON-12901790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-5f9c8004-1c11-49ec-a025-f4a513216dcf.info" returned: 0 in 0.280s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:58:51 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [req-1385e916-7224-4f38-a328-9a34473d1882 req-e2bcede2-37cb-4c00-aa46-7a6e04c42207 tempest-VolumesSnapshotsTestJSON-12901790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.964s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:58:51 devstack cinder-volume[85458]: INFO cinder.volume.manager [req-1385e916-7224-4f38-a328-9a34473d1882 req-e2bcede2-37cb-4c00-aa46-7a6e04c42207 tempest-VolumesSnapshotsTestJSON-12901790 None] Create snapshot completed successfully Sep 17 21:58:52 devstack cinder-volume[85458]: DEBUG cinder.coordination [req-79a6eed2-1ed3-4d80-ae97-04673893d189 req-109dff21-4ffb-4360-b72b-6d657bed78bd tempest-VolumesSnapshotsTestJSON-12901790 None] Acquiring lock "cinder-49c3eead-6315-436b-88d2-7ba4e8337f96-delete_snapshot" by "delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 21:58:52 devstack cinder-volume[85458]: DEBUG cinder.coordination [req-79a6eed2-1ed3-4d80-ae97-04673893d189 req-109dff21-4ffb-4360-b72b-6d657bed78bd tempest-VolumesSnapshotsTestJSON-12901790 None] Lock "cinder-49c3eead-6315-436b-88d2-7ba4e8337f96-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 21:58:52 devstack cinder-volume[85458]: DEBUG cinder.coordination [req-79a6eed2-1ed3-4d80-ae97-04673893d189 req-109dff21-4ffb-4360-b72b-6d657bed78bd tempest-VolumesSnapshotsTestJSON-12901790 None] Acquiring lock "cinder-quobyte-5f9c8004-1c11-49ec-a025-f4a513216dcf" by "delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 21:58:52 devstack cinder-volume[85458]: DEBUG cinder.coordination [req-79a6eed2-1ed3-4d80-ae97-04673893d189 req-109dff21-4ffb-4360-b72b-6d657bed78bd tempest-VolumesSnapshotsTestJSON-12901790 None] Lock "cinder-quobyte-5f9c8004-1c11-49ec-a025-f4a513216dcf" acquired by "delete_snapshot" :: waited 0.022s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 21:58:52 devstack cinder-volume[85458]: DEBUG cinder.coordination [req-79a6eed2-1ed3-4d80-ae97-04673893d189 req-109dff21-4ffb-4360-b72b-6d657bed78bd tempest-VolumesSnapshotsTestJSON-12901790 None] Acquiring lock "cinder-quobyte-49c3eead-6315-436b-88d2-7ba4e8337f96" by "_delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 21:58:52 devstack cinder-volume[85458]: DEBUG cinder.coordination [req-79a6eed2-1ed3-4d80-ae97-04673893d189 req-109dff21-4ffb-4360-b72b-6d657bed78bd tempest-VolumesSnapshotsTestJSON-12901790 None] Lock "cinder-quobyte-49c3eead-6315-436b-88d2-7ba4e8337f96" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 21:58:52 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [req-79a6eed2-1ed3-4d80-ae97-04673893d189 req-109dff21-4ffb-4360-b72b-6d657bed78bd tempest-VolumesSnapshotsTestJSON-12901790 None] Deleting offline snapshot 49c3eead-6315-436b-88d2-7ba4e8337f96 of volume 5f9c8004-1c11-49ec-a025-f4a513216dcf {{(pid=85458) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 21:58:52 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [req-79a6eed2-1ed3-4d80-ae97-04673893d189 req-109dff21-4ffb-4360-b72b-6d657bed78bd tempest-VolumesSnapshotsTestJSON-12901790 None] snapshot_file for this snap is: volume-5f9c8004-1c11-49ec-a025-f4a513216dcf.49c3eead-6315-436b-88d2-7ba4e8337f96 {{(pid=85458) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 21:58:52 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cd44dcb-8359-4b71-8c18-b482ef058d6b]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 21:58:52 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [req-79a6eed2-1ed3-4d80-ae97-04673893d189 req-109dff21-4ffb-4360-b72b-6d657bed78bd tempest-VolumesSnapshotsTestJSON-12901790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-5f9c8004-1c11-49ec-a025-f4a513216dcf.49c3eead-6315-436b-88d2-7ba4e8337f96 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:58:52 devstack sudo[96044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-5f9c8004-1c11-49ec-a025-f4a513216dcf.49c3eead-6315-436b-88d2-7ba4e8337f96 Sep 17 21:58:52 devstack sudo[96044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:58:53 devstack sudo[96044]: pam_unix(sudo:session): session closed for user root Sep 17 21:58:53 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [req-79a6eed2-1ed3-4d80-ae97-04673893d189 req-109dff21-4ffb-4360-b72b-6d657bed78bd tempest-VolumesSnapshotsTestJSON-12901790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-5f9c8004-1c11-49ec-a025-f4a513216dcf.49c3eead-6315-436b-88d2-7ba4e8337f96" returned: 0 in 0.487s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:58:53 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [req-79a6eed2-1ed3-4d80-ae97-04673893d189 req-109dff21-4ffb-4360-b72b-6d657bed78bd tempest-VolumesSnapshotsTestJSON-12901790 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5f9c8004-1c11-49ec-a025-f4a513216dcf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85458) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 21:58:53 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd415dfb-1574-423a-a7a1-a31fcd31b6c1]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 21:58:53 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [req-79a6eed2-1ed3-4d80-ae97-04673893d189 req-109dff21-4ffb-4360-b72b-6d657bed78bd tempest-VolumesSnapshotsTestJSON-12901790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-5f9c8004-1c11-49ec-a025-f4a513216dcf {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:58:53 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-f4064dc3-259c-4605-aba9-058fb52e4474 tempest-GroupSnapshotsV319Test-528185915 None] Group tempest-GroupSnapshotsV319Test-Group-1216798658: creating Sep 17 21:58:53 devstack sudo[96049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-5f9c8004-1c11-49ec-a025-f4a513216dcf Sep 17 21:58:53 devstack sudo[96049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:58:53 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-f4064dc3-259c-4605-aba9-058fb52e4474 tempest-GroupSnapshotsV319Test-528185915 None] Group tempest-GroupSnapshotsV319Test-Group-1216798658: created successfully Sep 17 21:58:53 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-f4064dc3-259c-4605-aba9-058fb52e4474 tempest-GroupSnapshotsV319Test-528185915 None] Create group completed successfully. Sep 17 21:58:53 devstack sudo[96049]: pam_unix(sudo:session): session closed for user root Sep 17 21:58:53 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [req-79a6eed2-1ed3-4d80-ae97-04673893d189 req-109dff21-4ffb-4360-b72b-6d657bed78bd tempest-VolumesSnapshotsTestJSON-12901790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-5f9c8004-1c11-49ec-a025-f4a513216dcf" returned: 0 in 0.399s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:58:53 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [req-79a6eed2-1ed3-4d80-ae97-04673893d189 req-109dff21-4ffb-4360-b72b-6d657bed78bd tempest-VolumesSnapshotsTestJSON-12901790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-5f9c8004-1c11-49ec-a025-f4a513216dcf.49c3eead-6315-436b-88d2-7ba4e8337f96 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:58:53 devstack sudo[96055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-5f9c8004-1c11-49ec-a025-f4a513216dcf.49c3eead-6315-436b-88d2-7ba4e8337f96 Sep 17 21:58:53 devstack sudo[96055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:58:53 devstack sudo[96055]: pam_unix(sudo:session): session closed for user root Sep 17 21:58:53 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [req-79a6eed2-1ed3-4d80-ae97-04673893d189 req-109dff21-4ffb-4360-b72b-6d657bed78bd tempest-VolumesSnapshotsTestJSON-12901790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-5f9c8004-1c11-49ec-a025-f4a513216dcf.49c3eead-6315-436b-88d2-7ba4e8337f96" returned: 0 in 0.350s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:58:53 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [req-79a6eed2-1ed3-4d80-ae97-04673893d189 req-109dff21-4ffb-4360-b72b-6d657bed78bd tempest-VolumesSnapshotsTestJSON-12901790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-5f9c8004-1c11-49ec-a025-f4a513216dcf.49c3eead-6315-436b-88d2-7ba4e8337f96 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:58:54 devstack sudo[96060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-5f9c8004-1c11-49ec-a025-f4a513216dcf.49c3eead-6315-436b-88d2-7ba4e8337f96 Sep 17 21:58:54 devstack sudo[96060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:58:54 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-5a398c98-935e-46cf-8324-cc220387d368 tempest-VolumesActionsTest-1538864328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:58:54 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-5a398c98-935e-46cf-8324-cc220387d368 tempest-VolumesActionsTest-1538864328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:58:54 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[bca1ceba-c521-4c25-b895-9e96adb4e712]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 21:58:54 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-5a398c98-935e-46cf-8324-cc220387d368 tempest-VolumesActionsTest-1538864328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-03e10b16-20c7-4383-b992-eb1dbadf793c {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:58:54 devstack sudo[96062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-03e10b16-20c7-4383-b992-eb1dbadf793c Sep 17 21:58:54 devstack sudo[96062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:58:54 devstack sudo[96060]: pam_unix(sudo:session): session closed for user root Sep 17 21:58:54 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [req-79a6eed2-1ed3-4d80-ae97-04673893d189 req-109dff21-4ffb-4360-b72b-6d657bed78bd tempest-VolumesSnapshotsTestJSON-12901790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-5f9c8004-1c11-49ec-a025-f4a513216dcf.49c3eead-6315-436b-88d2-7ba4e8337f96" returned: 0 in 0.287s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:58:54 devstack cinder-volume[85458]: DEBUG cinder.coordination [req-79a6eed2-1ed3-4d80-ae97-04673893d189 req-109dff21-4ffb-4360-b72b-6d657bed78bd tempest-VolumesSnapshotsTestJSON-12901790 None] Lock "cinder-quobyte-49c3eead-6315-436b-88d2-7ba4e8337f96" released by "_delete_snapshot" :: held 1.678s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 21:58:54 devstack cinder-volume[85458]: DEBUG cinder.coordination [req-79a6eed2-1ed3-4d80-ae97-04673893d189 req-109dff21-4ffb-4360-b72b-6d657bed78bd tempest-VolumesSnapshotsTestJSON-12901790 None] Lock "cinder-quobyte-5f9c8004-1c11-49ec-a025-f4a513216dcf" released by "delete_snapshot" :: held 1.710s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 21:58:54 devstack cinder-volume[85458]: DEBUG cinder.quota [req-79a6eed2-1ed3-4d80-ae97-04673893d189 req-109dff21-4ffb-4360-b72b-6d657bed78bd tempest-VolumesSnapshotsTestJSON-12901790 None] Created reservations ['8815bee4-77e8-4d11-9cd9-4af65c49d4b9', 'ed5cbe2c-6230-4b3a-8d88-8f0af582678c', 'e29f72b8-8a82-49ad-8b67-58a1250ae30b', '98b32602-53f3-4312-ae86-9085318b2ec9'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 21:58:54 devstack cinder-volume[85458]: INFO cinder.volume.manager [req-79a6eed2-1ed3-4d80-ae97-04673893d189 req-109dff21-4ffb-4360-b72b-6d657bed78bd tempest-VolumesSnapshotsTestJSON-12901790 None] Delete snapshot completed successfully. Sep 17 21:58:54 devstack cinder-volume[85458]: DEBUG cinder.coordination [req-79a6eed2-1ed3-4d80-ae97-04673893d189 req-109dff21-4ffb-4360-b72b-6d657bed78bd tempest-VolumesSnapshotsTestJSON-12901790 None] Lock "cinder-49c3eead-6315-436b-88d2-7ba4e8337f96-delete_snapshot" released by "delete_snapshot" :: held 1.890s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 21:58:54 devstack sudo[96062]: pam_unix(sudo:session): session closed for user root Sep 17 21:58:54 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-5a398c98-935e-46cf-8324-cc220387d368 tempest-VolumesActionsTest-1538864328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-03e10b16-20c7-4383-b992-eb1dbadf793c" returned: 0 in 0.452s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:58:54 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fa44c6a-e03c-4ac9-a426-359e8bc115e8]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 21:58:54 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-5a398c98-935e-46cf-8324-cc220387d368 tempest-VolumesActionsTest-1538864328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-03e10b16-20c7-4383-b992-eb1dbadf793c {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:58:54 devstack sudo[96068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-03e10b16-20c7-4383-b992-eb1dbadf793c Sep 17 21:58:54 devstack sudo[96068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:58:54 devstack sudo[96068]: pam_unix(sudo:session): session closed for user root Sep 17 21:58:54 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-5a398c98-935e-46cf-8324-cc220387d368 tempest-VolumesActionsTest-1538864328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-03e10b16-20c7-4383-b992-eb1dbadf793c" returned: 0 in 0.478s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:58:55 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-5a398c98-935e-46cf-8324-cc220387d368 tempest-VolumesActionsTest-1538864328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-03e10b16-20c7-4383-b992-eb1dbadf793c /opt/stack/data/cinder/conversion/03e10b16-20c7-4383-b992-eb1dbadf793c.temp_image.17980581-39b3-47ff-a783-7e55ae541138gwqylfns.img {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:58:55 devstack sudo[96073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-03e10b16-20c7-4383-b992-eb1dbadf793c /opt/stack/data/cinder/conversion/03e10b16-20c7-4383-b992-eb1dbadf793c.temp_image.17980581-39b3-47ff-a783-7e55ae541138gwqylfns.img Sep 17 21:58:55 devstack sudo[96073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:58:55 devstack cinder-volume[85458]: DEBUG cinder.coordination [req-ff722fdf-d8e8-4a21-b7f5-0024b3972179 req-32f209de-ff7e-4542-9b6b-3489d59450b6 tempest-VolumesSnapshotsTestJSON-12901790 None] Acquiring lock "cinder-5f9c8004-1c11-49ec-a025-f4a513216dcf-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 21:58:55 devstack cinder-volume[85458]: DEBUG cinder.coordination [req-ff722fdf-d8e8-4a21-b7f5-0024b3972179 req-32f209de-ff7e-4542-9b6b-3489d59450b6 tempest-VolumesSnapshotsTestJSON-12901790 None] Lock "cinder-5f9c8004-1c11-49ec-a025-f4a513216dcf-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 21:58:55 devstack cinder-volume[85458]: DEBUG cinder.coordination [req-ff722fdf-d8e8-4a21-b7f5-0024b3972179 req-32f209de-ff7e-4542-9b6b-3489d59450b6 tempest-VolumesSnapshotsTestJSON-12901790 None] Acquiring lock "cinder-quobyte-5f9c8004-1c11-49ec-a025-f4a513216dcf" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 21:58:55 devstack cinder-volume[85458]: DEBUG cinder.coordination [req-ff722fdf-d8e8-4a21-b7f5-0024b3972179 req-32f209de-ff7e-4542-9b6b-3489d59450b6 tempest-VolumesSnapshotsTestJSON-12901790 None] Lock "cinder-quobyte-5f9c8004-1c11-49ec-a025-f4a513216dcf" acquired by "delete_volume" :: waited 0.015s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 21:58:55 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed357e58-5a23-40b7-9e0e-467b55bceedb]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 21:58:55 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [req-ff722fdf-d8e8-4a21-b7f5-0024b3972179 req-32f209de-ff7e-4542-9b6b-3489d59450b6 tempest-VolumesSnapshotsTestJSON-12901790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-5f9c8004-1c11-49ec-a025-f4a513216dcf {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:58:55 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d690611-201d-4be2-b23b-48b80b53ec65 tempest-GroupSnapshotsV319Test-528185915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 21:58:55 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-0d690611-201d-4be2-b23b-48b80b53ec65 tempest-GroupSnapshotsV319Test-528185915 None] Flow 'volume_create_manager' (72ce8c82-875e-4cc6-9b6e-c304a5eca2dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 21:58:55 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-0d690611-201d-4be2-b23b-48b80b53ec65 tempest-GroupSnapshotsV319Test-528185915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11d7f3c8-de70-4308-802b-394bd02a7e61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:58:55 devstack sudo[96078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-5f9c8004-1c11-49ec-a025-f4a513216dcf Sep 17 21:58:55 devstack sudo[96078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:58:55 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-0d690611-201d-4be2-b23b-48b80b53ec65 tempest-GroupSnapshotsV319Test-528185915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11d7f3c8-de70-4308-802b-394bd02a7e61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T19:58:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1015347241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=24384c9c-069d-4ada-83e7-b96fdebcdfc9,host='devstack@QuobyteHD#QuobyteHD',id=c162b940-7d4b-478e-9f89-530b75d8fd1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84785a1f12ba4c63ad6afa9e49949a3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T19:58:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T19:58:55Z,use_quota=True,user_id='ad970dc5141e485e86144d3b0d3749af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d203970c-ec97-4031-a9e5-01971285c3d0),volume_type_id=d203970c-ec97-4031-a9e5-01971285c3d0)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:58:55 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-0d690611-201d-4be2-b23b-48b80b53ec65 tempest-GroupSnapshotsV319Test-528185915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37c526e4-4d15-4413-8e71-2d00a4bdc0f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:58:55 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-0d690611-201d-4be2-b23b-48b80b53ec65 tempest-GroupSnapshotsV319Test-528185915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37c526e4-4d15-4413-8e71-2d00a4bdc0f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:58:55 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-0d690611-201d-4be2-b23b-48b80b53ec65 tempest-GroupSnapshotsV319Test-528185915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4056826d-1f61-402a-81bd-b23bf6099cad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:58:55 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-0d690611-201d-4be2-b23b-48b80b53ec65 tempest-GroupSnapshotsV319Test-528185915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4056826d-1f61-402a-81bd-b23bf6099cad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c162b940-7d4b-478e-9f89-530b75d8fd1e', 'volume_name': 'volume-c162b940-7d4b-478e-9f89-530b75d8fd1e', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:58:55 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-0d690611-201d-4be2-b23b-48b80b53ec65 tempest-GroupSnapshotsV319Test-528185915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e65cd82c-d2a0-478c-9b3a-f73cd90b08a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:58:55 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-0d690611-201d-4be2-b23b-48b80b53ec65 tempest-GroupSnapshotsV319Test-528185915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e65cd82c-d2a0-478c-9b3a-f73cd90b08a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:58:55 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-0d690611-201d-4be2-b23b-48b80b53ec65 tempest-GroupSnapshotsV319Test-528185915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0c0ee39-ae31-4471-8fb3-373bf406e0d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:58:55 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-0d690611-201d-4be2-b23b-48b80b53ec65 tempest-GroupSnapshotsV319Test-528185915 None] Volume c162b940-7d4b-478e-9f89-530b75d8fd1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c162b940-7d4b-478e-9f89-530b75d8fd1e', 'volume_size': 1} Sep 17 21:58:55 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-0d690611-201d-4be2-b23b-48b80b53ec65 tempest-GroupSnapshotsV319Test-528185915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:58:55 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-b50cbff3-3ab9-4d4f-8902-9430b76e4494 tempest-VolumeTypesAccessTest-1166424292 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 21:58:55 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b50cbff3-3ab9-4d4f-8902-9430b76e4494 tempest-VolumeTypesAccessTest-1166424292 None] Flow 'volume_create_manager' (738f4828-ca9d-4c2e-a2c7-edea72d27169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 21:58:55 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b50cbff3-3ab9-4d4f-8902-9430b76e4494 tempest-VolumeTypesAccessTest-1166424292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a3f1c63-88ac-4de5-9108-fc96fb0e609f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:58:55 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b50cbff3-3ab9-4d4f-8902-9430b76e4494 tempest-VolumeTypesAccessTest-1166424292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a3f1c63-88ac-4de5-9108-fc96fb0e609f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T19:58:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1712346620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d3fb668-31f1-453f-b20e-9b02f836f3c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7918c88a71343ba81c864757182b2d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T19:58:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T19:58:55Z,use_quota=True,user_id='4cc9c19a74444b5d8ce06d9d82c6c25e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5b7d52e-4c0a-4125-9f3d-19bfa19a7827),volume_type_id=e5b7d52e-4c0a-4125-9f3d-19bfa19a7827)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:58:55 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b50cbff3-3ab9-4d4f-8902-9430b76e4494 tempest-VolumeTypesAccessTest-1166424292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6153f1a8-63dd-41e8-85ad-e5f2f34d00ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:58:55 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b50cbff3-3ab9-4d4f-8902-9430b76e4494 tempest-VolumeTypesAccessTest-1166424292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6153f1a8-63dd-41e8-85ad-e5f2f34d00ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:58:55 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b50cbff3-3ab9-4d4f-8902-9430b76e4494 tempest-VolumeTypesAccessTest-1166424292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5453c3fe-39fb-4dfb-b915-8c92f729cb92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:58:55 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b50cbff3-3ab9-4d4f-8902-9430b76e4494 tempest-VolumeTypesAccessTest-1166424292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5453c3fe-39fb-4dfb-b915-8c92f729cb92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d3fb668-31f1-453f-b20e-9b02f836f3c8', 'volume_name': 'volume-6d3fb668-31f1-453f-b20e-9b02f836f3c8', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:58:55 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b50cbff3-3ab9-4d4f-8902-9430b76e4494 tempest-VolumeTypesAccessTest-1166424292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e898749-622a-411c-ac3f-2dba4bdb855f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:58:55 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b50cbff3-3ab9-4d4f-8902-9430b76e4494 tempest-VolumeTypesAccessTest-1166424292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e898749-622a-411c-ac3f-2dba4bdb855f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:58:55 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b50cbff3-3ab9-4d4f-8902-9430b76e4494 tempest-VolumeTypesAccessTest-1166424292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5072b0be-b66b-4e58-b0d1-92a6327f240a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:58:55 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-b50cbff3-3ab9-4d4f-8902-9430b76e4494 tempest-VolumeTypesAccessTest-1166424292 None] Volume 6d3fb668-31f1-453f-b20e-9b02f836f3c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d3fb668-31f1-453f-b20e-9b02f836f3c8', 'volume_size': 1} Sep 17 21:58:55 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-b50cbff3-3ab9-4d4f-8902-9430b76e4494 tempest-VolumeTypesAccessTest-1166424292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:58:55 devstack sudo[96078]: pam_unix(sudo:session): session closed for user root Sep 17 21:58:55 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [req-ff722fdf-d8e8-4a21-b7f5-0024b3972179 req-32f209de-ff7e-4542-9b6b-3489d59450b6 tempest-VolumesSnapshotsTestJSON-12901790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-5f9c8004-1c11-49ec-a025-f4a513216dcf" returned: 0 in 0.571s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:58:55 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [req-ff722fdf-d8e8-4a21-b7f5-0024b3972179 req-32f209de-ff7e-4542-9b6b-3489d59450b6 tempest-VolumesSnapshotsTestJSON-12901790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-5f9c8004-1c11-49ec-a025-f4a513216dcf {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:58:55 devstack sudo[96091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-5f9c8004-1c11-49ec-a025-f4a513216dcf Sep 17 21:58:55 devstack sudo[96091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:58:56 devstack sudo[96091]: pam_unix(sudo:session): session closed for user root Sep 17 21:58:56 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [req-ff722fdf-d8e8-4a21-b7f5-0024b3972179 req-32f209de-ff7e-4542-9b6b-3489d59450b6 tempest-VolumesSnapshotsTestJSON-12901790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-5f9c8004-1c11-49ec-a025-f4a513216dcf" returned: 0 in 0.437s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:58:56 devstack cinder-volume[85458]: DEBUG cinder.coordination [req-ff722fdf-d8e8-4a21-b7f5-0024b3972179 req-32f209de-ff7e-4542-9b6b-3489d59450b6 tempest-VolumesSnapshotsTestJSON-12901790 None] Lock "cinder-quobyte-5f9c8004-1c11-49ec-a025-f4a513216dcf" released by "delete_volume" :: held 1.101s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 21:58:56 devstack cinder-volume[85458]: DEBUG cinder.quota [req-ff722fdf-d8e8-4a21-b7f5-0024b3972179 req-32f209de-ff7e-4542-9b6b-3489d59450b6 tempest-VolumesSnapshotsTestJSON-12901790 None] Created reservations ['2224573d-65c2-428d-940a-c728b0945634', '00dad1bd-5abd-4586-b1b2-f0562db9c2cf', '0468b6c3-4e36-4190-b1d5-44e3ff5e467d', '34e4fd2b-5c08-4462-a3ca-19c20830e9bd'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 21:58:56 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [req-ff722fdf-d8e8-4a21-b7f5-0024b3972179 req-32f209de-ff7e-4542-9b6b-3489d59450b6 tempest-VolumesSnapshotsTestJSON-12901790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:58:56 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [req-ff722fdf-d8e8-4a21-b7f5-0024b3972179 req-32f209de-ff7e-4542-9b6b-3489d59450b6 tempest-VolumesSnapshotsTestJSON-12901790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:58:56 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [req-ff722fdf-d8e8-4a21-b7f5-0024b3972179 req-32f209de-ff7e-4542-9b6b-3489d59450b6 tempest-VolumesSnapshotsTestJSON-12901790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 21:58:56 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [req-ff722fdf-d8e8-4a21-b7f5-0024b3972179 req-32f209de-ff7e-4542-9b6b-3489d59450b6 tempest-VolumesSnapshotsTestJSON-12901790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 21:58:56 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [req-ff722fdf-d8e8-4a21-b7f5-0024b3972179 req-32f209de-ff7e-4542-9b6b-3489d59450b6 tempest-VolumesSnapshotsTestJSON-12901790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:58:56 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [req-ff722fdf-d8e8-4a21-b7f5-0024b3972179 req-32f209de-ff7e-4542-9b6b-3489d59450b6 tempest-VolumesSnapshotsTestJSON-12901790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:58:56 devstack sudo[96094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 21:58:56 devstack sudo[96094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:58:56 devstack sudo[96094]: pam_unix(sudo:session): session closed for user root Sep 17 21:58:56 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [req-ff722fdf-d8e8-4a21-b7f5-0024b3972179 req-32f209de-ff7e-4542-9b6b-3489d59450b6 tempest-VolumesSnapshotsTestJSON-12901790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.444s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:58:56 devstack cinder-volume[85458]: DEBUG cinder.manager [req-ff722fdf-d8e8-4a21-b7f5-0024b3972179 req-32f209de-ff7e-4542-9b6b-3489d59450b6 tempest-VolumesSnapshotsTestJSON-12901790 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 21:58:57 devstack cinder-volume[85458]: INFO cinder.volume.manager [req-ff722fdf-d8e8-4a21-b7f5-0024b3972179 req-32f209de-ff7e-4542-9b6b-3489d59450b6 tempest-VolumesSnapshotsTestJSON-12901790 None] Deleted volume successfully. Sep 17 21:58:57 devstack cinder-volume[85458]: DEBUG cinder.coordination [req-ff722fdf-d8e8-4a21-b7f5-0024b3972179 req-32f209de-ff7e-4542-9b6b-3489d59450b6 tempest-VolumesSnapshotsTestJSON-12901790 None] Lock "cinder-5f9c8004-1c11-49ec-a025-f4a513216dcf-delete_volume" released by "delete_volume" :: held 1.890s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 21:59:01 devstack sudo[96073]: pam_unix(sudo:session): session closed for user root Sep 17 21:59:01 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-5a398c98-935e-46cf-8324-cc220387d368 tempest-VolumesActionsTest-1538864328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-03e10b16-20c7-4383-b992-eb1dbadf793c /opt/stack/data/cinder/conversion/03e10b16-20c7-4383-b992-eb1dbadf793c.temp_image.17980581-39b3-47ff-a783-7e55ae541138gwqylfns.img" returned: 0 in 6.890s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:59:01 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[db5e5a72-06fc-4fd5-bb63-83d1525684c3]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 21:59:01 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-5a398c98-935e-46cf-8324-cc220387d368 tempest-VolumesActionsTest-1538864328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-03e10b16-20c7-4383-b992-eb1dbadf793c {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:59:02 devstack sudo[96099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-03e10b16-20c7-4383-b992-eb1dbadf793c Sep 17 21:59:02 devstack sudo[96099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:59:02 devstack sudo[96099]: pam_unix(sudo:session): session closed for user root Sep 17 21:59:02 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-5a398c98-935e-46cf-8324-cc220387d368 tempest-VolumesActionsTest-1538864328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-03e10b16-20c7-4383-b992-eb1dbadf793c" returned: 0 in 0.498s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:59:02 devstack cinder-volume[85458]: DEBUG cinder.image.image_utils [None req-5a398c98-935e-46cf-8324-cc220387d368 tempest-VolumesActionsTest-1538864328 None] Image conversion details: src /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-03e10b16-20c7-4383-b992-eb1dbadf793c, size 1024.00 MB, duration 6.90 sec, destination /opt/stack/data/cinder/conversion/03e10b16-20c7-4383-b992-eb1dbadf793c.temp_image.17980581-39b3-47ff-a783-7e55ae541138gwqylfns.img {{(pid=85458) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 17 21:59:02 devstack cinder-volume[85458]: INFO cinder.image.image_utils [None req-5a398c98-935e-46cf-8324-cc220387d368 tempest-VolumesActionsTest-1538864328 None] Converted 1024.00 MB image at 148.48 MB/s Sep 17 21:59:02 devstack cinder-volume[85458]: DEBUG cinder.image.image_utils [None req-5a398c98-935e-46cf-8324-cc220387d368 tempest-VolumesActionsTest-1538864328 None] 17980581-39b3-47ff-a783-7e55ae541138 was raw, no need to convert to raw {{(pid=85458) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 17 21:59:03 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2f13a39-36da-4a0a-8fa5-e76fe7214be5 tempest-VolumesTestJSON-1035044901 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 21:59:03 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-f2f13a39-36da-4a0a-8fa5-e76fe7214be5 tempest-VolumesTestJSON-1035044901 None] Flow 'volume_create_manager' (ad4d10c6-db38-4837-b554-da05ad4e3bd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 21:59:03 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-f2f13a39-36da-4a0a-8fa5-e76fe7214be5 tempest-VolumesTestJSON-1035044901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99dfa718-997c-45d4-bfa7-394f04a9341c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:59:03 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-f2f13a39-36da-4a0a-8fa5-e76fe7214be5 tempest-VolumesTestJSON-1035044901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99dfa718-997c-45d4-bfa7-394f04a9341c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T19:59:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1463298477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1cd73d1-b23e-4c31-bc68-2f2cb2994f6f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0d81a2d784934b0b9e5570b4465cea05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T19:59:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T19:59:03Z,use_quota=True,user_id='4ed50b4f94ca4192873f348c6b0f5ac0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:59:03 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-f2f13a39-36da-4a0a-8fa5-e76fe7214be5 tempest-VolumesTestJSON-1035044901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (153e4473-dcbc-495b-aec0-e27fb475666c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:59:03 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-f2f13a39-36da-4a0a-8fa5-e76fe7214be5 tempest-VolumesTestJSON-1035044901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (153e4473-dcbc-495b-aec0-e27fb475666c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:59:03 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-f2f13a39-36da-4a0a-8fa5-e76fe7214be5 tempest-VolumesTestJSON-1035044901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1f29340-aaca-47b4-a60c-35f440f805ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:59:03 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-f2f13a39-36da-4a0a-8fa5-e76fe7214be5 tempest-VolumesTestJSON-1035044901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1f29340-aaca-47b4-a60c-35f440f805ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1cd73d1-b23e-4c31-bc68-2f2cb2994f6f', 'volume_name': 'volume-e1cd73d1-b23e-4c31-bc68-2f2cb2994f6f', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:59:03 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-f2f13a39-36da-4a0a-8fa5-e76fe7214be5 tempest-VolumesTestJSON-1035044901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e054df3-2eab-41d2-8f9a-5c550d279638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:59:03 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-f2f13a39-36da-4a0a-8fa5-e76fe7214be5 tempest-VolumesTestJSON-1035044901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e054df3-2eab-41d2-8f9a-5c550d279638) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:59:03 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-f2f13a39-36da-4a0a-8fa5-e76fe7214be5 tempest-VolumesTestJSON-1035044901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3139060-960e-4ffc-8762-663e70199912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:59:03 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-f2f13a39-36da-4a0a-8fa5-e76fe7214be5 tempest-VolumesTestJSON-1035044901 None] Volume e1cd73d1-b23e-4c31-bc68-2f2cb2994f6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1cd73d1-b23e-4c31-bc68-2f2cb2994f6f', 'volume_size': 1} Sep 17 21:59:03 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-f2f13a39-36da-4a0a-8fa5-e76fe7214be5 tempest-VolumesTestJSON-1035044901 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:59:13 devstack cinder-volume[85458]: DEBUG dbcounter [-] [85458] Writing DB stats cinder:SELECT=142,cinder:INSERT=42,cinder:UPDATE=138,cinder:DELETE=9 {{(pid=85458) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 21:59:13 devstack cinder-volume[85458]: DEBUG dbcounter [-] [85458] Writing DB stats cinder:SELECT=137,cinder:UPDATE=146,cinder:INSERT=30,cinder:DELETE=4 {{(pid=85458) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 21:59:20 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-5a398c98-935e-46cf-8324-cc220387d368 tempest-VolumesActionsTest-1538864328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 26.749s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:59:20 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-5a398c98-935e-46cf-8324-cc220387d368 tempest-VolumesActionsTest-1538864328 None] Uploaded volume to glance image-id: 17980581-39b3-47ff-a783-7e55ae541138. {{(pid=85458) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 17 21:59:20 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-0d690611-201d-4be2-b23b-48b80b53ec65 tempest-GroupSnapshotsV319Test-528185915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 25.277s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:59:20 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-0d690611-201d-4be2-b23b-48b80b53ec65 tempest-GroupSnapshotsV319Test-528185915 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=24384c9c-069d-4ada-83e7-b96fdebcdfc9,created_at=2026-09-17T19:58:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1015347241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=24384c9c-069d-4ada-83e7-b96fdebcdfc9,host='devstack@QuobyteHD#QuobyteHD',id=c162b940-7d4b-478e-9f89-530b75d8fd1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84785a1f12ba4c63ad6afa9e49949a3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T19:58:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T19:58:55Z,use_quota=True,user_id='ad970dc5141e485e86144d3b0d3749af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d203970c-ec97-4031-a9e5-01971285c3d0),volume_type_id=d203970c-ec97-4031-a9e5-01971285c3d0)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 21:59:20 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-0d690611-201d-4be2-b23b-48b80b53ec65 tempest-GroupSnapshotsV319Test-528185915 None] Creating volume c162b940-7d4b-478e-9f89-530b75d8fd1e {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 21:59:20 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-0d690611-201d-4be2-b23b-48b80b53ec65 tempest-GroupSnapshotsV319Test-528185915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:59:20 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-0d690611-201d-4be2-b23b-48b80b53ec65 tempest-GroupSnapshotsV319Test-528185915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:59:20 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-0d690611-201d-4be2-b23b-48b80b53ec65 tempest-GroupSnapshotsV319Test-528185915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 21:59:20 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-0d690611-201d-4be2-b23b-48b80b53ec65 tempest-GroupSnapshotsV319Test-528185915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 21:59:20 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-0d690611-201d-4be2-b23b-48b80b53ec65 tempest-GroupSnapshotsV319Test-528185915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:59:20 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-0d690611-201d-4be2-b23b-48b80b53ec65 tempest-GroupSnapshotsV319Test-528185915 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 21:59:20 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-0d690611-201d-4be2-b23b-48b80b53ec65 tempest-GroupSnapshotsV319Test-528185915 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 21:59:20 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-0d690611-201d-4be2-b23b-48b80b53ec65 tempest-GroupSnapshotsV319Test-528185915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c162b940-7d4b-478e-9f89-530b75d8fd1e 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:59:20 devstack sudo[96142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c162b940-7d4b-478e-9f89-530b75d8fd1e 1073741824 Sep 17 21:59:20 devstack sudo[96142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:59:20 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-5a398c98-935e-46cf-8324-cc220387d368 tempest-VolumesActionsTest-1538864328 None] Copy volume to image completed successfully. Sep 17 21:59:21 devstack sudo[96142]: pam_unix(sudo:session): session closed for user root Sep 17 21:59:21 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-0d690611-201d-4be2-b23b-48b80b53ec65 tempest-GroupSnapshotsV319Test-528185915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c162b940-7d4b-478e-9f89-530b75d8fd1e 1073741824" returned: 0 in 0.494s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:59:21 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-0d690611-201d-4be2-b23b-48b80b53ec65 tempest-GroupSnapshotsV319Test-528185915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c162b940-7d4b-478e-9f89-530b75d8fd1e {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:59:21 devstack sudo[96148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c162b940-7d4b-478e-9f89-530b75d8fd1e Sep 17 21:59:21 devstack sudo[96148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:59:21 devstack sudo[96148]: pam_unix(sudo:session): session closed for user root Sep 17 21:59:21 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-0d690611-201d-4be2-b23b-48b80b53ec65 tempest-GroupSnapshotsV319Test-528185915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c162b940-7d4b-478e-9f89-530b75d8fd1e" returned: 0 in 0.246s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:59:21 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-0d690611-201d-4be2-b23b-48b80b53ec65 tempest-GroupSnapshotsV319Test-528185915 None] <== create_volume: return (788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 21:59:21 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-0d690611-201d-4be2-b23b-48b80b53ec65 tempest-GroupSnapshotsV319Test-528185915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.792s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:59:21 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-b50cbff3-3ab9-4d4f-8902-9430b76e4494 tempest-VolumeTypesAccessTest-1166424292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 25.894s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:59:21 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-b50cbff3-3ab9-4d4f-8902-9430b76e4494 tempest-VolumeTypesAccessTest-1166424292 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T19:58:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1712346620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d3fb668-31f1-453f-b20e-9b02f836f3c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7918c88a71343ba81c864757182b2d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T19:58:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T19:58:55Z,use_quota=True,user_id='4cc9c19a74444b5d8ce06d9d82c6c25e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5b7d52e-4c0a-4125-9f3d-19bfa19a7827),volume_type_id=e5b7d52e-4c0a-4125-9f3d-19bfa19a7827)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 21:59:21 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-b50cbff3-3ab9-4d4f-8902-9430b76e4494 tempest-VolumeTypesAccessTest-1166424292 None] Creating volume 6d3fb668-31f1-453f-b20e-9b02f836f3c8 {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 21:59:21 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-b50cbff3-3ab9-4d4f-8902-9430b76e4494 tempest-VolumeTypesAccessTest-1166424292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:59:21 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-b50cbff3-3ab9-4d4f-8902-9430b76e4494 tempest-VolumeTypesAccessTest-1166424292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:59:21 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-b50cbff3-3ab9-4d4f-8902-9430b76e4494 tempest-VolumeTypesAccessTest-1166424292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 21:59:21 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-b50cbff3-3ab9-4d4f-8902-9430b76e4494 tempest-VolumeTypesAccessTest-1166424292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 21:59:21 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-b50cbff3-3ab9-4d4f-8902-9430b76e4494 tempest-VolumeTypesAccessTest-1166424292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:59:21 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-b50cbff3-3ab9-4d4f-8902-9430b76e4494 tempest-VolumeTypesAccessTest-1166424292 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 21:59:21 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-b50cbff3-3ab9-4d4f-8902-9430b76e4494 tempest-VolumeTypesAccessTest-1166424292 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 21:59:21 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-b50cbff3-3ab9-4d4f-8902-9430b76e4494 tempest-VolumeTypesAccessTest-1166424292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-6d3fb668-31f1-453f-b20e-9b02f836f3c8 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:59:21 devstack sudo[96151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-6d3fb668-31f1-453f-b20e-9b02f836f3c8 1073741824 Sep 17 21:59:21 devstack sudo[96151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:59:21 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-0d690611-201d-4be2-b23b-48b80b53ec65 tempest-GroupSnapshotsV319Test-528185915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0c0ee39-ae31-4471-8fb3-373bf406e0d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c162b940-7d4b-478e-9f89-530b75d8fd1e', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:59:21 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-0d690611-201d-4be2-b23b-48b80b53ec65 tempest-GroupSnapshotsV319Test-528185915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (896e3541-c388-41fe-84b3-9054c8028043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:59:21 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-0d690611-201d-4be2-b23b-48b80b53ec65 tempest-GroupSnapshotsV319Test-528185915 None] Volume volume-c162b940-7d4b-478e-9f89-530b75d8fd1e (c162b940-7d4b-478e-9f89-530b75d8fd1e): created successfully Sep 17 21:59:21 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-0d690611-201d-4be2-b23b-48b80b53ec65 tempest-GroupSnapshotsV319Test-528185915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (896e3541-c388-41fe-84b3-9054c8028043) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:59:21 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-0d690611-201d-4be2-b23b-48b80b53ec65 tempest-GroupSnapshotsV319Test-528185915 None] Flow 'volume_create_manager' (72ce8c82-875e-4cc6-9b6e-c304a5eca2dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 21:59:21 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-0d690611-201d-4be2-b23b-48b80b53ec65 tempest-GroupSnapshotsV319Test-528185915 None] Created volume successfully. Sep 17 21:59:22 devstack sudo[96151]: pam_unix(sudo:session): session closed for user root Sep 17 21:59:22 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-b50cbff3-3ab9-4d4f-8902-9430b76e4494 tempest-VolumeTypesAccessTest-1166424292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-6d3fb668-31f1-453f-b20e-9b02f836f3c8 1073741824" returned: 0 in 0.483s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:59:22 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-d8d7b841-303f-47c6-a31d-61514085103a tempest-VolumesActionsTest-1538864328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:59:22 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-b50cbff3-3ab9-4d4f-8902-9430b76e4494 tempest-VolumeTypesAccessTest-1166424292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-6d3fb668-31f1-453f-b20e-9b02f836f3c8 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:59:22 devstack sudo[96157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-6d3fb668-31f1-453f-b20e-9b02f836f3c8 Sep 17 21:59:22 devstack sudo[96157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:59:22 devstack sudo[96157]: pam_unix(sudo:session): session closed for user root Sep 17 21:59:22 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-b50cbff3-3ab9-4d4f-8902-9430b76e4494 tempest-VolumeTypesAccessTest-1166424292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-6d3fb668-31f1-453f-b20e-9b02f836f3c8" returned: 0 in 0.249s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:59:22 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-b50cbff3-3ab9-4d4f-8902-9430b76e4494 tempest-VolumeTypesAccessTest-1166424292 None] <== create_volume: return (784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 21:59:22 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-b50cbff3-3ab9-4d4f-8902-9430b76e4494 tempest-VolumeTypesAccessTest-1166424292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.787s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:59:22 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-f2f13a39-36da-4a0a-8fa5-e76fe7214be5 tempest-VolumesTestJSON-1035044901 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 19.177s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:59:22 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-f2f13a39-36da-4a0a-8fa5-e76fe7214be5 tempest-VolumesTestJSON-1035044901 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T19:59:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1463298477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1cd73d1-b23e-4c31-bc68-2f2cb2994f6f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0d81a2d784934b0b9e5570b4465cea05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T19:59:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T19:59:03Z,use_quota=True,user_id='4ed50b4f94ca4192873f348c6b0f5ac0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 21:59:22 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-f2f13a39-36da-4a0a-8fa5-e76fe7214be5 tempest-VolumesTestJSON-1035044901 None] Creating volume e1cd73d1-b23e-4c31-bc68-2f2cb2994f6f {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 21:59:22 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-f2f13a39-36da-4a0a-8fa5-e76fe7214be5 tempest-VolumesTestJSON-1035044901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:59:22 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-f2f13a39-36da-4a0a-8fa5-e76fe7214be5 tempest-VolumesTestJSON-1035044901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:59:22 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-f2f13a39-36da-4a0a-8fa5-e76fe7214be5 tempest-VolumesTestJSON-1035044901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 21:59:22 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-f2f13a39-36da-4a0a-8fa5-e76fe7214be5 tempest-VolumesTestJSON-1035044901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 21:59:22 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-f2f13a39-36da-4a0a-8fa5-e76fe7214be5 tempest-VolumesTestJSON-1035044901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:59:22 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-f2f13a39-36da-4a0a-8fa5-e76fe7214be5 tempest-VolumesTestJSON-1035044901 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 21:59:22 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-f2f13a39-36da-4a0a-8fa5-e76fe7214be5 tempest-VolumesTestJSON-1035044901 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 21:59:22 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-f2f13a39-36da-4a0a-8fa5-e76fe7214be5 tempest-VolumesTestJSON-1035044901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e1cd73d1-b23e-4c31-bc68-2f2cb2994f6f 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:59:22 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b50cbff3-3ab9-4d4f-8902-9430b76e4494 tempest-VolumeTypesAccessTest-1166424292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5072b0be-b66b-4e58-b0d1-92a6327f240a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d3fb668-31f1-453f-b20e-9b02f836f3c8', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:59:22 devstack sudo[96160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e1cd73d1-b23e-4c31-bc68-2f2cb2994f6f 1073741824 Sep 17 21:59:22 devstack sudo[96160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:59:22 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b50cbff3-3ab9-4d4f-8902-9430b76e4494 tempest-VolumeTypesAccessTest-1166424292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f77f4ad6-7524-4db1-8b67-7a3eb954e1c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:59:22 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-b50cbff3-3ab9-4d4f-8902-9430b76e4494 tempest-VolumeTypesAccessTest-1166424292 None] Volume volume-6d3fb668-31f1-453f-b20e-9b02f836f3c8 (6d3fb668-31f1-453f-b20e-9b02f836f3c8): created successfully Sep 17 21:59:22 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b50cbff3-3ab9-4d4f-8902-9430b76e4494 tempest-VolumeTypesAccessTest-1166424292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f77f4ad6-7524-4db1-8b67-7a3eb954e1c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:59:22 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b50cbff3-3ab9-4d4f-8902-9430b76e4494 tempest-VolumeTypesAccessTest-1166424292 None] Flow 'volume_create_manager' (738f4828-ca9d-4c2e-a2c7-edea72d27169) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 21:59:22 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-b50cbff3-3ab9-4d4f-8902-9430b76e4494 tempest-VolumeTypesAccessTest-1166424292 None] Created volume successfully. Sep 17 21:59:22 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-67f7027d-538a-48a1-87da-f1b284e7b0f6 tempest-GroupSnapshotsV319Test-528185915 None] GroupSnapshot 23f36710-94e6-4544-bca2-38cfe389ad3f: creating. Sep 17 21:59:22 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-67f7027d-538a-48a1-87da-f1b284e7b0f6 tempest-GroupSnapshotsV319Test-528185915 None] Group snapshot 23f36710-94e6-4544-bca2-38cfe389ad3f: creating. {{(pid=85458) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 17 21:59:22 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-67f7027d-538a-48a1-87da-f1b284e7b0f6 tempest-GroupSnapshotsV319Test-528185915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:59:22 devstack sudo[96160]: pam_unix(sudo:session): session closed for user root Sep 17 21:59:22 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-f2f13a39-36da-4a0a-8fa5-e76fe7214be5 tempest-VolumesTestJSON-1035044901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e1cd73d1-b23e-4c31-bc68-2f2cb2994f6f 1073741824" returned: 0 in 0.465s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:59:22 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-f2f13a39-36da-4a0a-8fa5-e76fe7214be5 tempest-VolumesTestJSON-1035044901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e1cd73d1-b23e-4c31-bc68-2f2cb2994f6f {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:59:22 devstack sudo[96165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e1cd73d1-b23e-4c31-bc68-2f2cb2994f6f Sep 17 21:59:22 devstack sudo[96165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:59:23 devstack sudo[96165]: pam_unix(sudo:session): session closed for user root Sep 17 21:59:23 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-f2f13a39-36da-4a0a-8fa5-e76fe7214be5 tempest-VolumesTestJSON-1035044901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e1cd73d1-b23e-4c31-bc68-2f2cb2994f6f" returned: 0 in 0.259s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:59:23 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-f2f13a39-36da-4a0a-8fa5-e76fe7214be5 tempest-VolumesTestJSON-1035044901 None] <== create_volume: return (767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 21:59:23 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-f2f13a39-36da-4a0a-8fa5-e76fe7214be5 tempest-VolumesTestJSON-1035044901 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.771s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:59:23 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-d8d7b841-303f-47c6-a31d-61514085103a tempest-VolumesActionsTest-1538864328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.058s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:59:23 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-f2f13a39-36da-4a0a-8fa5-e76fe7214be5 tempest-VolumesTestJSON-1035044901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3139060-960e-4ffc-8762-663e70199912) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1cd73d1-b23e-4c31-bc68-2f2cb2994f6f', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:59:23 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-f2f13a39-36da-4a0a-8fa5-e76fe7214be5 tempest-VolumesTestJSON-1035044901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb18a10f-2fa7-4e45-8667-5be8bcfca585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:59:23 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[d643e97d-ceca-4c43-85a1-529ccf8191b8]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 21:59:23 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-d4036d14-65dd-4c65-8e71-0a05dc390b51 tempest-VolumeTypesAccessTest-1166424292 None] Acquiring lock "cinder-6d3fb668-31f1-453f-b20e-9b02f836f3c8-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 21:59:23 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-d8d7b841-303f-47c6-a31d-61514085103a tempest-VolumesActionsTest-1538864328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-03e10b16-20c7-4383-b992-eb1dbadf793c {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:59:23 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-f2f13a39-36da-4a0a-8fa5-e76fe7214be5 tempest-VolumesTestJSON-1035044901 None] Volume volume-e1cd73d1-b23e-4c31-bc68-2f2cb2994f6f (e1cd73d1-b23e-4c31-bc68-2f2cb2994f6f): created successfully Sep 17 21:59:23 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-f2f13a39-36da-4a0a-8fa5-e76fe7214be5 tempest-VolumesTestJSON-1035044901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb18a10f-2fa7-4e45-8667-5be8bcfca585) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:59:23 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-f2f13a39-36da-4a0a-8fa5-e76fe7214be5 tempest-VolumesTestJSON-1035044901 None] Flow 'volume_create_manager' (ad4d10c6-db38-4837-b554-da05ad4e3bd9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 21:59:23 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-d4036d14-65dd-4c65-8e71-0a05dc390b51 tempest-VolumeTypesAccessTest-1166424292 None] Lock "cinder-6d3fb668-31f1-453f-b20e-9b02f836f3c8-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 21:59:23 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-f2f13a39-36da-4a0a-8fa5-e76fe7214be5 tempest-VolumesTestJSON-1035044901 None] Created volume successfully. Sep 17 21:59:23 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-d4036d14-65dd-4c65-8e71-0a05dc390b51 tempest-VolumeTypesAccessTest-1166424292 None] Acquiring lock "cinder-quobyte-6d3fb668-31f1-453f-b20e-9b02f836f3c8" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 21:59:23 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-d4036d14-65dd-4c65-8e71-0a05dc390b51 tempest-VolumeTypesAccessTest-1166424292 None] Lock "cinder-quobyte-6d3fb668-31f1-453f-b20e-9b02f836f3c8" acquired by "delete_volume" :: waited 0.015s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 21:59:23 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[745b0dcd-1a19-4a9b-85bd-96a41e43bfe8]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 21:59:23 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-d4036d14-65dd-4c65-8e71-0a05dc390b51 tempest-VolumeTypesAccessTest-1166424292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-6d3fb668-31f1-453f-b20e-9b02f836f3c8 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:59:23 devstack sudo[96168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-03e10b16-20c7-4383-b992-eb1dbadf793c Sep 17 21:59:23 devstack sudo[96168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:59:23 devstack sudo[96170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-6d3fb668-31f1-453f-b20e-9b02f836f3c8 Sep 17 21:59:23 devstack sudo[96170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:59:23 devstack sudo[96168]: pam_unix(sudo:session): session closed for user root Sep 17 21:59:23 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-d8d7b841-303f-47c6-a31d-61514085103a tempest-VolumesActionsTest-1538864328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-03e10b16-20c7-4383-b992-eb1dbadf793c" returned: 0 in 0.442s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:59:23 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[95177b12-281b-4599-a578-40ed927883df]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 21:59:23 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-d8d7b841-303f-47c6-a31d-61514085103a tempest-VolumesActionsTest-1538864328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-03e10b16-20c7-4383-b992-eb1dbadf793c {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:59:23 devstack sudo[96170]: pam_unix(sudo:session): session closed for user root Sep 17 21:59:23 devstack sudo[96176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-03e10b16-20c7-4383-b992-eb1dbadf793c Sep 17 21:59:23 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-d4036d14-65dd-4c65-8e71-0a05dc390b51 tempest-VolumeTypesAccessTest-1166424292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-6d3fb668-31f1-453f-b20e-9b02f836f3c8" returned: 0 in 0.442s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:59:23 devstack sudo[96176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:59:23 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-d4036d14-65dd-4c65-8e71-0a05dc390b51 tempest-VolumeTypesAccessTest-1166424292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-6d3fb668-31f1-453f-b20e-9b02f836f3c8 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:59:23 devstack sudo[96180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-6d3fb668-31f1-453f-b20e-9b02f836f3c8 Sep 17 21:59:23 devstack sudo[96180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:59:23 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-4860fa1d-c1fd-42be-9df2-5ac334796922 tempest-VolumesTestJSON-1035044901 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 21:59:23 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-4860fa1d-c1fd-42be-9df2-5ac334796922 tempest-VolumesTestJSON-1035044901 None] Flow 'volume_create_manager' (972aa429-58cc-4cca-9f5d-65ea72ed43dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 21:59:23 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-4860fa1d-c1fd-42be-9df2-5ac334796922 tempest-VolumesTestJSON-1035044901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b9034a3-6715-4eba-87fa-12599fd07d63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:59:23 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-4860fa1d-c1fd-42be-9df2-5ac334796922 tempest-VolumesTestJSON-1035044901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b9034a3-6715-4eba-87fa-12599fd07d63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T19:59:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-309623638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cd86fd2-3094-4542-9966-1372fabf1b67,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0d81a2d784934b0b9e5570b4465cea05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T19:59:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T19:59:24Z,use_quota=True,user_id='4ed50b4f94ca4192873f348c6b0f5ac0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:59:23 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-4860fa1d-c1fd-42be-9df2-5ac334796922 tempest-VolumesTestJSON-1035044901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb2c1863-89e8-45ff-8570-8f82ce133b4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:59:23 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-4860fa1d-c1fd-42be-9df2-5ac334796922 tempest-VolumesTestJSON-1035044901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb2c1863-89e8-45ff-8570-8f82ce133b4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:59:23 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-4860fa1d-c1fd-42be-9df2-5ac334796922 tempest-VolumesTestJSON-1035044901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6db7e9a1-01ff-44bb-a981-0f8e7911adda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:59:23 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-4860fa1d-c1fd-42be-9df2-5ac334796922 tempest-VolumesTestJSON-1035044901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6db7e9a1-01ff-44bb-a981-0f8e7911adda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4cd86fd2-3094-4542-9966-1372fabf1b67', 'volume_name': 'volume-4cd86fd2-3094-4542-9966-1372fabf1b67', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:59:23 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-4860fa1d-c1fd-42be-9df2-5ac334796922 tempest-VolumesTestJSON-1035044901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ce19306-e74b-4fda-ac55-e33f0451fc5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:59:24 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-4860fa1d-c1fd-42be-9df2-5ac334796922 tempest-VolumesTestJSON-1035044901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ce19306-e74b-4fda-ac55-e33f0451fc5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:59:24 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-4860fa1d-c1fd-42be-9df2-5ac334796922 tempest-VolumesTestJSON-1035044901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3881719b-6138-4bad-9d18-9163ba5d8bb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:59:24 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-4860fa1d-c1fd-42be-9df2-5ac334796922 tempest-VolumesTestJSON-1035044901 None] Volume 4cd86fd2-3094-4542-9966-1372fabf1b67: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4cd86fd2-3094-4542-9966-1372fabf1b67', 'volume_size': 1} Sep 17 21:59:24 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-4860fa1d-c1fd-42be-9df2-5ac334796922 tempest-VolumesTestJSON-1035044901 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:59:24 devstack sudo[96176]: pam_unix(sudo:session): session closed for user root Sep 17 21:59:24 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-d8d7b841-303f-47c6-a31d-61514085103a tempest-VolumesActionsTest-1538864328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-03e10b16-20c7-4383-b992-eb1dbadf793c" returned: 0 in 0.399s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:59:24 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-d8d7b841-303f-47c6-a31d-61514085103a tempest-VolumesActionsTest-1538864328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-03e10b16-20c7-4383-b992-eb1dbadf793c /opt/stack/data/cinder/conversion/03e10b16-20c7-4383-b992-eb1dbadf793c.temp_image.d122a0c1-326d-4f19-b948-8d0def81009apxtkae9z.img {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:59:24 devstack sudo[96186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-03e10b16-20c7-4383-b992-eb1dbadf793c /opt/stack/data/cinder/conversion/03e10b16-20c7-4383-b992-eb1dbadf793c.temp_image.d122a0c1-326d-4f19-b948-8d0def81009apxtkae9z.img Sep 17 21:59:24 devstack sudo[96186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:59:24 devstack sudo[96180]: pam_unix(sudo:session): session closed for user root Sep 17 21:59:24 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-d4036d14-65dd-4c65-8e71-0a05dc390b51 tempest-VolumeTypesAccessTest-1166424292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-6d3fb668-31f1-453f-b20e-9b02f836f3c8" returned: 0 in 0.313s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:59:24 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-d4036d14-65dd-4c65-8e71-0a05dc390b51 tempest-VolumeTypesAccessTest-1166424292 None] Lock "cinder-quobyte-6d3fb668-31f1-453f-b20e-9b02f836f3c8" released by "delete_volume" :: held 0.808s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 21:59:24 devstack cinder-volume[85458]: WARNING cinder.quota [None req-d4036d14-65dd-4c65-8e71-0a05dc390b51 tempest-VolumeTypesAccessTest-1166424292 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1037511550 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1037511550, it is now deprecated. Please use the default quota class for default quota. Sep 17 21:59:24 devstack cinder-volume[85458]: WARNING cinder.quota [None req-d4036d14-65dd-4c65-8e71-0a05dc390b51 tempest-VolumeTypesAccessTest-1166424292 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1037511550 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1037511550, it is now deprecated. Please use the default quota class for default quota. Sep 17 21:59:24 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-d4036d14-65dd-4c65-8e71-0a05dc390b51 tempest-VolumeTypesAccessTest-1166424292 None] Created reservations ['1f760677-e23b-46af-9663-ed1023028fee', '719564d2-5bca-49df-8402-06abe0a3b249', '180fa8f0-9efc-49b5-bf70-7fba99bbb02e', '6f669c14-6d22-4d81-bd07-0b57196d9867'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 21:59:24 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-d4036d14-65dd-4c65-8e71-0a05dc390b51 tempest-VolumeTypesAccessTest-1166424292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:59:24 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-d4036d14-65dd-4c65-8e71-0a05dc390b51 tempest-VolumeTypesAccessTest-1166424292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:59:24 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-d4036d14-65dd-4c65-8e71-0a05dc390b51 tempest-VolumeTypesAccessTest-1166424292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 21:59:24 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-d4036d14-65dd-4c65-8e71-0a05dc390b51 tempest-VolumeTypesAccessTest-1166424292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 21:59:24 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-d4036d14-65dd-4c65-8e71-0a05dc390b51 tempest-VolumeTypesAccessTest-1166424292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:59:24 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-d4036d14-65dd-4c65-8e71-0a05dc390b51 tempest-VolumeTypesAccessTest-1166424292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:59:24 devstack sudo[96188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 21:59:24 devstack sudo[96188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:59:24 devstack sudo[96188]: pam_unix(sudo:session): session closed for user root Sep 17 21:59:24 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-d4036d14-65dd-4c65-8e71-0a05dc390b51 tempest-VolumeTypesAccessTest-1166424292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.440s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:59:24 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-d4036d14-65dd-4c65-8e71-0a05dc390b51 tempest-VolumeTypesAccessTest-1166424292 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 21:59:24 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-d4036d14-65dd-4c65-8e71-0a05dc390b51 tempest-VolumeTypesAccessTest-1166424292 None] Deleted volume successfully. Sep 17 21:59:24 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-d4036d14-65dd-4c65-8e71-0a05dc390b51 tempest-VolumeTypesAccessTest-1166424292 None] Lock "cinder-6d3fb668-31f1-453f-b20e-9b02f836f3c8-delete_volume" released by "delete_volume" :: held 1.497s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 21:59:27 devstack cinder-volume[85458]: DEBUG oslo_service.periodic_task [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85458) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 21:59:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:59:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:59:27 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 21:59:27 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 21:59:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:59:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:59:27 devstack sudo[96203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 21:59:27 devstack sudo[96203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:59:28 devstack sudo[96203]: pam_unix(sudo:session): session closed for user root Sep 17 21:59:28 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.484s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:59:28 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 21:59:28 devstack cinder-volume[85458]: DEBUG oslo_service.periodic_task [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Running periodic task VolumeManager._thread_info {{(pid=85458) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 21:59:28 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] thread count: 28 {{(pid=85458) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 21:59:28 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] thread info: [<_MainThread(MainThread, started 127546830999680)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85458) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 21:59:31 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-d8d7b841-303f-47c6-a31d-61514085103a tempest-VolumesActionsTest-1538864328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-03e10b16-20c7-4383-b992-eb1dbadf793c /opt/stack/data/cinder/conversion/03e10b16-20c7-4383-b992-eb1dbadf793c.temp_image.d122a0c1-326d-4f19-b948-8d0def81009apxtkae9z.img" returned: 0 in 7.085s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:59:31 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e5045dd-318f-4f23-8d90-9b394e0bf660]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 21:59:31 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-d8d7b841-303f-47c6-a31d-61514085103a tempest-VolumesActionsTest-1538864328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-03e10b16-20c7-4383-b992-eb1dbadf793c {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:59:31 devstack sudo[96216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-03e10b16-20c7-4383-b992-eb1dbadf793c Sep 17 21:59:31 devstack sudo[96216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:59:31 devstack sudo[96216]: pam_unix(sudo:session): session closed for user root Sep 17 21:59:31 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-d8d7b841-303f-47c6-a31d-61514085103a tempest-VolumesActionsTest-1538864328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-03e10b16-20c7-4383-b992-eb1dbadf793c" returned: 0 in 0.548s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:59:31 devstack cinder-volume[85458]: DEBUG cinder.image.image_utils [None req-d8d7b841-303f-47c6-a31d-61514085103a tempest-VolumesActionsTest-1538864328 None] Image conversion details: src /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-03e10b16-20c7-4383-b992-eb1dbadf793c, size 1024.00 MB, duration 7.09 sec, destination /opt/stack/data/cinder/conversion/03e10b16-20c7-4383-b992-eb1dbadf793c.temp_image.d122a0c1-326d-4f19-b948-8d0def81009apxtkae9z.img {{(pid=85458) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 17 21:59:31 devstack cinder-volume[85458]: INFO cinder.image.image_utils [None req-d8d7b841-303f-47c6-a31d-61514085103a tempest-VolumesActionsTest-1538864328 None] Converted 1024.00 MB image at 144.52 MB/s Sep 17 21:59:31 devstack cinder-volume[85458]: DEBUG cinder.image.image_utils [None req-d8d7b841-303f-47c6-a31d-61514085103a tempest-VolumesActionsTest-1538864328 None] d122a0c1-326d-4f19-b948-8d0def81009a was raw, converting to qcow2 {{(pid=85458) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}} Sep 17 21:59:31 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0e95098-ff98-4d40-b1b5-36193a68cf1f]: (4, 'raw') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 21:59:31 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-d8d7b841-303f-47c6-a31d-61514085103a tempest-VolumesActionsTest-1538864328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/03e10b16-20c7-4383-b992-eb1dbadf793c.temp_image.d122a0c1-326d-4f19-b948-8d0def81009apxtkae9z.img {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:59:31 devstack sudo[96221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/03e10b16-20c7-4383-b992-eb1dbadf793c.temp_image.d122a0c1-326d-4f19-b948-8d0def81009apxtkae9z.img Sep 17 21:59:31 devstack sudo[96221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:59:32 devstack sudo[96221]: pam_unix(sudo:session): session closed for user root Sep 17 21:59:32 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-d8d7b841-303f-47c6-a31d-61514085103a tempest-VolumesActionsTest-1538864328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/03e10b16-20c7-4383-b992-eb1dbadf793c.temp_image.d122a0c1-326d-4f19-b948-8d0def81009apxtkae9z.img" returned: 0 in 0.315s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:59:32 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-d8d7b841-303f-47c6-a31d-61514085103a tempest-VolumesActionsTest-1538864328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/03e10b16-20c7-4383-b992-eb1dbadf793c.temp_image.d122a0c1-326d-4f19-b948-8d0def81009apxtkae9z.img {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:59:32 devstack sudo[96225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/03e10b16-20c7-4383-b992-eb1dbadf793c.temp_image.d122a0c1-326d-4f19-b948-8d0def81009apxtkae9z.img Sep 17 21:59:32 devstack sudo[96225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:59:32 devstack sudo[96225]: pam_unix(sudo:session): session closed for user root Sep 17 21:59:32 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-d8d7b841-303f-47c6-a31d-61514085103a tempest-VolumesActionsTest-1538864328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/03e10b16-20c7-4383-b992-eb1dbadf793c.temp_image.d122a0c1-326d-4f19-b948-8d0def81009apxtkae9z.img" returned: 1 in 0.322s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:59:32 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-d8d7b841-303f-47c6-a31d-61514085103a tempest-VolumesActionsTest-1538864328 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/03e10b16-20c7-4383-b992-eb1dbadf793c.temp_image.d122a0c1-326d-4f19-b948-8d0def81009apxtkae9z.img' failed. Not Retrying. {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 21:59:32 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-d8d7b841-303f-47c6-a31d-61514085103a tempest-VolumesActionsTest-1538864328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/03e10b16-20c7-4383-b992-eb1dbadf793c.temp_image.d122a0c1-326d-4f19-b948-8d0def81009apxtkae9z.img /opt/stack/data/cinder/conversion/vol_upload_j0ix0k2e {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:59:32 devstack sudo[96230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/03e10b16-20c7-4383-b992-eb1dbadf793c.temp_image.d122a0c1-326d-4f19-b948-8d0def81009apxtkae9z.img /opt/stack/data/cinder/conversion/vol_upload_j0ix0k2e Sep 17 21:59:32 devstack sudo[96230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:59:32 devstack sudo[96230]: pam_unix(sudo:session): session closed for user root Sep 17 21:59:32 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-d8d7b841-303f-47c6-a31d-61514085103a tempest-VolumesActionsTest-1538864328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/03e10b16-20c7-4383-b992-eb1dbadf793c.temp_image.d122a0c1-326d-4f19-b948-8d0def81009apxtkae9z.img /opt/stack/data/cinder/conversion/vol_upload_j0ix0k2e" returned: 0 in 0.259s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:59:32 devstack cinder-volume[85458]: DEBUG cinder.image.image_utils [None req-d8d7b841-303f-47c6-a31d-61514085103a tempest-VolumesActionsTest-1538864328 None] Image conversion details: src /opt/stack/data/cinder/conversion/03e10b16-20c7-4383-b992-eb1dbadf793c.temp_image.d122a0c1-326d-4f19-b948-8d0def81009apxtkae9z.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_j0ix0k2e {{(pid=85458) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 17 21:59:32 devstack cinder-volume[85458]: INFO cinder.image.image_utils [None req-d8d7b841-303f-47c6-a31d-61514085103a tempest-VolumesActionsTest-1538864328 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 17 21:59:32 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dc5c91d-39c2-4153-bd3f-23114bbb8de0]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 21:59:32 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-d8d7b841-303f-47c6-a31d-61514085103a tempest-VolumesActionsTest-1538864328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_j0ix0k2e {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:59:32 devstack sudo[96236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_j0ix0k2e Sep 17 21:59:32 devstack sudo[96236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:59:32 devstack sudo[96236]: pam_unix(sudo:session): session closed for user root Sep 17 21:59:32 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-d8d7b841-303f-47c6-a31d-61514085103a tempest-VolumesActionsTest-1538864328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_j0ix0k2e" returned: 0 in 0.331s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:59:34 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-d8d7b841-303f-47c6-a31d-61514085103a tempest-VolumesActionsTest-1538864328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 11.184s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:59:34 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-d8d7b841-303f-47c6-a31d-61514085103a tempest-VolumesActionsTest-1538864328 None] Uploaded volume to glance image-id: d122a0c1-326d-4f19-b948-8d0def81009a. {{(pid=85458) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 17 21:59:34 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-67f7027d-538a-48a1-87da-f1b284e7b0f6 tempest-GroupSnapshotsV319Test-528185915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 11.637s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:59:34 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-67f7027d-538a-48a1-87da-f1b284e7b0f6 tempest-GroupSnapshotsV319Test-528185915 None] Creating offline snapshot db416447-2ce4-49cc-8da6-190587bf5926 of volume c162b940-7d4b-478e-9f89-530b75d8fd1e {{(pid=85458) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 21:59:34 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-d8d7b841-303f-47c6-a31d-61514085103a tempest-VolumesActionsTest-1538864328 None] Copy volume to image completed successfully. Sep 17 21:59:34 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7e6b160-5a97-4e32-b6d5-ba65d916a115]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 21:59:34 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-67f7027d-538a-48a1-87da-f1b284e7b0f6 tempest-GroupSnapshotsV319Test-528185915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c162b940-7d4b-478e-9f89-530b75d8fd1e {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:59:34 devstack sudo[96243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c162b940-7d4b-478e-9f89-530b75d8fd1e Sep 17 21:59:34 devstack sudo[96243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:59:34 devstack sudo[96243]: pam_unix(sudo:session): session closed for user root Sep 17 21:59:34 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-67f7027d-538a-48a1-87da-f1b284e7b0f6 tempest-GroupSnapshotsV319Test-528185915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c162b940-7d4b-478e-9f89-530b75d8fd1e" returned: 0 in 0.400s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:59:34 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-67f7027d-538a-48a1-87da-f1b284e7b0f6 tempest-GroupSnapshotsV319Test-528185915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c162b940-7d4b-478e-9f89-530b75d8fd1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c162b940-7d4b-478e-9f89-530b75d8fd1e.db416447-2ce4-49cc-8da6-190587bf5926 1G {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:59:34 devstack sudo[96248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c162b940-7d4b-478e-9f89-530b75d8fd1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c162b940-7d4b-478e-9f89-530b75d8fd1e.db416447-2ce4-49cc-8da6-190587bf5926 1G Sep 17 21:59:34 devstack sudo[96248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:59:35 devstack sudo[96248]: pam_unix(sudo:session): session closed for user root Sep 17 21:59:35 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-67f7027d-538a-48a1-87da-f1b284e7b0f6 tempest-GroupSnapshotsV319Test-528185915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c162b940-7d4b-478e-9f89-530b75d8fd1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c162b940-7d4b-478e-9f89-530b75d8fd1e.db416447-2ce4-49cc-8da6-190587bf5926 1G" returned: 0 in 0.473s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:59:35 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-67f7027d-538a-48a1-87da-f1b284e7b0f6 tempest-GroupSnapshotsV319Test-528185915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c162b940-7d4b-478e-9f89-530b75d8fd1e -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c162b940-7d4b-478e-9f89-530b75d8fd1e.db416447-2ce4-49cc-8da6-190587bf5926 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:59:35 devstack sudo[96253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c162b940-7d4b-478e-9f89-530b75d8fd1e -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c162b940-7d4b-478e-9f89-530b75d8fd1e.db416447-2ce4-49cc-8da6-190587bf5926 Sep 17 21:59:35 devstack sudo[96253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:59:35 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-c91b2a13-1913-4441-8c02-befc97478a5f tempest-VolumesActionsTest-1538864328 None] Acquiring lock "cinder-03e10b16-20c7-4383-b992-eb1dbadf793c-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 21:59:35 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-c91b2a13-1913-4441-8c02-befc97478a5f tempest-VolumesActionsTest-1538864328 None] Lock "cinder-03e10b16-20c7-4383-b992-eb1dbadf793c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 21:59:35 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-c91b2a13-1913-4441-8c02-befc97478a5f tempest-VolumesActionsTest-1538864328 None] Acquiring lock "cinder-quobyte-03e10b16-20c7-4383-b992-eb1dbadf793c" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 21:59:35 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-c91b2a13-1913-4441-8c02-befc97478a5f tempest-VolumesActionsTest-1538864328 None] Lock "cinder-quobyte-03e10b16-20c7-4383-b992-eb1dbadf793c" acquired by "delete_volume" :: waited 0.015s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 21:59:35 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[63f247c3-015c-40f0-84d7-ba43c9c60c33]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 21:59:35 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-c91b2a13-1913-4441-8c02-befc97478a5f tempest-VolumesActionsTest-1538864328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-03e10b16-20c7-4383-b992-eb1dbadf793c {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:59:35 devstack sudo[96253]: pam_unix(sudo:session): session closed for user root Sep 17 21:59:35 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-67f7027d-538a-48a1-87da-f1b284e7b0f6 tempest-GroupSnapshotsV319Test-528185915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c162b940-7d4b-478e-9f89-530b75d8fd1e -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c162b940-7d4b-478e-9f89-530b75d8fd1e.db416447-2ce4-49cc-8da6-190587bf5926" returned: 0 in 0.368s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:59:35 devstack cinder-volume[85458]: WARNING cinder.volume.drivers.remotefs [None req-67f7027d-538a-48a1-87da-f1b284e7b0f6 tempest-GroupSnapshotsV319Test-528185915 None] /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c162b940-7d4b-478e-9f89-530b75d8fd1e.db416447-2ce4-49cc-8da6-190587bf5926 is being set with open permissions: ugo+rw: NotImplementedError Sep 17 21:59:35 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-67f7027d-538a-48a1-87da-f1b284e7b0f6 tempest-GroupSnapshotsV319Test-528185915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c162b940-7d4b-478e-9f89-530b75d8fd1e.db416447-2ce4-49cc-8da6-190587bf5926 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:59:35 devstack sudo[96259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c162b940-7d4b-478e-9f89-530b75d8fd1e.db416447-2ce4-49cc-8da6-190587bf5926 Sep 17 21:59:35 devstack sudo[96259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:59:35 devstack sudo[96257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-03e10b16-20c7-4383-b992-eb1dbadf793c Sep 17 21:59:35 devstack sudo[96257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:59:35 devstack sudo[96259]: pam_unix(sudo:session): session closed for user root Sep 17 21:59:35 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-67f7027d-538a-48a1-87da-f1b284e7b0f6 tempest-GroupSnapshotsV319Test-528185915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c162b940-7d4b-478e-9f89-530b75d8fd1e.db416447-2ce4-49cc-8da6-190587bf5926" returned: 0 in 0.276s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:59:35 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-67f7027d-538a-48a1-87da-f1b284e7b0f6 tempest-GroupSnapshotsV319Test-528185915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c162b940-7d4b-478e-9f89-530b75d8fd1e.info {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:59:35 devstack sudo[96257]: pam_unix(sudo:session): session closed for user root Sep 17 21:59:35 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-c91b2a13-1913-4441-8c02-befc97478a5f tempest-VolumesActionsTest-1538864328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-03e10b16-20c7-4383-b992-eb1dbadf793c" returned: 0 in 0.416s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:59:35 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-c91b2a13-1913-4441-8c02-befc97478a5f tempest-VolumesActionsTest-1538864328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-03e10b16-20c7-4383-b992-eb1dbadf793c {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:59:35 devstack sudo[96267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c162b940-7d4b-478e-9f89-530b75d8fd1e.info Sep 17 21:59:35 devstack sudo[96267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:59:36 devstack sudo[96268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-03e10b16-20c7-4383-b992-eb1dbadf793c Sep 17 21:59:36 devstack sudo[96268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:59:36 devstack sudo[96267]: pam_unix(sudo:session): session closed for user root Sep 17 21:59:36 devstack sudo[96268]: pam_unix(sudo:session): session closed for user root Sep 17 21:59:36 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-67f7027d-538a-48a1-87da-f1b284e7b0f6 tempest-GroupSnapshotsV319Test-528185915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c162b940-7d4b-478e-9f89-530b75d8fd1e.info" returned: 0 in 0.326s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:59:36 devstack cinder-volume[85458]: WARNING cinder.volume.drivers.remotefs [None req-67f7027d-538a-48a1-87da-f1b284e7b0f6 tempest-GroupSnapshotsV319Test-528185915 None] /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c162b940-7d4b-478e-9f89-530b75d8fd1e.info is being set with open permissions: ugo+rw: NotImplementedError Sep 17 21:59:36 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-67f7027d-538a-48a1-87da-f1b284e7b0f6 tempest-GroupSnapshotsV319Test-528185915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c162b940-7d4b-478e-9f89-530b75d8fd1e.info {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:59:36 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-c91b2a13-1913-4441-8c02-befc97478a5f tempest-VolumesActionsTest-1538864328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-03e10b16-20c7-4383-b992-eb1dbadf793c" returned: 0 in 0.309s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:59:36 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-c91b2a13-1913-4441-8c02-befc97478a5f tempest-VolumesActionsTest-1538864328 None] Lock "cinder-quobyte-03e10b16-20c7-4383-b992-eb1dbadf793c" released by "delete_volume" :: held 0.771s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 21:59:36 devstack sudo[96273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c162b940-7d4b-478e-9f89-530b75d8fd1e.info Sep 17 21:59:36 devstack sudo[96273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:59:36 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-c91b2a13-1913-4441-8c02-befc97478a5f tempest-VolumesActionsTest-1538864328 None] Created reservations ['1234f5d7-7f53-4429-9d13-2229e1395adf', '60b03806-0b0f-43e9-8ae6-3eed2e1aa366', 'f420893b-e5fb-45eb-9dd7-814fa6d466a5', '8c80b730-0cf8-47b7-87bd-c4b11051776f'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 21:59:36 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-c91b2a13-1913-4441-8c02-befc97478a5f tempest-VolumesActionsTest-1538864328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:59:36 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-c91b2a13-1913-4441-8c02-befc97478a5f tempest-VolumesActionsTest-1538864328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:59:36 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-c91b2a13-1913-4441-8c02-befc97478a5f tempest-VolumesActionsTest-1538864328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 21:59:36 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-c91b2a13-1913-4441-8c02-befc97478a5f tempest-VolumesActionsTest-1538864328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 21:59:36 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-c91b2a13-1913-4441-8c02-befc97478a5f tempest-VolumesActionsTest-1538864328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:59:36 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-c91b2a13-1913-4441-8c02-befc97478a5f tempest-VolumesActionsTest-1538864328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:59:36 devstack sudo[96275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 21:59:36 devstack sudo[96275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:59:36 devstack sudo[96273]: pam_unix(sudo:session): session closed for user root Sep 17 21:59:36 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-67f7027d-538a-48a1-87da-f1b284e7b0f6 tempest-GroupSnapshotsV319Test-528185915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c162b940-7d4b-478e-9f89-530b75d8fd1e.info" returned: 0 in 0.296s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:59:36 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-67f7027d-538a-48a1-87da-f1b284e7b0f6 tempest-GroupSnapshotsV319Test-528185915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.256s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:59:36 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-4860fa1d-c1fd-42be-9df2-5ac334796922 tempest-VolumesTestJSON-1035044901 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.582s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:59:36 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-4860fa1d-c1fd-42be-9df2-5ac334796922 tempest-VolumesTestJSON-1035044901 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T19:59:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-309623638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cd86fd2-3094-4542-9966-1372fabf1b67,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0d81a2d784934b0b9e5570b4465cea05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T19:59:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T19:59:24Z,use_quota=True,user_id='4ed50b4f94ca4192873f348c6b0f5ac0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 21:59:36 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-4860fa1d-c1fd-42be-9df2-5ac334796922 tempest-VolumesTestJSON-1035044901 None] Creating volume 4cd86fd2-3094-4542-9966-1372fabf1b67 {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 21:59:36 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-4860fa1d-c1fd-42be-9df2-5ac334796922 tempest-VolumesTestJSON-1035044901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:59:36 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-4860fa1d-c1fd-42be-9df2-5ac334796922 tempest-VolumesTestJSON-1035044901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:59:36 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-4860fa1d-c1fd-42be-9df2-5ac334796922 tempest-VolumesTestJSON-1035044901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 21:59:36 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-4860fa1d-c1fd-42be-9df2-5ac334796922 tempest-VolumesTestJSON-1035044901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 21:59:36 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-4860fa1d-c1fd-42be-9df2-5ac334796922 tempest-VolumesTestJSON-1035044901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:59:36 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-4860fa1d-c1fd-42be-9df2-5ac334796922 tempest-VolumesTestJSON-1035044901 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 21:59:36 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-4860fa1d-c1fd-42be-9df2-5ac334796922 tempest-VolumesTestJSON-1035044901 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 21:59:36 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-4860fa1d-c1fd-42be-9df2-5ac334796922 tempest-VolumesTestJSON-1035044901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-4cd86fd2-3094-4542-9966-1372fabf1b67 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:59:36 devstack sudo[96278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-4cd86fd2-3094-4542-9966-1372fabf1b67 1073741824 Sep 17 21:59:36 devstack sudo[96278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:59:36 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-67f7027d-538a-48a1-87da-f1b284e7b0f6 tempest-GroupSnapshotsV319Test-528185915 None] group_snapshot 23f36710-94e6-4544-bca2-38cfe389ad3f: created successfully Sep 17 21:59:36 devstack sudo[96275]: pam_unix(sudo:session): session closed for user root Sep 17 21:59:36 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-c91b2a13-1913-4441-8c02-befc97478a5f tempest-VolumesActionsTest-1538864328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.333s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:59:36 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-c91b2a13-1913-4441-8c02-befc97478a5f tempest-VolumesActionsTest-1538864328 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 21:59:36 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-c91b2a13-1913-4441-8c02-befc97478a5f tempest-VolumesActionsTest-1538864328 None] Deleted volume successfully. Sep 17 21:59:36 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-c91b2a13-1913-4441-8c02-befc97478a5f tempest-VolumesActionsTest-1538864328 None] Lock "cinder-03e10b16-20c7-4383-b992-eb1dbadf793c-delete_volume" released by "delete_volume" :: held 1.387s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 21:59:37 devstack sudo[96278]: pam_unix(sudo:session): session closed for user root Sep 17 21:59:37 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-4860fa1d-c1fd-42be-9df2-5ac334796922 tempest-VolumesTestJSON-1035044901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-4cd86fd2-3094-4542-9966-1372fabf1b67 1073741824" returned: 0 in 0.638s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:59:37 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-4860fa1d-c1fd-42be-9df2-5ac334796922 tempest-VolumesTestJSON-1035044901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-4cd86fd2-3094-4542-9966-1372fabf1b67 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:59:37 devstack sudo[96285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-4cd86fd2-3094-4542-9966-1372fabf1b67 Sep 17 21:59:37 devstack sudo[96285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:59:37 devstack sudo[96285]: pam_unix(sudo:session): session closed for user root Sep 17 21:59:37 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-4860fa1d-c1fd-42be-9df2-5ac334796922 tempest-VolumesTestJSON-1035044901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-4cd86fd2-3094-4542-9966-1372fabf1b67" returned: 0 in 0.302s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:59:37 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-4860fa1d-c1fd-42be-9df2-5ac334796922 tempest-VolumesTestJSON-1035044901 None] <== create_volume: return (1004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 21:59:37 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-4860fa1d-c1fd-42be-9df2-5ac334796922 tempest-VolumesTestJSON-1035044901 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.011s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:59:37 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-4860fa1d-c1fd-42be-9df2-5ac334796922 tempest-VolumesTestJSON-1035044901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3881719b-6138-4bad-9d18-9163ba5d8bb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4cd86fd2-3094-4542-9966-1372fabf1b67', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:59:37 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-4860fa1d-c1fd-42be-9df2-5ac334796922 tempest-VolumesTestJSON-1035044901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (117b83ed-40bc-408e-a445-5124c6a69848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:59:37 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-4860fa1d-c1fd-42be-9df2-5ac334796922 tempest-VolumesTestJSON-1035044901 None] Volume volume-4cd86fd2-3094-4542-9966-1372fabf1b67 (4cd86fd2-3094-4542-9966-1372fabf1b67): created successfully Sep 17 21:59:37 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-4860fa1d-c1fd-42be-9df2-5ac334796922 tempest-VolumesTestJSON-1035044901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (117b83ed-40bc-408e-a445-5124c6a69848) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:59:37 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-4860fa1d-c1fd-42be-9df2-5ac334796922 tempest-VolumesTestJSON-1035044901 None] Flow 'volume_create_manager' (972aa429-58cc-4cca-9f5d-65ea72ed43dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 21:59:37 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-4860fa1d-c1fd-42be-9df2-5ac334796922 tempest-VolumesTestJSON-1035044901 None] Created volume successfully. Sep 17 21:59:38 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-69361f08-b362-483d-b48b-f50abd7343dc tempest-GroupSnapshotsV319Test-528185915 None] group_snapshot 23f36710-94e6-4544-bca2-38cfe389ad3f: deleting Sep 17 21:59:38 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-69361f08-b362-483d-b48b-f50abd7343dc tempest-GroupSnapshotsV319Test-528185915 None] group_snapshot 23f36710-94e6-4544-bca2-38cfe389ad3f: deleting {{(pid=85458) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 17 21:59:38 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-69361f08-b362-483d-b48b-f50abd7343dc tempest-GroupSnapshotsV319Test-528185915 None] Acquiring lock "cinder-quobyte-c162b940-7d4b-478e-9f89-530b75d8fd1e" by "delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 21:59:38 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-69361f08-b362-483d-b48b-f50abd7343dc tempest-GroupSnapshotsV319Test-528185915 None] Lock "cinder-quobyte-c162b940-7d4b-478e-9f89-530b75d8fd1e" acquired by "delete_snapshot" :: waited 0.025s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 21:59:38 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-69361f08-b362-483d-b48b-f50abd7343dc tempest-GroupSnapshotsV319Test-528185915 None] Acquiring lock "cinder-quobyte-db416447-2ce4-49cc-8da6-190587bf5926" by "_delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 21:59:38 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-69361f08-b362-483d-b48b-f50abd7343dc tempest-GroupSnapshotsV319Test-528185915 None] Lock "cinder-quobyte-db416447-2ce4-49cc-8da6-190587bf5926" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 21:59:38 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-69361f08-b362-483d-b48b-f50abd7343dc tempest-GroupSnapshotsV319Test-528185915 None] Deleting offline snapshot db416447-2ce4-49cc-8da6-190587bf5926 of volume c162b940-7d4b-478e-9f89-530b75d8fd1e {{(pid=85458) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 21:59:38 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-69361f08-b362-483d-b48b-f50abd7343dc tempest-GroupSnapshotsV319Test-528185915 None] snapshot_file for this snap is: volume-c162b940-7d4b-478e-9f89-530b75d8fd1e.db416447-2ce4-49cc-8da6-190587bf5926 {{(pid=85458) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 21:59:38 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c7ad754-3a7d-4962-be92-82c16df7522e]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 21:59:38 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-69361f08-b362-483d-b48b-f50abd7343dc tempest-GroupSnapshotsV319Test-528185915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c162b940-7d4b-478e-9f89-530b75d8fd1e.db416447-2ce4-49cc-8da6-190587bf5926 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:59:38 devstack sudo[96288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c162b940-7d4b-478e-9f89-530b75d8fd1e.db416447-2ce4-49cc-8da6-190587bf5926 Sep 17 21:59:38 devstack sudo[96288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:59:38 devstack sudo[96288]: pam_unix(sudo:session): session closed for user root Sep 17 21:59:38 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-69361f08-b362-483d-b48b-f50abd7343dc tempest-GroupSnapshotsV319Test-528185915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c162b940-7d4b-478e-9f89-530b75d8fd1e.db416447-2ce4-49cc-8da6-190587bf5926" returned: 0 in 0.535s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:59:38 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-69361f08-b362-483d-b48b-f50abd7343dc tempest-GroupSnapshotsV319Test-528185915 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c162b940-7d4b-478e-9f89-530b75d8fd1e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85458) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 21:59:38 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[06d5f8fb-4f8c-45af-b387-e0c2cda0e67b]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 21:59:38 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-69361f08-b362-483d-b48b-f50abd7343dc tempest-GroupSnapshotsV319Test-528185915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c162b940-7d4b-478e-9f89-530b75d8fd1e {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:59:38 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-98f5344c-e973-42e1-b8a9-96f5af6ac2fa tempest-VolumesTestJSON-1035044901 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 21:59:38 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-98f5344c-e973-42e1-b8a9-96f5af6ac2fa tempest-VolumesTestJSON-1035044901 None] Flow 'volume_create_manager' (e7ab7f27-0ab5-458c-bb31-b93af34ba16b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 21:59:38 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-98f5344c-e973-42e1-b8a9-96f5af6ac2fa tempest-VolumesTestJSON-1035044901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdbbf91c-ac98-45cc-a2e6-3f2c1cb77f17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:59:38 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-98f5344c-e973-42e1-b8a9-96f5af6ac2fa tempest-VolumesTestJSON-1035044901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdbbf91c-ac98-45cc-a2e6-3f2c1cb77f17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T19:59:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-111113547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7496bdb0-9e87-4f7a-8f28-db99407e0860,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0d81a2d784934b0b9e5570b4465cea05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T19:59:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T19:59:39Z,use_quota=True,user_id='4ed50b4f94ca4192873f348c6b0f5ac0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:59:38 devstack sudo[96294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c162b940-7d4b-478e-9f89-530b75d8fd1e Sep 17 21:59:38 devstack sudo[96294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:59:38 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-98f5344c-e973-42e1-b8a9-96f5af6ac2fa tempest-VolumesTestJSON-1035044901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (543114a6-f029-4ed2-a66d-2404dc16576f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:59:38 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-98f5344c-e973-42e1-b8a9-96f5af6ac2fa tempest-VolumesTestJSON-1035044901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (543114a6-f029-4ed2-a66d-2404dc16576f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:59:38 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-98f5344c-e973-42e1-b8a9-96f5af6ac2fa tempest-VolumesTestJSON-1035044901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b115635b-192d-43c0-84a0-bd9155b85dbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:59:38 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-98f5344c-e973-42e1-b8a9-96f5af6ac2fa tempest-VolumesTestJSON-1035044901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b115635b-192d-43c0-84a0-bd9155b85dbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7496bdb0-9e87-4f7a-8f28-db99407e0860', 'volume_name': 'volume-7496bdb0-9e87-4f7a-8f28-db99407e0860', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:59:39 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-98f5344c-e973-42e1-b8a9-96f5af6ac2fa tempest-VolumesTestJSON-1035044901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79be54b7-5a57-43dc-94c3-82f7e64dc634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:59:39 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-98f5344c-e973-42e1-b8a9-96f5af6ac2fa tempest-VolumesTestJSON-1035044901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79be54b7-5a57-43dc-94c3-82f7e64dc634) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:59:39 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-98f5344c-e973-42e1-b8a9-96f5af6ac2fa tempest-VolumesTestJSON-1035044901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8a01139-e345-4a34-86f6-53669abe2fe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:59:39 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-98f5344c-e973-42e1-b8a9-96f5af6ac2fa tempest-VolumesTestJSON-1035044901 None] Volume 7496bdb0-9e87-4f7a-8f28-db99407e0860: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7496bdb0-9e87-4f7a-8f28-db99407e0860', 'volume_size': 1} Sep 17 21:59:39 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-98f5344c-e973-42e1-b8a9-96f5af6ac2fa tempest-VolumesTestJSON-1035044901 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:59:39 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-98f5344c-e973-42e1-b8a9-96f5af6ac2fa tempest-VolumesTestJSON-1035044901 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:59:39 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-98f5344c-e973-42e1-b8a9-96f5af6ac2fa tempest-VolumesTestJSON-1035044901 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T19:59:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-111113547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7496bdb0-9e87-4f7a-8f28-db99407e0860,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0d81a2d784934b0b9e5570b4465cea05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T19:59:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T19:59:39Z,use_quota=True,user_id='4ed50b4f94ca4192873f348c6b0f5ac0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 21:59:39 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-98f5344c-e973-42e1-b8a9-96f5af6ac2fa tempest-VolumesTestJSON-1035044901 None] Creating volume 7496bdb0-9e87-4f7a-8f28-db99407e0860 {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 21:59:39 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-98f5344c-e973-42e1-b8a9-96f5af6ac2fa tempest-VolumesTestJSON-1035044901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:59:39 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-98f5344c-e973-42e1-b8a9-96f5af6ac2fa tempest-VolumesTestJSON-1035044901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:59:39 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-98f5344c-e973-42e1-b8a9-96f5af6ac2fa tempest-VolumesTestJSON-1035044901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 21:59:39 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-98f5344c-e973-42e1-b8a9-96f5af6ac2fa tempest-VolumesTestJSON-1035044901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 21:59:39 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-98f5344c-e973-42e1-b8a9-96f5af6ac2fa tempest-VolumesTestJSON-1035044901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:59:39 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-98f5344c-e973-42e1-b8a9-96f5af6ac2fa tempest-VolumesTestJSON-1035044901 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 21:59:39 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-98f5344c-e973-42e1-b8a9-96f5af6ac2fa tempest-VolumesTestJSON-1035044901 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 21:59:39 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-98f5344c-e973-42e1-b8a9-96f5af6ac2fa tempest-VolumesTestJSON-1035044901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7496bdb0-9e87-4f7a-8f28-db99407e0860 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:59:39 devstack sudo[96297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7496bdb0-9e87-4f7a-8f28-db99407e0860 1073741824 Sep 17 21:59:39 devstack sudo[96297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:59:39 devstack sudo[96294]: pam_unix(sudo:session): session closed for user root Sep 17 21:59:39 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-69361f08-b362-483d-b48b-f50abd7343dc tempest-GroupSnapshotsV319Test-528185915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c162b940-7d4b-478e-9f89-530b75d8fd1e" returned: 0 in 0.481s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:59:39 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-69361f08-b362-483d-b48b-f50abd7343dc tempest-GroupSnapshotsV319Test-528185915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c162b940-7d4b-478e-9f89-530b75d8fd1e.db416447-2ce4-49cc-8da6-190587bf5926 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:59:39 devstack sudo[96305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c162b940-7d4b-478e-9f89-530b75d8fd1e.db416447-2ce4-49cc-8da6-190587bf5926 Sep 17 21:59:39 devstack sudo[96305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:59:39 devstack sudo[96297]: pam_unix(sudo:session): session closed for user root Sep 17 21:59:39 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-98f5344c-e973-42e1-b8a9-96f5af6ac2fa tempest-VolumesTestJSON-1035044901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7496bdb0-9e87-4f7a-8f28-db99407e0860 1073741824" returned: 0 in 0.594s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:59:39 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-98f5344c-e973-42e1-b8a9-96f5af6ac2fa tempest-VolumesTestJSON-1035044901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7496bdb0-9e87-4f7a-8f28-db99407e0860 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:59:39 devstack sudo[96313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7496bdb0-9e87-4f7a-8f28-db99407e0860 Sep 17 21:59:39 devstack sudo[96313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:59:39 devstack sudo[96305]: pam_unix(sudo:session): session closed for user root Sep 17 21:59:39 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-69361f08-b362-483d-b48b-f50abd7343dc tempest-GroupSnapshotsV319Test-528185915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c162b940-7d4b-478e-9f89-530b75d8fd1e.db416447-2ce4-49cc-8da6-190587bf5926" returned: 0 in 0.469s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:59:39 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-69361f08-b362-483d-b48b-f50abd7343dc tempest-GroupSnapshotsV319Test-528185915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c162b940-7d4b-478e-9f89-530b75d8fd1e.db416447-2ce4-49cc-8da6-190587bf5926 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:59:39 devstack sudo[96315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c162b940-7d4b-478e-9f89-530b75d8fd1e.db416447-2ce4-49cc-8da6-190587bf5926 Sep 17 21:59:39 devstack sudo[96315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:59:40 devstack sudo[96313]: pam_unix(sudo:session): session closed for user root Sep 17 21:59:40 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-98f5344c-e973-42e1-b8a9-96f5af6ac2fa tempest-VolumesTestJSON-1035044901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7496bdb0-9e87-4f7a-8f28-db99407e0860" returned: 0 in 0.367s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:59:40 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-98f5344c-e973-42e1-b8a9-96f5af6ac2fa tempest-VolumesTestJSON-1035044901 None] <== create_volume: return (1026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 21:59:40 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-98f5344c-e973-42e1-b8a9-96f5af6ac2fa tempest-VolumesTestJSON-1035044901 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.029s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:59:40 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-98f5344c-e973-42e1-b8a9-96f5af6ac2fa tempest-VolumesTestJSON-1035044901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8a01139-e345-4a34-86f6-53669abe2fe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7496bdb0-9e87-4f7a-8f28-db99407e0860', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:59:40 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-98f5344c-e973-42e1-b8a9-96f5af6ac2fa tempest-VolumesTestJSON-1035044901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75fa551c-1efc-4408-9c81-2d735bc98b9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:59:40 devstack sudo[96315]: pam_unix(sudo:session): session closed for user root Sep 17 21:59:40 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-98f5344c-e973-42e1-b8a9-96f5af6ac2fa tempest-VolumesTestJSON-1035044901 None] Volume volume-7496bdb0-9e87-4f7a-8f28-db99407e0860 (7496bdb0-9e87-4f7a-8f28-db99407e0860): created successfully Sep 17 21:59:40 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-98f5344c-e973-42e1-b8a9-96f5af6ac2fa tempest-VolumesTestJSON-1035044901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75fa551c-1efc-4408-9c81-2d735bc98b9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:59:40 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-98f5344c-e973-42e1-b8a9-96f5af6ac2fa tempest-VolumesTestJSON-1035044901 None] Flow 'volume_create_manager' (e7ab7f27-0ab5-458c-bb31-b93af34ba16b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 21:59:40 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-69361f08-b362-483d-b48b-f50abd7343dc tempest-GroupSnapshotsV319Test-528185915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c162b940-7d4b-478e-9f89-530b75d8fd1e.db416447-2ce4-49cc-8da6-190587bf5926" returned: 0 in 0.363s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:59:40 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-69361f08-b362-483d-b48b-f50abd7343dc tempest-GroupSnapshotsV319Test-528185915 None] Lock "cinder-quobyte-db416447-2ce4-49cc-8da6-190587bf5926" released by "_delete_snapshot" :: held 2.043s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 21:59:40 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-98f5344c-e973-42e1-b8a9-96f5af6ac2fa tempest-VolumesTestJSON-1035044901 None] Created volume successfully. Sep 17 21:59:40 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-69361f08-b362-483d-b48b-f50abd7343dc tempest-GroupSnapshotsV319Test-528185915 None] Lock "cinder-quobyte-c162b940-7d4b-478e-9f89-530b75d8fd1e" released by "delete_snapshot" :: held 2.072s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 21:59:40 devstack cinder-volume[85458]: WARNING cinder.quota [None req-69361f08-b362-483d-b48b-f50abd7343dc tempest-GroupSnapshotsV319Test-528185915 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-270526473 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-270526473, it is now deprecated. Please use the default quota class for default quota. Sep 17 21:59:40 devstack cinder-volume[85458]: WARNING cinder.quota [None req-69361f08-b362-483d-b48b-f50abd7343dc tempest-GroupSnapshotsV319Test-528185915 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-270526473 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-270526473, it is now deprecated. Please use the default quota class for default quota. Sep 17 21:59:40 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-69361f08-b362-483d-b48b-f50abd7343dc tempest-GroupSnapshotsV319Test-528185915 None] Created reservations ['09a7d695-2dfd-49e4-a7ec-98064f10202a', 'af603370-245e-4c87-818c-96f5d09f5e33', 'c3b3d997-51e8-48ab-aa85-cc49a4c94e27', '3ad4bc9c-d02b-4238-be5b-f26f8a797bc7'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 21:59:40 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-69361f08-b362-483d-b48b-f50abd7343dc tempest-GroupSnapshotsV319Test-528185915 None] group_snapshot 23f36710-94e6-4544-bca2-38cfe389ad3f: deleted successfully Sep 17 21:59:40 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-88cfbf79-0dfe-4404-95d3-e8e442a40ab4 tempest-GroupSnapshotsV319Test-528185915 None] Acquiring lock "cinder-quobyte-c162b940-7d4b-478e-9f89-530b75d8fd1e" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 21:59:40 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-88cfbf79-0dfe-4404-95d3-e8e442a40ab4 tempest-GroupSnapshotsV319Test-528185915 None] Lock "cinder-quobyte-c162b940-7d4b-478e-9f89-530b75d8fd1e" acquired by "delete_volume" :: waited 0.018s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 21:59:40 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aec4f24-4804-4a5d-aea9-d40f29bd175e]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 21:59:40 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-88cfbf79-0dfe-4404-95d3-e8e442a40ab4 tempest-GroupSnapshotsV319Test-528185915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c162b940-7d4b-478e-9f89-530b75d8fd1e {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:59:40 devstack sudo[96319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c162b940-7d4b-478e-9f89-530b75d8fd1e Sep 17 21:59:40 devstack sudo[96319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:59:41 devstack sudo[96319]: pam_unix(sudo:session): session closed for user root Sep 17 21:59:41 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-88cfbf79-0dfe-4404-95d3-e8e442a40ab4 tempest-GroupSnapshotsV319Test-528185915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c162b940-7d4b-478e-9f89-530b75d8fd1e" returned: 0 in 0.538s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:59:41 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-88cfbf79-0dfe-4404-95d3-e8e442a40ab4 tempest-GroupSnapshotsV319Test-528185915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c162b940-7d4b-478e-9f89-530b75d8fd1e {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:59:41 devstack sudo[96324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c162b940-7d4b-478e-9f89-530b75d8fd1e Sep 17 21:59:41 devstack sudo[96324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:59:41 devstack sudo[96324]: pam_unix(sudo:session): session closed for user root Sep 17 21:59:41 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-88cfbf79-0dfe-4404-95d3-e8e442a40ab4 tempest-GroupSnapshotsV319Test-528185915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c162b940-7d4b-478e-9f89-530b75d8fd1e" returned: 0 in 0.375s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:59:41 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-88cfbf79-0dfe-4404-95d3-e8e442a40ab4 tempest-GroupSnapshotsV319Test-528185915 None] Lock "cinder-quobyte-c162b940-7d4b-478e-9f89-530b75d8fd1e" released by "delete_volume" :: held 0.989s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 21:59:41 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-88cfbf79-0dfe-4404-95d3-e8e442a40ab4 tempest-GroupSnapshotsV319Test-528185915 None] Created reservations ['237d1932-7512-4ff1-b4ba-8f69691ae137'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 21:59:41 devstack cinder-volume[85458]: WARNING cinder.quota [None req-88cfbf79-0dfe-4404-95d3-e8e442a40ab4 tempest-GroupSnapshotsV319Test-528185915 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-270526473 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-270526473, it is now deprecated. Please use the default quota class for default quota. Sep 17 21:59:41 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-88cfbf79-0dfe-4404-95d3-e8e442a40ab4 tempest-GroupSnapshotsV319Test-528185915 None] Created reservations ['a1103b68-e0f7-4d1f-a502-1980fea02fe6', '021c4cd8-58ad-4cb9-9c66-9cd5e7c0a199', '02c7dec2-5994-4703-8e2a-73529a5b07f9', '2a9438e0-fbd2-473f-afa8-045984041b28'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 21:59:42 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-88cfbf79-0dfe-4404-95d3-e8e442a40ab4 tempest-GroupSnapshotsV319Test-528185915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:59:42 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-88cfbf79-0dfe-4404-95d3-e8e442a40ab4 tempest-GroupSnapshotsV319Test-528185915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:59:42 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-88cfbf79-0dfe-4404-95d3-e8e442a40ab4 tempest-GroupSnapshotsV319Test-528185915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 21:59:42 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-88cfbf79-0dfe-4404-95d3-e8e442a40ab4 tempest-GroupSnapshotsV319Test-528185915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 21:59:42 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-88cfbf79-0dfe-4404-95d3-e8e442a40ab4 tempest-GroupSnapshotsV319Test-528185915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:59:42 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-88cfbf79-0dfe-4404-95d3-e8e442a40ab4 tempest-GroupSnapshotsV319Test-528185915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:59:42 devstack sudo[96327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 21:59:42 devstack sudo[96327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:59:42 devstack sudo[96327]: pam_unix(sudo:session): session closed for user root Sep 17 21:59:42 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-88cfbf79-0dfe-4404-95d3-e8e442a40ab4 tempest-GroupSnapshotsV319Test-528185915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.311s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:59:42 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-88cfbf79-0dfe-4404-95d3-e8e442a40ab4 tempest-GroupSnapshotsV319Test-528185915 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 21:59:42 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-88cfbf79-0dfe-4404-95d3-e8e442a40ab4 tempest-GroupSnapshotsV319Test-528185915 None] Delete group completed successfully. Sep 17 21:59:42 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-69c7985b-83fc-41b6-a9e6-6f1231e78836 tempest-VolumesTestJSON-1035044901 None] Acquiring lock "cinder-7496bdb0-9e87-4f7a-8f28-db99407e0860-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 21:59:42 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-69c7985b-83fc-41b6-a9e6-6f1231e78836 tempest-VolumesTestJSON-1035044901 None] Lock "cinder-7496bdb0-9e87-4f7a-8f28-db99407e0860-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 21:59:42 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-69c7985b-83fc-41b6-a9e6-6f1231e78836 tempest-VolumesTestJSON-1035044901 None] Acquiring lock "cinder-quobyte-7496bdb0-9e87-4f7a-8f28-db99407e0860" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 21:59:42 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-69c7985b-83fc-41b6-a9e6-6f1231e78836 tempest-VolumesTestJSON-1035044901 None] Lock "cinder-quobyte-7496bdb0-9e87-4f7a-8f28-db99407e0860" acquired by "delete_volume" :: waited 0.014s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 21:59:42 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaea1258-946f-4b8c-8a2f-185af626666e]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 21:59:42 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-69c7985b-83fc-41b6-a9e6-6f1231e78836 tempest-VolumesTestJSON-1035044901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7496bdb0-9e87-4f7a-8f28-db99407e0860 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:59:42 devstack sudo[96331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7496bdb0-9e87-4f7a-8f28-db99407e0860 Sep 17 21:59:42 devstack sudo[96331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:59:43 devstack sudo[96331]: pam_unix(sudo:session): session closed for user root Sep 17 21:59:43 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-69c7985b-83fc-41b6-a9e6-6f1231e78836 tempest-VolumesTestJSON-1035044901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7496bdb0-9e87-4f7a-8f28-db99407e0860" returned: 0 in 0.428s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:59:43 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-69c7985b-83fc-41b6-a9e6-6f1231e78836 tempest-VolumesTestJSON-1035044901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7496bdb0-9e87-4f7a-8f28-db99407e0860 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:59:43 devstack sudo[96336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7496bdb0-9e87-4f7a-8f28-db99407e0860 Sep 17 21:59:43 devstack sudo[96336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:59:43 devstack sudo[96336]: pam_unix(sudo:session): session closed for user root Sep 17 21:59:43 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-69c7985b-83fc-41b6-a9e6-6f1231e78836 tempest-VolumesTestJSON-1035044901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7496bdb0-9e87-4f7a-8f28-db99407e0860" returned: 0 in 0.347s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:59:43 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-69c7985b-83fc-41b6-a9e6-6f1231e78836 tempest-VolumesTestJSON-1035044901 None] Lock "cinder-quobyte-7496bdb0-9e87-4f7a-8f28-db99407e0860" released by "delete_volume" :: held 0.837s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 21:59:43 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-69c7985b-83fc-41b6-a9e6-6f1231e78836 tempest-VolumesTestJSON-1035044901 None] Created reservations ['1b92a8d0-30a5-4bbe-abcd-14d0389e2cdf', 'b080c98a-e0ed-43a5-a2f3-35de589d587b', '553e8496-6d56-4ab5-af15-249316ffbbb6', '0368c304-70b8-4c8c-93f7-cb356897a7b7'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 21:59:43 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-69c7985b-83fc-41b6-a9e6-6f1231e78836 tempest-VolumesTestJSON-1035044901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:59:43 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-69c7985b-83fc-41b6-a9e6-6f1231e78836 tempest-VolumesTestJSON-1035044901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:59:43 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-69c7985b-83fc-41b6-a9e6-6f1231e78836 tempest-VolumesTestJSON-1035044901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 21:59:43 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-69c7985b-83fc-41b6-a9e6-6f1231e78836 tempest-VolumesTestJSON-1035044901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 21:59:43 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-69c7985b-83fc-41b6-a9e6-6f1231e78836 tempest-VolumesTestJSON-1035044901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:59:43 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-69c7985b-83fc-41b6-a9e6-6f1231e78836 tempest-VolumesTestJSON-1035044901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:59:43 devstack sudo[96339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 21:59:43 devstack sudo[96339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:59:43 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-94a8f653-9c3c-437b-9d9e-052c84b42090 tempest-VolumesTestJSON-1035044901 None] Acquiring lock "cinder-4cd86fd2-3094-4542-9966-1372fabf1b67-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 21:59:43 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-94a8f653-9c3c-437b-9d9e-052c84b42090 tempest-VolumesTestJSON-1035044901 None] Lock "cinder-4cd86fd2-3094-4542-9966-1372fabf1b67-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 21:59:43 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-94a8f653-9c3c-437b-9d9e-052c84b42090 tempest-VolumesTestJSON-1035044901 None] Acquiring lock "cinder-quobyte-4cd86fd2-3094-4542-9966-1372fabf1b67" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 21:59:43 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-94a8f653-9c3c-437b-9d9e-052c84b42090 tempest-VolumesTestJSON-1035044901 None] Lock "cinder-quobyte-4cd86fd2-3094-4542-9966-1372fabf1b67" acquired by "delete_volume" :: waited 0.053s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 21:59:44 devstack sudo[96339]: pam_unix(sudo:session): session closed for user root Sep 17 21:59:44 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-69c7985b-83fc-41b6-a9e6-6f1231e78836 tempest-VolumesTestJSON-1035044901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.419s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:59:44 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-69c7985b-83fc-41b6-a9e6-6f1231e78836 tempest-VolumesTestJSON-1035044901 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 21:59:44 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-69c7985b-83fc-41b6-a9e6-6f1231e78836 tempest-VolumesTestJSON-1035044901 None] Deleted volume successfully. Sep 17 21:59:44 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1675cb6-f73c-42a4-945b-e2cceeca304e]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 21:59:44 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-94a8f653-9c3c-437b-9d9e-052c84b42090 tempest-VolumesTestJSON-1035044901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-4cd86fd2-3094-4542-9966-1372fabf1b67 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:59:44 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-69c7985b-83fc-41b6-a9e6-6f1231e78836 tempest-VolumesTestJSON-1035044901 None] Lock "cinder-7496bdb0-9e87-4f7a-8f28-db99407e0860-delete_volume" released by "delete_volume" :: held 1.563s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 21:59:44 devstack sudo[96342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-4cd86fd2-3094-4542-9966-1372fabf1b67 Sep 17 21:59:44 devstack sudo[96342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:59:44 devstack sudo[96342]: pam_unix(sudo:session): session closed for user root Sep 17 21:59:44 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-94a8f653-9c3c-437b-9d9e-052c84b42090 tempest-VolumesTestJSON-1035044901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-4cd86fd2-3094-4542-9966-1372fabf1b67" returned: 0 in 0.465s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:59:44 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-94a8f653-9c3c-437b-9d9e-052c84b42090 tempest-VolumesTestJSON-1035044901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-4cd86fd2-3094-4542-9966-1372fabf1b67 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:59:44 devstack sudo[96347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-4cd86fd2-3094-4542-9966-1372fabf1b67 Sep 17 21:59:44 devstack sudo[96347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:59:44 devstack sudo[96347]: pam_unix(sudo:session): session closed for user root Sep 17 21:59:44 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-94a8f653-9c3c-437b-9d9e-052c84b42090 tempest-VolumesTestJSON-1035044901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-4cd86fd2-3094-4542-9966-1372fabf1b67" returned: 0 in 0.337s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:59:44 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-94a8f653-9c3c-437b-9d9e-052c84b42090 tempest-VolumesTestJSON-1035044901 None] Lock "cinder-quobyte-4cd86fd2-3094-4542-9966-1372fabf1b67" released by "delete_volume" :: held 0.890s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 21:59:44 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-94a8f653-9c3c-437b-9d9e-052c84b42090 tempest-VolumesTestJSON-1035044901 None] Created reservations ['8d5b362e-02bf-4a03-9137-f6006c26ea4e', '0216b505-2807-4d4d-8e85-903f48f79e69', 'f3a49545-b5f6-4f76-982e-ef42947b533d', '99fb4adc-d4cb-4d96-b880-4ea81d601943'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 21:59:45 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-94a8f653-9c3c-437b-9d9e-052c84b42090 tempest-VolumesTestJSON-1035044901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:59:45 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-94a8f653-9c3c-437b-9d9e-052c84b42090 tempest-VolumesTestJSON-1035044901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:59:45 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-94a8f653-9c3c-437b-9d9e-052c84b42090 tempest-VolumesTestJSON-1035044901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 21:59:45 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-94a8f653-9c3c-437b-9d9e-052c84b42090 tempest-VolumesTestJSON-1035044901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 21:59:45 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-94a8f653-9c3c-437b-9d9e-052c84b42090 tempest-VolumesTestJSON-1035044901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:59:45 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-94a8f653-9c3c-437b-9d9e-052c84b42090 tempest-VolumesTestJSON-1035044901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:59:45 devstack sudo[96350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 21:59:45 devstack sudo[96350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:59:45 devstack sudo[96350]: pam_unix(sudo:session): session closed for user root Sep 17 21:59:45 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-94a8f653-9c3c-437b-9d9e-052c84b42090 tempest-VolumesTestJSON-1035044901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.398s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:59:45 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-94a8f653-9c3c-437b-9d9e-052c84b42090 tempest-VolumesTestJSON-1035044901 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 21:59:45 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-94a8f653-9c3c-437b-9d9e-052c84b42090 tempest-VolumesTestJSON-1035044901 None] Deleted volume successfully. Sep 17 21:59:45 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-94a8f653-9c3c-437b-9d9e-052c84b42090 tempest-VolumesTestJSON-1035044901 None] Lock "cinder-4cd86fd2-3094-4542-9966-1372fabf1b67-delete_volume" released by "delete_volume" :: held 1.751s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 21:59:46 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-cf0cacd2-0e4b-4c39-bbff-416f6e42eb39 tempest-VolumesTestJSON-1035044901 None] Acquiring lock "cinder-e1cd73d1-b23e-4c31-bc68-2f2cb2994f6f-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 21:59:46 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-cf0cacd2-0e4b-4c39-bbff-416f6e42eb39 tempest-VolumesTestJSON-1035044901 None] Lock "cinder-e1cd73d1-b23e-4c31-bc68-2f2cb2994f6f-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 21:59:46 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-cf0cacd2-0e4b-4c39-bbff-416f6e42eb39 tempest-VolumesTestJSON-1035044901 None] Acquiring lock "cinder-quobyte-e1cd73d1-b23e-4c31-bc68-2f2cb2994f6f" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 21:59:46 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-cf0cacd2-0e4b-4c39-bbff-416f6e42eb39 tempest-VolumesTestJSON-1035044901 None] Lock "cinder-quobyte-e1cd73d1-b23e-4c31-bc68-2f2cb2994f6f" acquired by "delete_volume" :: waited 0.026s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 21:59:46 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eb3fc3b-b8b1-40c4-bcf5-b51ebcc1fc91]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 21:59:46 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-cf0cacd2-0e4b-4c39-bbff-416f6e42eb39 tempest-VolumesTestJSON-1035044901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e1cd73d1-b23e-4c31-bc68-2f2cb2994f6f {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:59:46 devstack sudo[96353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e1cd73d1-b23e-4c31-bc68-2f2cb2994f6f Sep 17 21:59:46 devstack sudo[96353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:59:47 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cb3e5bf-2bf3-42f8-bc4a-57b52efde6c0 tempest-VolumesCloneNegativeTest-1192651843 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 21:59:47 devstack sudo[96353]: pam_unix(sudo:session): session closed for user root Sep 17 21:59:47 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-0cb3e5bf-2bf3-42f8-bc4a-57b52efde6c0 tempest-VolumesCloneNegativeTest-1192651843 None] Flow 'volume_create_manager' (e2863162-b9cb-469d-bc87-8acb3b8ad6f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 21:59:47 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-0cb3e5bf-2bf3-42f8-bc4a-57b52efde6c0 tempest-VolumesCloneNegativeTest-1192651843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66af0d5a-9e59-4e70-97a7-ac6ba1a178b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:59:47 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-cf0cacd2-0e4b-4c39-bbff-416f6e42eb39 tempest-VolumesTestJSON-1035044901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e1cd73d1-b23e-4c31-bc68-2f2cb2994f6f" returned: 0 in 0.665s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:59:47 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-cf0cacd2-0e4b-4c39-bbff-416f6e42eb39 tempest-VolumesTestJSON-1035044901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e1cd73d1-b23e-4c31-bc68-2f2cb2994f6f {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:59:47 devstack sudo[96358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e1cd73d1-b23e-4c31-bc68-2f2cb2994f6f Sep 17 21:59:47 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-0cb3e5bf-2bf3-42f8-bc4a-57b52efde6c0 tempest-VolumesCloneNegativeTest-1192651843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66af0d5a-9e59-4e70-97a7-ac6ba1a178b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T19:59:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-667421345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7007c515-dfb8-470d-8dea-e708e8003dcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66c8571101b141c9aa5adf861d346105',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T19:59:47Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T19:59:47Z,use_quota=True,user_id='d1337cc14f4742fabd1bd60f552be2e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:59:47 devstack sudo[96358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:59:47 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-0cb3e5bf-2bf3-42f8-bc4a-57b52efde6c0 tempest-VolumesCloneNegativeTest-1192651843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a69c9051-8cab-4f8a-8bcf-d303dfb61031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:59:47 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-0cb3e5bf-2bf3-42f8-bc4a-57b52efde6c0 tempest-VolumesCloneNegativeTest-1192651843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a69c9051-8cab-4f8a-8bcf-d303dfb61031) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:59:47 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-0cb3e5bf-2bf3-42f8-bc4a-57b52efde6c0 tempest-VolumesCloneNegativeTest-1192651843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dde08a2-f4df-4ca7-b998-acdc055d5aba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:59:47 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-0cb3e5bf-2bf3-42f8-bc4a-57b52efde6c0 tempest-VolumesCloneNegativeTest-1192651843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dde08a2-f4df-4ca7-b998-acdc055d5aba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7007c515-dfb8-470d-8dea-e708e8003dcc', 'volume_name': 'volume-7007c515-dfb8-470d-8dea-e708e8003dcc', 'volume_size': 2}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:59:47 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-0cb3e5bf-2bf3-42f8-bc4a-57b52efde6c0 tempest-VolumesCloneNegativeTest-1192651843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e55305b4-6d29-41a8-856d-feb7cb18fd71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:59:47 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-0cb3e5bf-2bf3-42f8-bc4a-57b52efde6c0 tempest-VolumesCloneNegativeTest-1192651843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e55305b4-6d29-41a8-856d-feb7cb18fd71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:59:47 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-0cb3e5bf-2bf3-42f8-bc4a-57b52efde6c0 tempest-VolumesCloneNegativeTest-1192651843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04f563ca-db39-4ffc-9195-8614bbf63070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:59:47 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-0cb3e5bf-2bf3-42f8-bc4a-57b52efde6c0 tempest-VolumesCloneNegativeTest-1192651843 None] Volume 7007c515-dfb8-470d-8dea-e708e8003dcc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7007c515-dfb8-470d-8dea-e708e8003dcc', 'volume_size': 2} Sep 17 21:59:47 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-0cb3e5bf-2bf3-42f8-bc4a-57b52efde6c0 tempest-VolumesCloneNegativeTest-1192651843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:59:47 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-0cb3e5bf-2bf3-42f8-bc4a-57b52efde6c0 tempest-VolumesCloneNegativeTest-1192651843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:59:47 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-0cb3e5bf-2bf3-42f8-bc4a-57b52efde6c0 tempest-VolumesCloneNegativeTest-1192651843 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T19:59:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-667421345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7007c515-dfb8-470d-8dea-e708e8003dcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66c8571101b141c9aa5adf861d346105',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T19:59:47Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T19:59:47Z,use_quota=True,user_id='d1337cc14f4742fabd1bd60f552be2e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 21:59:47 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-0cb3e5bf-2bf3-42f8-bc4a-57b52efde6c0 tempest-VolumesCloneNegativeTest-1192651843 None] Creating volume 7007c515-dfb8-470d-8dea-e708e8003dcc {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 21:59:47 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-0cb3e5bf-2bf3-42f8-bc4a-57b52efde6c0 tempest-VolumesCloneNegativeTest-1192651843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:59:47 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-0cb3e5bf-2bf3-42f8-bc4a-57b52efde6c0 tempest-VolumesCloneNegativeTest-1192651843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:59:47 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-0cb3e5bf-2bf3-42f8-bc4a-57b52efde6c0 tempest-VolumesCloneNegativeTest-1192651843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 21:59:47 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-0cb3e5bf-2bf3-42f8-bc4a-57b52efde6c0 tempest-VolumesCloneNegativeTest-1192651843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 21:59:47 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-0cb3e5bf-2bf3-42f8-bc4a-57b52efde6c0 tempest-VolumesCloneNegativeTest-1192651843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:59:47 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-0cb3e5bf-2bf3-42f8-bc4a-57b52efde6c0 tempest-VolumesCloneNegativeTest-1192651843 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 21:59:47 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-0cb3e5bf-2bf3-42f8-bc4a-57b52efde6c0 tempest-VolumesCloneNegativeTest-1192651843 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 21:59:47 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-0cb3e5bf-2bf3-42f8-bc4a-57b52efde6c0 tempest-VolumesCloneNegativeTest-1192651843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7007c515-dfb8-470d-8dea-e708e8003dcc 2147483648 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:59:47 devstack sudo[96360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7007c515-dfb8-470d-8dea-e708e8003dcc 2147483648 Sep 17 21:59:47 devstack sudo[96360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:59:47 devstack sudo[96358]: pam_unix(sudo:session): session closed for user root Sep 17 21:59:47 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-cf0cacd2-0e4b-4c39-bbff-416f6e42eb39 tempest-VolumesTestJSON-1035044901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e1cd73d1-b23e-4c31-bc68-2f2cb2994f6f" returned: 0 in 0.319s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:59:47 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-cf0cacd2-0e4b-4c39-bbff-416f6e42eb39 tempest-VolumesTestJSON-1035044901 None] Lock "cinder-quobyte-e1cd73d1-b23e-4c31-bc68-2f2cb2994f6f" released by "delete_volume" :: held 1.073s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 21:59:47 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-cf0cacd2-0e4b-4c39-bbff-416f6e42eb39 tempest-VolumesTestJSON-1035044901 None] Created reservations ['bf8edea7-f547-4cfd-9266-f0cedde1d972', '909b2173-eea0-4b52-aa7a-651b61c94558', 'cb12f6ef-b62f-4b66-a003-c3bb355edabf', '67c6269c-b1ae-43c5-a4fa-225ffa368809'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 21:59:47 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-cf0cacd2-0e4b-4c39-bbff-416f6e42eb39 tempest-VolumesTestJSON-1035044901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:59:47 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-cf0cacd2-0e4b-4c39-bbff-416f6e42eb39 tempest-VolumesTestJSON-1035044901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:59:47 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-cf0cacd2-0e4b-4c39-bbff-416f6e42eb39 tempest-VolumesTestJSON-1035044901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 21:59:47 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-cf0cacd2-0e4b-4c39-bbff-416f6e42eb39 tempest-VolumesTestJSON-1035044901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 21:59:47 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-cf0cacd2-0e4b-4c39-bbff-416f6e42eb39 tempest-VolumesTestJSON-1035044901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:59:47 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-cf0cacd2-0e4b-4c39-bbff-416f6e42eb39 tempest-VolumesTestJSON-1035044901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:59:47 devstack sudo[96366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 21:59:47 devstack sudo[96366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:59:47 devstack sudo[96360]: pam_unix(sudo:session): session closed for user root Sep 17 21:59:47 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-0cb3e5bf-2bf3-42f8-bc4a-57b52efde6c0 tempest-VolumesCloneNegativeTest-1192651843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7007c515-dfb8-470d-8dea-e708e8003dcc 2147483648" returned: 0 in 0.793s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:59:48 devstack sudo[96366]: pam_unix(sudo:session): session closed for user root Sep 17 21:59:48 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-0cb3e5bf-2bf3-42f8-bc4a-57b52efde6c0 tempest-VolumesCloneNegativeTest-1192651843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7007c515-dfb8-470d-8dea-e708e8003dcc {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:59:48 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-cf0cacd2-0e4b-4c39-bbff-416f6e42eb39 tempest-VolumesTestJSON-1035044901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.391s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:59:48 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-cf0cacd2-0e4b-4c39-bbff-416f6e42eb39 tempest-VolumesTestJSON-1035044901 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 21:59:48 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-cf0cacd2-0e4b-4c39-bbff-416f6e42eb39 tempest-VolumesTestJSON-1035044901 None] Deleted volume successfully. Sep 17 21:59:48 devstack sudo[96370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7007c515-dfb8-470d-8dea-e708e8003dcc Sep 17 21:59:48 devstack sudo[96370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:59:48 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-cf0cacd2-0e4b-4c39-bbff-416f6e42eb39 tempest-VolumesTestJSON-1035044901 None] Lock "cinder-e1cd73d1-b23e-4c31-bc68-2f2cb2994f6f-delete_volume" released by "delete_volume" :: held 1.814s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 21:59:48 devstack sudo[96370]: pam_unix(sudo:session): session closed for user root Sep 17 21:59:48 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-0cb3e5bf-2bf3-42f8-bc4a-57b52efde6c0 tempest-VolumesCloneNegativeTest-1192651843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7007c515-dfb8-470d-8dea-e708e8003dcc" returned: 0 in 0.259s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:59:48 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-0cb3e5bf-2bf3-42f8-bc4a-57b52efde6c0 tempest-VolumesCloneNegativeTest-1192651843 None] <== create_volume: return (1124ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 21:59:48 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-0cb3e5bf-2bf3-42f8-bc4a-57b52efde6c0 tempest-VolumesCloneNegativeTest-1192651843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.128s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:59:48 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-0cb3e5bf-2bf3-42f8-bc4a-57b52efde6c0 tempest-VolumesCloneNegativeTest-1192651843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04f563ca-db39-4ffc-9195-8614bbf63070) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7007c515-dfb8-470d-8dea-e708e8003dcc', 'volume_size': 2}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:59:48 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-0cb3e5bf-2bf3-42f8-bc4a-57b52efde6c0 tempest-VolumesCloneNegativeTest-1192651843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dfed02e-0784-4e81-847d-d83b0d4994e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 21:59:48 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-0cb3e5bf-2bf3-42f8-bc4a-57b52efde6c0 tempest-VolumesCloneNegativeTest-1192651843 None] Volume volume-7007c515-dfb8-470d-8dea-e708e8003dcc (7007c515-dfb8-470d-8dea-e708e8003dcc): created successfully Sep 17 21:59:48 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-0cb3e5bf-2bf3-42f8-bc4a-57b52efde6c0 tempest-VolumesCloneNegativeTest-1192651843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dfed02e-0784-4e81-847d-d83b0d4994e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 21:59:48 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-0cb3e5bf-2bf3-42f8-bc4a-57b52efde6c0 tempest-VolumesCloneNegativeTest-1192651843 None] Flow 'volume_create_manager' (e2863162-b9cb-469d-bc87-8acb3b8ad6f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 21:59:48 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-0cb3e5bf-2bf3-42f8-bc4a-57b52efde6c0 tempest-VolumesCloneNegativeTest-1192651843 None] Created volume successfully. Sep 17 21:59:49 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-526f29ea-7e76-4022-895e-af7bbc7943f6 tempest-VolumesCloneNegativeTest-1192651843 None] Acquiring lock "cinder-7007c515-dfb8-470d-8dea-e708e8003dcc-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 21:59:49 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-526f29ea-7e76-4022-895e-af7bbc7943f6 tempest-VolumesCloneNegativeTest-1192651843 None] Lock "cinder-7007c515-dfb8-470d-8dea-e708e8003dcc-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 21:59:49 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-526f29ea-7e76-4022-895e-af7bbc7943f6 tempest-VolumesCloneNegativeTest-1192651843 None] Acquiring lock "cinder-quobyte-7007c515-dfb8-470d-8dea-e708e8003dcc" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 21:59:49 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-526f29ea-7e76-4022-895e-af7bbc7943f6 tempest-VolumesCloneNegativeTest-1192651843 None] Lock "cinder-quobyte-7007c515-dfb8-470d-8dea-e708e8003dcc" acquired by "delete_volume" :: waited 0.021s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 21:59:49 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7ecc12a-e061-4596-8e83-c940e1e3f544]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 21:59:49 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-526f29ea-7e76-4022-895e-af7bbc7943f6 tempest-VolumesCloneNegativeTest-1192651843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7007c515-dfb8-470d-8dea-e708e8003dcc {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:59:49 devstack sudo[96375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7007c515-dfb8-470d-8dea-e708e8003dcc Sep 17 21:59:49 devstack sudo[96375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:59:50 devstack sudo[96375]: pam_unix(sudo:session): session closed for user root Sep 17 21:59:50 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-526f29ea-7e76-4022-895e-af7bbc7943f6 tempest-VolumesCloneNegativeTest-1192651843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7007c515-dfb8-470d-8dea-e708e8003dcc" returned: 0 in 0.550s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:59:50 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-526f29ea-7e76-4022-895e-af7bbc7943f6 tempest-VolumesCloneNegativeTest-1192651843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7007c515-dfb8-470d-8dea-e708e8003dcc {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:59:50 devstack sudo[96380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7007c515-dfb8-470d-8dea-e708e8003dcc Sep 17 21:59:50 devstack sudo[96380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:59:50 devstack sudo[96380]: pam_unix(sudo:session): session closed for user root Sep 17 21:59:50 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-526f29ea-7e76-4022-895e-af7bbc7943f6 tempest-VolumesCloneNegativeTest-1192651843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7007c515-dfb8-470d-8dea-e708e8003dcc" returned: 0 in 0.337s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:59:50 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-526f29ea-7e76-4022-895e-af7bbc7943f6 tempest-VolumesCloneNegativeTest-1192651843 None] Lock "cinder-quobyte-7007c515-dfb8-470d-8dea-e708e8003dcc" released by "delete_volume" :: held 0.983s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 21:59:50 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-526f29ea-7e76-4022-895e-af7bbc7943f6 tempest-VolumesCloneNegativeTest-1192651843 None] Created reservations ['c6423a79-5f7e-4ac5-a623-f7cbc683b34c', '30d584bf-0073-4548-b646-c0835151a044', '6bbd9238-f23a-4c51-8d37-8f7dbc3e0a48', '0611f0c7-a12b-4baa-98fb-f48fcd44460d'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 21:59:50 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-526f29ea-7e76-4022-895e-af7bbc7943f6 tempest-VolumesCloneNegativeTest-1192651843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 21:59:50 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-526f29ea-7e76-4022-895e-af7bbc7943f6 tempest-VolumesCloneNegativeTest-1192651843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 21:59:50 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-526f29ea-7e76-4022-895e-af7bbc7943f6 tempest-VolumesCloneNegativeTest-1192651843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 21:59:50 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-526f29ea-7e76-4022-895e-af7bbc7943f6 tempest-VolumesCloneNegativeTest-1192651843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 21:59:50 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-526f29ea-7e76-4022-895e-af7bbc7943f6 tempest-VolumesCloneNegativeTest-1192651843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 21:59:50 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-526f29ea-7e76-4022-895e-af7bbc7943f6 tempest-VolumesCloneNegativeTest-1192651843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 21:59:50 devstack sudo[96384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 21:59:50 devstack sudo[96384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 21:59:51 devstack sudo[96384]: pam_unix(sudo:session): session closed for user root Sep 17 21:59:51 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-526f29ea-7e76-4022-895e-af7bbc7943f6 tempest-VolumesCloneNegativeTest-1192651843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.344s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 21:59:51 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-526f29ea-7e76-4022-895e-af7bbc7943f6 tempest-VolumesCloneNegativeTest-1192651843 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 21:59:51 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-526f29ea-7e76-4022-895e-af7bbc7943f6 tempest-VolumesCloneNegativeTest-1192651843 None] Deleted volume successfully. Sep 17 21:59:51 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-526f29ea-7e76-4022-895e-af7bbc7943f6 tempest-VolumesCloneNegativeTest-1192651843 None] Lock "cinder-7007c515-dfb8-470d-8dea-e708e8003dcc-delete_volume" released by "delete_volume" :: held 1.687s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:00:00 devstack cinder-volume[85458]: DEBUG dbcounter [-] [85458] Writing DB stats cinder:UPDATE=84,cinder:DELETE=8,cinder:SELECT=61,cinder:INSERT=19 {{(pid=85458) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 22:00:01 devstack cinder-volume[85458]: DEBUG dbcounter [-] [85458] Writing DB stats cinder:SELECT=64,cinder:INSERT=21,cinder:UPDATE=85,cinder:DELETE=4 {{(pid=85458) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 22:00:01 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-7a7c3835-4999-4b48-9680-71dce21e58bb tempest-BackendsCapabilitiesAdminTestsJSON-82121492 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.759220123291, 'free_capacity_gb': 1775.759220123291, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=85458) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 17 22:00:01 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-53329981-b41f-479b-bef2-db1c8d3b847e tempest-BackendsCapabilitiesAdminTestsJSON-82121492 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.759220123291, 'free_capacity_gb': 1775.759220123291, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=85458) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 17 22:00:05 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-94f9de2f-213c-48b4-ad6e-4ba35e088fc3 tempest-VolumesSnapshotNegativeTestJSON-1050196357 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 22:00:05 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-94f9de2f-213c-48b4-ad6e-4ba35e088fc3 tempest-VolumesSnapshotNegativeTestJSON-1050196357 None] Flow 'volume_create_manager' (31171f9d-c43c-4621-af40-314cf27d4e74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:00:05 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-94f9de2f-213c-48b4-ad6e-4ba35e088fc3 tempest-VolumesSnapshotNegativeTestJSON-1050196357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33930a86-94b7-485a-9aa2-d7a2e28a28fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:00:05 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-94f9de2f-213c-48b4-ad6e-4ba35e088fc3 tempest-VolumesSnapshotNegativeTestJSON-1050196357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33930a86-94b7-485a-9aa2-d7a2e28a28fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:00:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-222801342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6a7a1d0-8eaa-4ee8-8ef6-1ec82865e2b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41573e28c1ac47ea8ad149bc3a516d7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:00:05Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:00:05Z,use_quota=True,user_id='743f9c773cca40bda07e8290642a338e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:00:05 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-94f9de2f-213c-48b4-ad6e-4ba35e088fc3 tempest-VolumesSnapshotNegativeTestJSON-1050196357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (570496cb-277f-49d0-80c8-d3d8ffebed3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:00:05 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-94f9de2f-213c-48b4-ad6e-4ba35e088fc3 tempest-VolumesSnapshotNegativeTestJSON-1050196357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (570496cb-277f-49d0-80c8-d3d8ffebed3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:00:05 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-94f9de2f-213c-48b4-ad6e-4ba35e088fc3 tempest-VolumesSnapshotNegativeTestJSON-1050196357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (587fe4aa-6584-4228-9563-f417bf2deffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:00:05 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-94f9de2f-213c-48b4-ad6e-4ba35e088fc3 tempest-VolumesSnapshotNegativeTestJSON-1050196357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (587fe4aa-6584-4228-9563-f417bf2deffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6a7a1d0-8eaa-4ee8-8ef6-1ec82865e2b3', 'volume_name': 'volume-f6a7a1d0-8eaa-4ee8-8ef6-1ec82865e2b3', 'volume_size': 2}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:00:05 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-94f9de2f-213c-48b4-ad6e-4ba35e088fc3 tempest-VolumesSnapshotNegativeTestJSON-1050196357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f8ed52a-4c3d-4e63-89e5-1d673bf86a70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:00:05 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-94f9de2f-213c-48b4-ad6e-4ba35e088fc3 tempest-VolumesSnapshotNegativeTestJSON-1050196357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f8ed52a-4c3d-4e63-89e5-1d673bf86a70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:00:05 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-94f9de2f-213c-48b4-ad6e-4ba35e088fc3 tempest-VolumesSnapshotNegativeTestJSON-1050196357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b687c065-4d46-43d0-ae95-52dc9206f21a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:00:05 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-94f9de2f-213c-48b4-ad6e-4ba35e088fc3 tempest-VolumesSnapshotNegativeTestJSON-1050196357 None] Volume f6a7a1d0-8eaa-4ee8-8ef6-1ec82865e2b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6a7a1d0-8eaa-4ee8-8ef6-1ec82865e2b3', 'volume_size': 2} Sep 17 22:00:05 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-94f9de2f-213c-48b4-ad6e-4ba35e088fc3 tempest-VolumesSnapshotNegativeTestJSON-1050196357 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:00:05 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-94f9de2f-213c-48b4-ad6e-4ba35e088fc3 tempest-VolumesSnapshotNegativeTestJSON-1050196357 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:00:05 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-94f9de2f-213c-48b4-ad6e-4ba35e088fc3 tempest-VolumesSnapshotNegativeTestJSON-1050196357 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:00:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-222801342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6a7a1d0-8eaa-4ee8-8ef6-1ec82865e2b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41573e28c1ac47ea8ad149bc3a516d7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:00:05Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:00:05Z,use_quota=True,user_id='743f9c773cca40bda07e8290642a338e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 22:00:05 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-94f9de2f-213c-48b4-ad6e-4ba35e088fc3 tempest-VolumesSnapshotNegativeTestJSON-1050196357 None] Creating volume f6a7a1d0-8eaa-4ee8-8ef6-1ec82865e2b3 {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 22:00:05 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-94f9de2f-213c-48b4-ad6e-4ba35e088fc3 tempest-VolumesSnapshotNegativeTestJSON-1050196357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:00:05 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-94f9de2f-213c-48b4-ad6e-4ba35e088fc3 tempest-VolumesSnapshotNegativeTestJSON-1050196357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:00:05 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-94f9de2f-213c-48b4-ad6e-4ba35e088fc3 tempest-VolumesSnapshotNegativeTestJSON-1050196357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:00:05 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-94f9de2f-213c-48b4-ad6e-4ba35e088fc3 tempest-VolumesSnapshotNegativeTestJSON-1050196357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:00:05 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-94f9de2f-213c-48b4-ad6e-4ba35e088fc3 tempest-VolumesSnapshotNegativeTestJSON-1050196357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:00:05 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-94f9de2f-213c-48b4-ad6e-4ba35e088fc3 tempest-VolumesSnapshotNegativeTestJSON-1050196357 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 22:00:05 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-94f9de2f-213c-48b4-ad6e-4ba35e088fc3 tempest-VolumesSnapshotNegativeTestJSON-1050196357 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 22:00:05 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-94f9de2f-213c-48b4-ad6e-4ba35e088fc3 tempest-VolumesSnapshotNegativeTestJSON-1050196357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f6a7a1d0-8eaa-4ee8-8ef6-1ec82865e2b3 2147483648 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:00:05 devstack sudo[96388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f6a7a1d0-8eaa-4ee8-8ef6-1ec82865e2b3 2147483648 Sep 17 22:00:05 devstack sudo[96388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:00:05 devstack sudo[96388]: pam_unix(sudo:session): session closed for user root Sep 17 22:00:05 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-94f9de2f-213c-48b4-ad6e-4ba35e088fc3 tempest-VolumesSnapshotNegativeTestJSON-1050196357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f6a7a1d0-8eaa-4ee8-8ef6-1ec82865e2b3 2147483648" returned: 0 in 0.630s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:00:05 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-94f9de2f-213c-48b4-ad6e-4ba35e088fc3 tempest-VolumesSnapshotNegativeTestJSON-1050196357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f6a7a1d0-8eaa-4ee8-8ef6-1ec82865e2b3 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:00:05 devstack sudo[96395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f6a7a1d0-8eaa-4ee8-8ef6-1ec82865e2b3 Sep 17 22:00:05 devstack sudo[96395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:00:06 devstack sudo[96395]: pam_unix(sudo:session): session closed for user root Sep 17 22:00:06 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-94f9de2f-213c-48b4-ad6e-4ba35e088fc3 tempest-VolumesSnapshotNegativeTestJSON-1050196357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f6a7a1d0-8eaa-4ee8-8ef6-1ec82865e2b3" returned: 0 in 0.287s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:00:06 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-94f9de2f-213c-48b4-ad6e-4ba35e088fc3 tempest-VolumesSnapshotNegativeTestJSON-1050196357 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 22:00:06 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-94f9de2f-213c-48b4-ad6e-4ba35e088fc3 tempest-VolumesSnapshotNegativeTestJSON-1050196357 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.989s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:00:06 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-94f9de2f-213c-48b4-ad6e-4ba35e088fc3 tempest-VolumesSnapshotNegativeTestJSON-1050196357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b687c065-4d46-43d0-ae95-52dc9206f21a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6a7a1d0-8eaa-4ee8-8ef6-1ec82865e2b3', 'volume_size': 2}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:00:06 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-94f9de2f-213c-48b4-ad6e-4ba35e088fc3 tempest-VolumesSnapshotNegativeTestJSON-1050196357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15a3a656-a260-48dc-9530-14196f93ade0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:00:06 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-94f9de2f-213c-48b4-ad6e-4ba35e088fc3 tempest-VolumesSnapshotNegativeTestJSON-1050196357 None] Volume volume-f6a7a1d0-8eaa-4ee8-8ef6-1ec82865e2b3 (f6a7a1d0-8eaa-4ee8-8ef6-1ec82865e2b3): created successfully Sep 17 22:00:06 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-94f9de2f-213c-48b4-ad6e-4ba35e088fc3 tempest-VolumesSnapshotNegativeTestJSON-1050196357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15a3a656-a260-48dc-9530-14196f93ade0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:00:06 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-94f9de2f-213c-48b4-ad6e-4ba35e088fc3 tempest-VolumesSnapshotNegativeTestJSON-1050196357 None] Flow 'volume_create_manager' (31171f9d-c43c-4621-af40-314cf27d4e74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:00:06 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-94f9de2f-213c-48b4-ad6e-4ba35e088fc3 tempest-VolumesSnapshotNegativeTestJSON-1050196357 None] Created volume successfully. Sep 17 22:00:07 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-80ad1b2c-05a5-46e0-8388-c4aee748f4d1 tempest-VolumesSnapshotNegativeTestJSON-1050196357 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:00:07 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-80ad1b2c-05a5-46e0-8388-c4aee748f4d1 tempest-VolumesSnapshotNegativeTestJSON-1050196357 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:00:07 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-80ad1b2c-05a5-46e0-8388-c4aee748f4d1 tempest-VolumesSnapshotNegativeTestJSON-1050196357 None] Creating offline snapshot 223187b7-209b-41c7-a663-406bc603a205 of volume f6a7a1d0-8eaa-4ee8-8ef6-1ec82865e2b3 {{(pid=85458) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 22:00:07 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d8bca09-8e20-4543-b753-bec3f7ad898e]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:00:07 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-80ad1b2c-05a5-46e0-8388-c4aee748f4d1 tempest-VolumesSnapshotNegativeTestJSON-1050196357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f6a7a1d0-8eaa-4ee8-8ef6-1ec82865e2b3 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:00:07 devstack sudo[96398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f6a7a1d0-8eaa-4ee8-8ef6-1ec82865e2b3 Sep 17 22:00:07 devstack sudo[96398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:00:08 devstack sudo[96398]: pam_unix(sudo:session): session closed for user root Sep 17 22:00:08 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-80ad1b2c-05a5-46e0-8388-c4aee748f4d1 tempest-VolumesSnapshotNegativeTestJSON-1050196357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f6a7a1d0-8eaa-4ee8-8ef6-1ec82865e2b3" returned: 0 in 0.589s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:00:08 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-80ad1b2c-05a5-46e0-8388-c4aee748f4d1 tempest-VolumesSnapshotNegativeTestJSON-1050196357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f6a7a1d0-8eaa-4ee8-8ef6-1ec82865e2b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f6a7a1d0-8eaa-4ee8-8ef6-1ec82865e2b3.223187b7-209b-41c7-a663-406bc603a205 2G {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:00:08 devstack sudo[96403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f6a7a1d0-8eaa-4ee8-8ef6-1ec82865e2b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f6a7a1d0-8eaa-4ee8-8ef6-1ec82865e2b3.223187b7-209b-41c7-a663-406bc603a205 2G Sep 17 22:00:08 devstack sudo[96403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:00:08 devstack sudo[96403]: pam_unix(sudo:session): session closed for user root Sep 17 22:00:08 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-80ad1b2c-05a5-46e0-8388-c4aee748f4d1 tempest-VolumesSnapshotNegativeTestJSON-1050196357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f6a7a1d0-8eaa-4ee8-8ef6-1ec82865e2b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f6a7a1d0-8eaa-4ee8-8ef6-1ec82865e2b3.223187b7-209b-41c7-a663-406bc603a205 2G" returned: 0 in 0.598s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:00:08 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-80ad1b2c-05a5-46e0-8388-c4aee748f4d1 tempest-VolumesSnapshotNegativeTestJSON-1050196357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6a7a1d0-8eaa-4ee8-8ef6-1ec82865e2b3 -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f6a7a1d0-8eaa-4ee8-8ef6-1ec82865e2b3.223187b7-209b-41c7-a663-406bc603a205 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:00:08 devstack sudo[96409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6a7a1d0-8eaa-4ee8-8ef6-1ec82865e2b3 -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f6a7a1d0-8eaa-4ee8-8ef6-1ec82865e2b3.223187b7-209b-41c7-a663-406bc603a205 Sep 17 22:00:08 devstack sudo[96409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:00:09 devstack sudo[96409]: pam_unix(sudo:session): session closed for user root Sep 17 22:00:09 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-80ad1b2c-05a5-46e0-8388-c4aee748f4d1 tempest-VolumesSnapshotNegativeTestJSON-1050196357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6a7a1d0-8eaa-4ee8-8ef6-1ec82865e2b3 -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f6a7a1d0-8eaa-4ee8-8ef6-1ec82865e2b3.223187b7-209b-41c7-a663-406bc603a205" returned: 0 in 0.480s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:00:09 devstack cinder-volume[85458]: WARNING cinder.volume.drivers.remotefs [None req-80ad1b2c-05a5-46e0-8388-c4aee748f4d1 tempest-VolumesSnapshotNegativeTestJSON-1050196357 None] /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f6a7a1d0-8eaa-4ee8-8ef6-1ec82865e2b3.223187b7-209b-41c7-a663-406bc603a205 is being set with open permissions: ugo+rw Sep 17 22:00:09 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-80ad1b2c-05a5-46e0-8388-c4aee748f4d1 tempest-VolumesSnapshotNegativeTestJSON-1050196357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f6a7a1d0-8eaa-4ee8-8ef6-1ec82865e2b3.223187b7-209b-41c7-a663-406bc603a205 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:00:09 devstack sudo[96416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f6a7a1d0-8eaa-4ee8-8ef6-1ec82865e2b3.223187b7-209b-41c7-a663-406bc603a205 Sep 17 22:00:09 devstack sudo[96416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:00:09 devstack sudo[96416]: pam_unix(sudo:session): session closed for user root Sep 17 22:00:09 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-80ad1b2c-05a5-46e0-8388-c4aee748f4d1 tempest-VolumesSnapshotNegativeTestJSON-1050196357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f6a7a1d0-8eaa-4ee8-8ef6-1ec82865e2b3.223187b7-209b-41c7-a663-406bc603a205" returned: 0 in 0.337s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:00:09 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-80ad1b2c-05a5-46e0-8388-c4aee748f4d1 tempest-VolumesSnapshotNegativeTestJSON-1050196357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f6a7a1d0-8eaa-4ee8-8ef6-1ec82865e2b3.info {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:00:09 devstack sudo[96419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f6a7a1d0-8eaa-4ee8-8ef6-1ec82865e2b3.info Sep 17 22:00:09 devstack sudo[96419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:00:09 devstack sudo[96419]: pam_unix(sudo:session): session closed for user root Sep 17 22:00:09 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-80ad1b2c-05a5-46e0-8388-c4aee748f4d1 tempest-VolumesSnapshotNegativeTestJSON-1050196357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f6a7a1d0-8eaa-4ee8-8ef6-1ec82865e2b3.info" returned: 0 in 0.409s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:00:09 devstack cinder-volume[85458]: WARNING cinder.volume.drivers.remotefs [None req-80ad1b2c-05a5-46e0-8388-c4aee748f4d1 tempest-VolumesSnapshotNegativeTestJSON-1050196357 None] /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f6a7a1d0-8eaa-4ee8-8ef6-1ec82865e2b3.info is being set with open permissions: ugo+rw Sep 17 22:00:09 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-80ad1b2c-05a5-46e0-8388-c4aee748f4d1 tempest-VolumesSnapshotNegativeTestJSON-1050196357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f6a7a1d0-8eaa-4ee8-8ef6-1ec82865e2b3.info {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:00:09 devstack sudo[96428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f6a7a1d0-8eaa-4ee8-8ef6-1ec82865e2b3.info Sep 17 22:00:09 devstack sudo[96428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:00:10 devstack sudo[96428]: pam_unix(sudo:session): session closed for user root Sep 17 22:00:10 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-80ad1b2c-05a5-46e0-8388-c4aee748f4d1 tempest-VolumesSnapshotNegativeTestJSON-1050196357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f6a7a1d0-8eaa-4ee8-8ef6-1ec82865e2b3.info" returned: 0 in 0.320s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:00:10 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-80ad1b2c-05a5-46e0-8388-c4aee748f4d1 tempest-VolumesSnapshotNegativeTestJSON-1050196357 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.881s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:00:10 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-80ad1b2c-05a5-46e0-8388-c4aee748f4d1 tempest-VolumesSnapshotNegativeTestJSON-1050196357 None] Create snapshot completed successfully Sep 17 22:00:10 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-653be84c-7415-45ac-b2dd-496ecac13e40 tempest-VolumesSnapshotNegativeTestJSON-1050196357 None] Acquiring lock "cinder-223187b7-209b-41c7-a663-406bc603a205-delete_snapshot" by "delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:00:10 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-653be84c-7415-45ac-b2dd-496ecac13e40 tempest-VolumesSnapshotNegativeTestJSON-1050196357 None] Lock "cinder-223187b7-209b-41c7-a663-406bc603a205-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:00:10 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-653be84c-7415-45ac-b2dd-496ecac13e40 tempest-VolumesSnapshotNegativeTestJSON-1050196357 None] Acquiring lock "cinder-quobyte-f6a7a1d0-8eaa-4ee8-8ef6-1ec82865e2b3" by "delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:00:10 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-653be84c-7415-45ac-b2dd-496ecac13e40 tempest-VolumesSnapshotNegativeTestJSON-1050196357 None] Lock "cinder-quobyte-f6a7a1d0-8eaa-4ee8-8ef6-1ec82865e2b3" acquired by "delete_snapshot" :: waited 0.034s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:00:10 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-653be84c-7415-45ac-b2dd-496ecac13e40 tempest-VolumesSnapshotNegativeTestJSON-1050196357 None] Acquiring lock "cinder-quobyte-223187b7-209b-41c7-a663-406bc603a205" by "_delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:00:10 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-653be84c-7415-45ac-b2dd-496ecac13e40 tempest-VolumesSnapshotNegativeTestJSON-1050196357 None] Lock "cinder-quobyte-223187b7-209b-41c7-a663-406bc603a205" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:00:10 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-653be84c-7415-45ac-b2dd-496ecac13e40 tempest-VolumesSnapshotNegativeTestJSON-1050196357 None] Deleting offline snapshot 223187b7-209b-41c7-a663-406bc603a205 of volume f6a7a1d0-8eaa-4ee8-8ef6-1ec82865e2b3 {{(pid=85458) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 22:00:10 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-653be84c-7415-45ac-b2dd-496ecac13e40 tempest-VolumesSnapshotNegativeTestJSON-1050196357 None] snapshot_file for this snap is: volume-f6a7a1d0-8eaa-4ee8-8ef6-1ec82865e2b3.223187b7-209b-41c7-a663-406bc603a205 {{(pid=85458) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 22:00:10 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[02f3e2f9-2fbf-49ac-aa8a-01cf36279ed9]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:00:10 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-653be84c-7415-45ac-b2dd-496ecac13e40 tempest-VolumesSnapshotNegativeTestJSON-1050196357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f6a7a1d0-8eaa-4ee8-8ef6-1ec82865e2b3.223187b7-209b-41c7-a663-406bc603a205 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:00:10 devstack sudo[96431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f6a7a1d0-8eaa-4ee8-8ef6-1ec82865e2b3.223187b7-209b-41c7-a663-406bc603a205 Sep 17 22:00:10 devstack sudo[96431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:00:11 devstack sudo[96431]: pam_unix(sudo:session): session closed for user root Sep 17 22:00:11 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-653be84c-7415-45ac-b2dd-496ecac13e40 tempest-VolumesSnapshotNegativeTestJSON-1050196357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f6a7a1d0-8eaa-4ee8-8ef6-1ec82865e2b3.223187b7-209b-41c7-a663-406bc603a205" returned: 0 in 0.495s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:00:11 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-653be84c-7415-45ac-b2dd-496ecac13e40 tempest-VolumesSnapshotNegativeTestJSON-1050196357 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f6a7a1d0-8eaa-4ee8-8ef6-1ec82865e2b3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85458) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 22:00:11 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb39f4a6-798a-4a8e-96ce-f385b0fbfe2d]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:00:11 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-653be84c-7415-45ac-b2dd-496ecac13e40 tempest-VolumesSnapshotNegativeTestJSON-1050196357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f6a7a1d0-8eaa-4ee8-8ef6-1ec82865e2b3 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:00:11 devstack sudo[96436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f6a7a1d0-8eaa-4ee8-8ef6-1ec82865e2b3 Sep 17 22:00:11 devstack sudo[96436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:00:11 devstack sudo[96436]: pam_unix(sudo:session): session closed for user root Sep 17 22:00:11 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-653be84c-7415-45ac-b2dd-496ecac13e40 tempest-VolumesSnapshotNegativeTestJSON-1050196357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f6a7a1d0-8eaa-4ee8-8ef6-1ec82865e2b3" returned: 0 in 0.602s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:00:11 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-653be84c-7415-45ac-b2dd-496ecac13e40 tempest-VolumesSnapshotNegativeTestJSON-1050196357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f6a7a1d0-8eaa-4ee8-8ef6-1ec82865e2b3.223187b7-209b-41c7-a663-406bc603a205 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:00:12 devstack sudo[96444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f6a7a1d0-8eaa-4ee8-8ef6-1ec82865e2b3.223187b7-209b-41c7-a663-406bc603a205 Sep 17 22:00:12 devstack sudo[96444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:00:12 devstack sudo[96444]: pam_unix(sudo:session): session closed for user root Sep 17 22:00:12 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-653be84c-7415-45ac-b2dd-496ecac13e40 tempest-VolumesSnapshotNegativeTestJSON-1050196357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f6a7a1d0-8eaa-4ee8-8ef6-1ec82865e2b3.223187b7-209b-41c7-a663-406bc603a205" returned: 0 in 0.706s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:00:12 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-653be84c-7415-45ac-b2dd-496ecac13e40 tempest-VolumesSnapshotNegativeTestJSON-1050196357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f6a7a1d0-8eaa-4ee8-8ef6-1ec82865e2b3.223187b7-209b-41c7-a663-406bc603a205 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:00:12 devstack sudo[96460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f6a7a1d0-8eaa-4ee8-8ef6-1ec82865e2b3.223187b7-209b-41c7-a663-406bc603a205 Sep 17 22:00:12 devstack sudo[96460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:00:13 devstack sudo[96460]: pam_unix(sudo:session): session closed for user root Sep 17 22:00:13 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-653be84c-7415-45ac-b2dd-496ecac13e40 tempest-VolumesSnapshotNegativeTestJSON-1050196357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f6a7a1d0-8eaa-4ee8-8ef6-1ec82865e2b3.223187b7-209b-41c7-a663-406bc603a205" returned: 0 in 0.431s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:00:13 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-653be84c-7415-45ac-b2dd-496ecac13e40 tempest-VolumesSnapshotNegativeTestJSON-1050196357 None] Lock "cinder-quobyte-223187b7-209b-41c7-a663-406bc603a205" released by "_delete_snapshot" :: held 2.410s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:00:13 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-653be84c-7415-45ac-b2dd-496ecac13e40 tempest-VolumesSnapshotNegativeTestJSON-1050196357 None] Lock "cinder-quobyte-f6a7a1d0-8eaa-4ee8-8ef6-1ec82865e2b3" released by "delete_snapshot" :: held 2.440s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:00:13 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-653be84c-7415-45ac-b2dd-496ecac13e40 tempest-VolumesSnapshotNegativeTestJSON-1050196357 None] Created reservations ['735bb8ad-9d29-4b45-b98f-f24aa4bb8dc8', '95e006e4-5405-4a4f-9cff-cba8d08bf4f8', 'dd0cfda1-8181-42d9-9cc5-27657894789a', '59361805-252b-4635-8d31-5b9364c1740d'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:00:13 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-653be84c-7415-45ac-b2dd-496ecac13e40 tempest-VolumesSnapshotNegativeTestJSON-1050196357 None] Delete snapshot completed successfully. Sep 17 22:00:13 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-653be84c-7415-45ac-b2dd-496ecac13e40 tempest-VolumesSnapshotNegativeTestJSON-1050196357 None] Lock "cinder-223187b7-209b-41c7-a663-406bc603a205-delete_snapshot" released by "delete_snapshot" :: held 2.641s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:00:14 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-ccebcb46-0201-44bd-abd9-5eabb9fe78ba tempest-VolumesSnapshotNegativeTestJSON-1050196357 None] Acquiring lock "cinder-f6a7a1d0-8eaa-4ee8-8ef6-1ec82865e2b3-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:00:14 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-ccebcb46-0201-44bd-abd9-5eabb9fe78ba tempest-VolumesSnapshotNegativeTestJSON-1050196357 None] Lock "cinder-f6a7a1d0-8eaa-4ee8-8ef6-1ec82865e2b3-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:00:14 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-ccebcb46-0201-44bd-abd9-5eabb9fe78ba tempest-VolumesSnapshotNegativeTestJSON-1050196357 None] Acquiring lock "cinder-quobyte-f6a7a1d0-8eaa-4ee8-8ef6-1ec82865e2b3" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:00:14 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-ccebcb46-0201-44bd-abd9-5eabb9fe78ba tempest-VolumesSnapshotNegativeTestJSON-1050196357 None] Lock "cinder-quobyte-f6a7a1d0-8eaa-4ee8-8ef6-1ec82865e2b3" acquired by "delete_volume" :: waited 0.025s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:00:14 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[546a104d-fed9-4c54-9ccb-f52de7f0ed49]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:00:14 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-ccebcb46-0201-44bd-abd9-5eabb9fe78ba tempest-VolumesSnapshotNegativeTestJSON-1050196357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f6a7a1d0-8eaa-4ee8-8ef6-1ec82865e2b3 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:00:14 devstack sudo[96466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f6a7a1d0-8eaa-4ee8-8ef6-1ec82865e2b3 Sep 17 22:00:14 devstack sudo[96466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:00:14 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-ccebcb46-0201-44bd-abd9-5eabb9fe78ba tempest-VolumesSnapshotNegativeTestJSON-1050196357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f6a7a1d0-8eaa-4ee8-8ef6-1ec82865e2b3" returned: 0 in 0.539s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:00:14 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-ccebcb46-0201-44bd-abd9-5eabb9fe78ba tempest-VolumesSnapshotNegativeTestJSON-1050196357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f6a7a1d0-8eaa-4ee8-8ef6-1ec82865e2b3 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:00:14 devstack sudo[96466]: pam_unix(sudo:session): session closed for user root Sep 17 22:00:14 devstack sudo[96472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f6a7a1d0-8eaa-4ee8-8ef6-1ec82865e2b3 Sep 17 22:00:14 devstack sudo[96472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:00:15 devstack sudo[96472]: pam_unix(sudo:session): session closed for user root Sep 17 22:00:15 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-ccebcb46-0201-44bd-abd9-5eabb9fe78ba tempest-VolumesSnapshotNegativeTestJSON-1050196357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f6a7a1d0-8eaa-4ee8-8ef6-1ec82865e2b3" returned: 0 in 0.783s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:00:15 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-ccebcb46-0201-44bd-abd9-5eabb9fe78ba tempest-VolumesSnapshotNegativeTestJSON-1050196357 None] Lock "cinder-quobyte-f6a7a1d0-8eaa-4ee8-8ef6-1ec82865e2b3" released by "delete_volume" :: held 1.448s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:00:15 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-ccebcb46-0201-44bd-abd9-5eabb9fe78ba tempest-VolumesSnapshotNegativeTestJSON-1050196357 None] Created reservations ['6bf378e2-4362-4886-9d5c-cace88521fb0', 'd4b6a443-66dc-4836-b11a-e39b0056a77f', 'df8bcadf-d119-415d-91b9-ca5704fd5f72', '235e53c3-982f-4e4f-bd62-2f433dbc81ca'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:00:15 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-ccebcb46-0201-44bd-abd9-5eabb9fe78ba tempest-VolumesSnapshotNegativeTestJSON-1050196357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:00:15 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-ccebcb46-0201-44bd-abd9-5eabb9fe78ba tempest-VolumesSnapshotNegativeTestJSON-1050196357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:00:15 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-ccebcb46-0201-44bd-abd9-5eabb9fe78ba tempest-VolumesSnapshotNegativeTestJSON-1050196357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:00:15 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-ccebcb46-0201-44bd-abd9-5eabb9fe78ba tempest-VolumesSnapshotNegativeTestJSON-1050196357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:00:15 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-ccebcb46-0201-44bd-abd9-5eabb9fe78ba tempest-VolumesSnapshotNegativeTestJSON-1050196357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:00:15 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-ccebcb46-0201-44bd-abd9-5eabb9fe78ba tempest-VolumesSnapshotNegativeTestJSON-1050196357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:00:16 devstack sudo[96562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:00:16 devstack sudo[96562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:00:16 devstack sudo[96562]: pam_unix(sudo:session): session closed for user root Sep 17 22:00:16 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-ccebcb46-0201-44bd-abd9-5eabb9fe78ba tempest-VolumesSnapshotNegativeTestJSON-1050196357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.415s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:00:16 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-ccebcb46-0201-44bd-abd9-5eabb9fe78ba tempest-VolumesSnapshotNegativeTestJSON-1050196357 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:00:16 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-ccebcb46-0201-44bd-abd9-5eabb9fe78ba tempest-VolumesSnapshotNegativeTestJSON-1050196357 None] Deleted volume successfully. Sep 17 22:00:16 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-ccebcb46-0201-44bd-abd9-5eabb9fe78ba tempest-VolumesSnapshotNegativeTestJSON-1050196357 None] Lock "cinder-f6a7a1d0-8eaa-4ee8-8ef6-1ec82865e2b3-delete_volume" released by "delete_volume" :: held 2.351s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:00:20 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffa1a26e-88ba-42f0-a8e2-01b27a43816b tempest-VolumesActionsTest-1014407808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 22:00:20 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-ffa1a26e-88ba-42f0-a8e2-01b27a43816b tempest-VolumesActionsTest-1014407808 None] Flow 'volume_create_manager' (c18d6cee-f378-4cc5-806d-5410735059ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:00:20 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-ffa1a26e-88ba-42f0-a8e2-01b27a43816b tempest-VolumesActionsTest-1014407808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76e7a9f6-458c-4ad9-9990-9f48687650cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:00:20 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-ffa1a26e-88ba-42f0-a8e2-01b27a43816b tempest-VolumesActionsTest-1014407808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76e7a9f6-458c-4ad9-9990-9f48687650cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:00:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-725609723',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28232226-fea7-4bbb-aa7b-1f8fabbaf536,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='029b95d472924e47b850686b44c327c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:00:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:00:20Z,use_quota=True,user_id='7a4b6fdac92c499282a190a384e15972',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:00:20 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-ffa1a26e-88ba-42f0-a8e2-01b27a43816b tempest-VolumesActionsTest-1014407808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a3a4796-d135-4ff6-8bad-2a8ffb814906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:00:20 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-ffa1a26e-88ba-42f0-a8e2-01b27a43816b tempest-VolumesActionsTest-1014407808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a3a4796-d135-4ff6-8bad-2a8ffb814906) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:00:20 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-ffa1a26e-88ba-42f0-a8e2-01b27a43816b tempest-VolumesActionsTest-1014407808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9535ca5-b9c7-4d33-9f89-344359b6561b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:00:20 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-ffa1a26e-88ba-42f0-a8e2-01b27a43816b tempest-VolumesActionsTest-1014407808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9535ca5-b9c7-4d33-9f89-344359b6561b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28232226-fea7-4bbb-aa7b-1f8fabbaf536', 'volume_name': 'volume-28232226-fea7-4bbb-aa7b-1f8fabbaf536', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:00:20 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-ffa1a26e-88ba-42f0-a8e2-01b27a43816b tempest-VolumesActionsTest-1014407808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (349aef1f-9d51-4ee2-83fe-4fc07584a5fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:00:20 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-ffa1a26e-88ba-42f0-a8e2-01b27a43816b tempest-VolumesActionsTest-1014407808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (349aef1f-9d51-4ee2-83fe-4fc07584a5fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:00:20 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-ffa1a26e-88ba-42f0-a8e2-01b27a43816b tempest-VolumesActionsTest-1014407808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17d15e23-dc97-4dbc-9a03-3974a113bc78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:00:20 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-ffa1a26e-88ba-42f0-a8e2-01b27a43816b tempest-VolumesActionsTest-1014407808 None] Volume 28232226-fea7-4bbb-aa7b-1f8fabbaf536: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28232226-fea7-4bbb-aa7b-1f8fabbaf536', 'volume_size': 1} Sep 17 22:00:20 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-ffa1a26e-88ba-42f0-a8e2-01b27a43816b tempest-VolumesActionsTest-1014407808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:00:20 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-ffa1a26e-88ba-42f0-a8e2-01b27a43816b tempest-VolumesActionsTest-1014407808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:00:20 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-ffa1a26e-88ba-42f0-a8e2-01b27a43816b tempest-VolumesActionsTest-1014407808 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:00:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-725609723',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28232226-fea7-4bbb-aa7b-1f8fabbaf536,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='029b95d472924e47b850686b44c327c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:00:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:00:20Z,use_quota=True,user_id='7a4b6fdac92c499282a190a384e15972',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 22:00:20 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-ffa1a26e-88ba-42f0-a8e2-01b27a43816b tempest-VolumesActionsTest-1014407808 None] Creating volume 28232226-fea7-4bbb-aa7b-1f8fabbaf536 {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 22:00:20 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-ffa1a26e-88ba-42f0-a8e2-01b27a43816b tempest-VolumesActionsTest-1014407808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:00:20 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-ffa1a26e-88ba-42f0-a8e2-01b27a43816b tempest-VolumesActionsTest-1014407808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:00:20 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-ffa1a26e-88ba-42f0-a8e2-01b27a43816b tempest-VolumesActionsTest-1014407808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:00:20 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-ffa1a26e-88ba-42f0-a8e2-01b27a43816b tempest-VolumesActionsTest-1014407808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:00:20 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-ffa1a26e-88ba-42f0-a8e2-01b27a43816b tempest-VolumesActionsTest-1014407808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:00:20 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-ffa1a26e-88ba-42f0-a8e2-01b27a43816b tempest-VolumesActionsTest-1014407808 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 22:00:20 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-ffa1a26e-88ba-42f0-a8e2-01b27a43816b tempest-VolumesActionsTest-1014407808 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 22:00:20 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-ffa1a26e-88ba-42f0-a8e2-01b27a43816b tempest-VolumesActionsTest-1014407808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-28232226-fea7-4bbb-aa7b-1f8fabbaf536 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:00:20 devstack sudo[96583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-28232226-fea7-4bbb-aa7b-1f8fabbaf536 1073741824 Sep 17 22:00:20 devstack sudo[96583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:00:21 devstack sudo[96583]: pam_unix(sudo:session): session closed for user root Sep 17 22:00:21 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-ffa1a26e-88ba-42f0-a8e2-01b27a43816b tempest-VolumesActionsTest-1014407808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-28232226-fea7-4bbb-aa7b-1f8fabbaf536 1073741824" returned: 0 in 0.812s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:00:21 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-ffa1a26e-88ba-42f0-a8e2-01b27a43816b tempest-VolumesActionsTest-1014407808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-28232226-fea7-4bbb-aa7b-1f8fabbaf536 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:00:21 devstack sudo[96588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-28232226-fea7-4bbb-aa7b-1f8fabbaf536 Sep 17 22:00:21 devstack sudo[96588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:00:21 devstack sudo[96588]: pam_unix(sudo:session): session closed for user root Sep 17 22:00:21 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-ffa1a26e-88ba-42f0-a8e2-01b27a43816b tempest-VolumesActionsTest-1014407808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-28232226-fea7-4bbb-aa7b-1f8fabbaf536" returned: 0 in 0.297s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:00:21 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-ffa1a26e-88ba-42f0-a8e2-01b27a43816b tempest-VolumesActionsTest-1014407808 None] <== create_volume: return (1193ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 22:00:21 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-ffa1a26e-88ba-42f0-a8e2-01b27a43816b tempest-VolumesActionsTest-1014407808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.197s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:00:21 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-ffa1a26e-88ba-42f0-a8e2-01b27a43816b tempest-VolumesActionsTest-1014407808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17d15e23-dc97-4dbc-9a03-3974a113bc78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28232226-fea7-4bbb-aa7b-1f8fabbaf536', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:00:21 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-ffa1a26e-88ba-42f0-a8e2-01b27a43816b tempest-VolumesActionsTest-1014407808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcebb4b0-14fe-48e4-a1c0-c48b61389d59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:00:21 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-ffa1a26e-88ba-42f0-a8e2-01b27a43816b tempest-VolumesActionsTest-1014407808 None] Volume volume-28232226-fea7-4bbb-aa7b-1f8fabbaf536 (28232226-fea7-4bbb-aa7b-1f8fabbaf536): created successfully Sep 17 22:00:21 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-ffa1a26e-88ba-42f0-a8e2-01b27a43816b tempest-VolumesActionsTest-1014407808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcebb4b0-14fe-48e4-a1c0-c48b61389d59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:00:21 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-ffa1a26e-88ba-42f0-a8e2-01b27a43816b tempest-VolumesActionsTest-1014407808 None] Flow 'volume_create_manager' (c18d6cee-f378-4cc5-806d-5410735059ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:00:22 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-ffa1a26e-88ba-42f0-a8e2-01b27a43816b tempest-VolumesActionsTest-1014407808 None] Created volume successfully. Sep 17 22:00:22 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-df21fbe7-2940-4473-ba21-5d94f134c36b tempest-VolumesActionsTest-1014407808 None] Acquiring lock "cinder-28232226-fea7-4bbb-aa7b-1f8fabbaf536" by "attach_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:00:22 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-df21fbe7-2940-4473-ba21-5d94f134c36b tempest-VolumesActionsTest-1014407808 None] Lock "cinder-28232226-fea7-4bbb-aa7b-1f8fabbaf536" acquired by "attach_volume" :: waited 0.045s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:00:23 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-df21fbe7-2940-4473-ba21-5d94f134c36b tempest-VolumesActionsTest-1014407808 None] Attaching volume 28232226-fea7-4bbb-aa7b-1f8fabbaf536 to instance 776a3697-2398-451e-bef9-fe23dba2453a at mountpoint /dev/vdb on host None. Sep 17 22:00:23 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-df21fbe7-2940-4473-ba21-5d94f134c36b tempest-VolumesActionsTest-1014407808 None] Attach volume completed successfully. Sep 17 22:00:23 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-df21fbe7-2940-4473-ba21-5d94f134c36b tempest-VolumesActionsTest-1014407808 None] Lock "cinder-28232226-fea7-4bbb-aa7b-1f8fabbaf536" released by "attach_volume" :: held 0.243s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:00:24 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-e7cd5cfb-bca3-4e0a-8d5f-8a1377a74e15 tempest-VolumesActionsTest-1712154832 None] Terminate volume connection completed successfully. Sep 17 22:00:24 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-e7cd5cfb-bca3-4e0a-8d5f-8a1377a74e15 tempest-VolumesActionsTest-1712154832 None] Acquiring lock "cinder-28232226-fea7-4bbb-aa7b-1f8fabbaf536-detach_volume" by "detach_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:00:24 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-e7cd5cfb-bca3-4e0a-8d5f-8a1377a74e15 tempest-VolumesActionsTest-1712154832 None] Lock "cinder-28232226-fea7-4bbb-aa7b-1f8fabbaf536-detach_volume" acquired by "detach_volume" :: waited 0.043s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:00:24 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-e7cd5cfb-bca3-4e0a-8d5f-8a1377a74e15 tempest-VolumesActionsTest-1712154832 None] Detaching volume 28232226-fea7-4bbb-aa7b-1f8fabbaf536 from instance 776a3697-2398-451e-bef9-fe23dba2453a. Sep 17 22:00:24 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-e7cd5cfb-bca3-4e0a-8d5f-8a1377a74e15 tempest-VolumesActionsTest-1712154832 None] Detach volume completed successfully. Sep 17 22:00:24 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-e7cd5cfb-bca3-4e0a-8d5f-8a1377a74e15 tempest-VolumesActionsTest-1712154832 None] Lock "cinder-28232226-fea7-4bbb-aa7b-1f8fabbaf536-detach_volume" released by "detach_volume" :: held 0.150s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:00:25 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-256be92f-07af-46fe-8168-f6526d32b4d8 tempest-VolumesActionsTest-1014407808 None] Acquiring lock "cinder-28232226-fea7-4bbb-aa7b-1f8fabbaf536-detach_volume" by "detach_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:00:25 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-256be92f-07af-46fe-8168-f6526d32b4d8 tempest-VolumesActionsTest-1014407808 None] Lock "cinder-28232226-fea7-4bbb-aa7b-1f8fabbaf536-detach_volume" acquired by "detach_volume" :: waited 0.035s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:00:25 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-256be92f-07af-46fe-8168-f6526d32b4d8 tempest-VolumesActionsTest-1014407808 None] Volume detach called, but volume not attached. Sep 17 22:00:25 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-256be92f-07af-46fe-8168-f6526d32b4d8 tempest-VolumesActionsTest-1014407808 None] Lock "cinder-28232226-fea7-4bbb-aa7b-1f8fabbaf536-detach_volume" released by "detach_volume" :: held 0.045s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:00:25 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-87ced35a-d8e8-4623-8d74-838224a67bb1 tempest-VolumesActionsTest-1014407808 None] Acquiring lock "cinder-28232226-fea7-4bbb-aa7b-1f8fabbaf536-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:00:25 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-87ced35a-d8e8-4623-8d74-838224a67bb1 tempest-VolumesActionsTest-1014407808 None] Lock "cinder-28232226-fea7-4bbb-aa7b-1f8fabbaf536-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:00:25 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-87ced35a-d8e8-4623-8d74-838224a67bb1 tempest-VolumesActionsTest-1014407808 None] Acquiring lock "cinder-quobyte-28232226-fea7-4bbb-aa7b-1f8fabbaf536" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:00:25 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-87ced35a-d8e8-4623-8d74-838224a67bb1 tempest-VolumesActionsTest-1014407808 None] Lock "cinder-quobyte-28232226-fea7-4bbb-aa7b-1f8fabbaf536" acquired by "delete_volume" :: waited 0.025s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:00:25 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0f3f04b-ab3b-4795-9329-4283bc2559c6]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:00:25 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-87ced35a-d8e8-4623-8d74-838224a67bb1 tempest-VolumesActionsTest-1014407808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-28232226-fea7-4bbb-aa7b-1f8fabbaf536 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:00:25 devstack sudo[96591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-28232226-fea7-4bbb-aa7b-1f8fabbaf536 Sep 17 22:00:25 devstack sudo[96591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:00:26 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-e6027e31-9ca1-4016-b48e-5302540fc120 tempest-GroupsV320Test-2027361141 None] Group tempest-GroupsV320Test-Group-1306014174: creating Sep 17 22:00:26 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-e6027e31-9ca1-4016-b48e-5302540fc120 tempest-GroupsV320Test-2027361141 None] Group tempest-GroupsV320Test-Group-1306014174: created successfully Sep 17 22:00:26 devstack sudo[96591]: pam_unix(sudo:session): session closed for user root Sep 17 22:00:26 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-87ced35a-d8e8-4623-8d74-838224a67bb1 tempest-VolumesActionsTest-1014407808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-28232226-fea7-4bbb-aa7b-1f8fabbaf536" returned: 0 in 0.695s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:00:26 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-87ced35a-d8e8-4623-8d74-838224a67bb1 tempest-VolumesActionsTest-1014407808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-28232226-fea7-4bbb-aa7b-1f8fabbaf536 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:00:26 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-e6027e31-9ca1-4016-b48e-5302540fc120 tempest-GroupsV320Test-2027361141 None] Create group completed successfully. Sep 17 22:00:26 devstack sudo[96596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-28232226-fea7-4bbb-aa7b-1f8fabbaf536 Sep 17 22:00:26 devstack sudo[96596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:00:26 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2407861-5c24-4acf-ba59-064446091013 tempest-VolumesMetadataTest-489183052 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 22:00:26 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e2407861-5c24-4acf-ba59-064446091013 tempest-VolumesMetadataTest-489183052 None] Flow 'volume_create_manager' (1e485b7b-1413-4504-a9c4-f7870276d12b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:00:26 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e2407861-5c24-4acf-ba59-064446091013 tempest-VolumesMetadataTest-489183052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2625b0ee-ad73-4225-a377-6eadd65b2bb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:00:26 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e2407861-5c24-4acf-ba59-064446091013 tempest-VolumesMetadataTest-489183052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2625b0ee-ad73-4225-a377-6eadd65b2bb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:00:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-890323975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7f91614-bb6e-428c-aa2b-98d51eeac15b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5bdcce285ba4ee6807f500cd40a04e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:00:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:00:27Z,use_quota=True,user_id='a701b5c34a364558ad77e5dccbaa1b5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:00:26 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e2407861-5c24-4acf-ba59-064446091013 tempest-VolumesMetadataTest-489183052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db6b17ae-2450-43b9-8b0b-26c60aa8f1f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:00:26 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e2407861-5c24-4acf-ba59-064446091013 tempest-VolumesMetadataTest-489183052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db6b17ae-2450-43b9-8b0b-26c60aa8f1f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:00:26 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e2407861-5c24-4acf-ba59-064446091013 tempest-VolumesMetadataTest-489183052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86e875ef-bd7a-45ca-af5a-406b39d0fac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:00:26 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e2407861-5c24-4acf-ba59-064446091013 tempest-VolumesMetadataTest-489183052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86e875ef-bd7a-45ca-af5a-406b39d0fac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7f91614-bb6e-428c-aa2b-98d51eeac15b', 'volume_name': 'volume-e7f91614-bb6e-428c-aa2b-98d51eeac15b', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:00:26 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e2407861-5c24-4acf-ba59-064446091013 tempest-VolumesMetadataTest-489183052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3b9c951-eb96-462c-857c-e2de5326cf36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:00:26 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e2407861-5c24-4acf-ba59-064446091013 tempest-VolumesMetadataTest-489183052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3b9c951-eb96-462c-857c-e2de5326cf36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:00:26 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e2407861-5c24-4acf-ba59-064446091013 tempest-VolumesMetadataTest-489183052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d6e8c0b-6ca1-47f4-aace-d3a7e877ccc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:00:26 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-e2407861-5c24-4acf-ba59-064446091013 tempest-VolumesMetadataTest-489183052 None] Volume e7f91614-bb6e-428c-aa2b-98d51eeac15b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7f91614-bb6e-428c-aa2b-98d51eeac15b', 'volume_size': 1} Sep 17 22:00:26 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e2407861-5c24-4acf-ba59-064446091013 tempest-VolumesMetadataTest-489183052 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:00:26 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e2407861-5c24-4acf-ba59-064446091013 tempest-VolumesMetadataTest-489183052 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:00:26 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-e2407861-5c24-4acf-ba59-064446091013 tempest-VolumesMetadataTest-489183052 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:00:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-890323975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7f91614-bb6e-428c-aa2b-98d51eeac15b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5bdcce285ba4ee6807f500cd40a04e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:00:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:00:27Z,use_quota=True,user_id='a701b5c34a364558ad77e5dccbaa1b5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 22:00:26 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-e2407861-5c24-4acf-ba59-064446091013 tempest-VolumesMetadataTest-489183052 None] Creating volume e7f91614-bb6e-428c-aa2b-98d51eeac15b {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 22:00:26 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e2407861-5c24-4acf-ba59-064446091013 tempest-VolumesMetadataTest-489183052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:00:26 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e2407861-5c24-4acf-ba59-064446091013 tempest-VolumesMetadataTest-489183052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:00:26 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-e2407861-5c24-4acf-ba59-064446091013 tempest-VolumesMetadataTest-489183052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:00:26 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-e2407861-5c24-4acf-ba59-064446091013 tempest-VolumesMetadataTest-489183052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:00:26 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e2407861-5c24-4acf-ba59-064446091013 tempest-VolumesMetadataTest-489183052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:00:26 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-e2407861-5c24-4acf-ba59-064446091013 tempest-VolumesMetadataTest-489183052 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 22:00:26 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-e2407861-5c24-4acf-ba59-064446091013 tempest-VolumesMetadataTest-489183052 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 22:00:26 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e2407861-5c24-4acf-ba59-064446091013 tempest-VolumesMetadataTest-489183052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e7f91614-bb6e-428c-aa2b-98d51eeac15b 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:00:26 devstack sudo[96598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e7f91614-bb6e-428c-aa2b-98d51eeac15b 1073741824 Sep 17 22:00:26 devstack sudo[96598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:00:27 devstack sudo[96596]: pam_unix(sudo:session): session closed for user root Sep 17 22:00:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-87ced35a-d8e8-4623-8d74-838224a67bb1 tempest-VolumesActionsTest-1014407808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-28232226-fea7-4bbb-aa7b-1f8fabbaf536" returned: 0 in 0.522s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:00:27 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-87ced35a-d8e8-4623-8d74-838224a67bb1 tempest-VolumesActionsTest-1014407808 None] Lock "cinder-quobyte-28232226-fea7-4bbb-aa7b-1f8fabbaf536" released by "delete_volume" :: held 1.305s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:00:27 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-87ced35a-d8e8-4623-8d74-838224a67bb1 tempest-VolumesActionsTest-1014407808 None] Created reservations ['02690c5b-3789-4f53-a97c-23f8e9d30616', 'bbd81686-2382-4f36-9e13-1cdcd31d6839', 'b4087528-7403-491b-b8d1-8cf6a4ec8992', '5572b6ac-bbdc-48ae-9f36-16f4dd4664fb'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:00:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-87ced35a-d8e8-4623-8d74-838224a67bb1 tempest-VolumesActionsTest-1014407808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:00:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-87ced35a-d8e8-4623-8d74-838224a67bb1 tempest-VolumesActionsTest-1014407808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:00:27 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-87ced35a-d8e8-4623-8d74-838224a67bb1 tempest-VolumesActionsTest-1014407808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:00:27 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-87ced35a-d8e8-4623-8d74-838224a67bb1 tempest-VolumesActionsTest-1014407808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:00:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-87ced35a-d8e8-4623-8d74-838224a67bb1 tempest-VolumesActionsTest-1014407808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:00:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-87ced35a-d8e8-4623-8d74-838224a67bb1 tempest-VolumesActionsTest-1014407808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:00:27 devstack sudo[96603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:00:27 devstack sudo[96603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:00:27 devstack sudo[96598]: pam_unix(sudo:session): session closed for user root Sep 17 22:00:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e2407861-5c24-4acf-ba59-064446091013 tempest-VolumesMetadataTest-489183052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e7f91614-bb6e-428c-aa2b-98d51eeac15b 1073741824" returned: 0 in 0.602s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:00:27 devstack sudo[96603]: pam_unix(sudo:session): session closed for user root Sep 17 22:00:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e2407861-5c24-4acf-ba59-064446091013 tempest-VolumesMetadataTest-489183052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e7f91614-bb6e-428c-aa2b-98d51eeac15b {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:00:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-87ced35a-d8e8-4623-8d74-838224a67bb1 tempest-VolumesActionsTest-1014407808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.385s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:00:27 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-87ced35a-d8e8-4623-8d74-838224a67bb1 tempest-VolumesActionsTest-1014407808 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:00:27 devstack sudo[96608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e7f91614-bb6e-428c-aa2b-98d51eeac15b Sep 17 22:00:27 devstack sudo[96608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:00:27 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-87ced35a-d8e8-4623-8d74-838224a67bb1 tempest-VolumesActionsTest-1014407808 None] Deleted volume successfully. Sep 17 22:00:27 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-87ced35a-d8e8-4623-8d74-838224a67bb1 tempest-VolumesActionsTest-1014407808 None] Lock "cinder-28232226-fea7-4bbb-aa7b-1f8fabbaf536-delete_volume" released by "delete_volume" :: held 2.056s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:00:27 devstack cinder-volume[85458]: DEBUG oslo_service.periodic_task [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85458) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 22:00:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:00:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:00:27 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:00:27 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:00:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:00:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:00:27 devstack sudo[96611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:00:27 devstack sudo[96611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:00:28 devstack sudo[96608]: pam_unix(sudo:session): session closed for user root Sep 17 22:00:28 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e2407861-5c24-4acf-ba59-064446091013 tempest-VolumesMetadataTest-489183052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e7f91614-bb6e-428c-aa2b-98d51eeac15b" returned: 0 in 0.487s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:00:28 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-e2407861-5c24-4acf-ba59-064446091013 tempest-VolumesMetadataTest-489183052 None] <== create_volume: return (1179ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 22:00:28 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e2407861-5c24-4acf-ba59-064446091013 tempest-VolumesMetadataTest-489183052 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.182s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:00:28 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e2407861-5c24-4acf-ba59-064446091013 tempest-VolumesMetadataTest-489183052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d6e8c0b-6ca1-47f4-aace-d3a7e877ccc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7f91614-bb6e-428c-aa2b-98d51eeac15b', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:00:28 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e2407861-5c24-4acf-ba59-064446091013 tempest-VolumesMetadataTest-489183052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cbd6366-ecf2-4879-8de0-422bec2b2cb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:00:28 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-e2407861-5c24-4acf-ba59-064446091013 tempest-VolumesMetadataTest-489183052 None] Volume volume-e7f91614-bb6e-428c-aa2b-98d51eeac15b (e7f91614-bb6e-428c-aa2b-98d51eeac15b): created successfully Sep 17 22:00:28 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e2407861-5c24-4acf-ba59-064446091013 tempest-VolumesMetadataTest-489183052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cbd6366-ecf2-4879-8de0-422bec2b2cb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:00:28 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e2407861-5c24-4acf-ba59-064446091013 tempest-VolumesMetadataTest-489183052 None] Flow 'volume_create_manager' (1e485b7b-1413-4504-a9c4-f7870276d12b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:00:28 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-e2407861-5c24-4acf-ba59-064446091013 tempest-VolumesMetadataTest-489183052 None] Created volume successfully. Sep 17 22:00:28 devstack sudo[96611]: pam_unix(sudo:session): session closed for user root Sep 17 22:00:28 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.454s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:00:28 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:00:28 devstack cinder-volume[85458]: DEBUG oslo_service.periodic_task [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Running periodic task VolumeManager._thread_info {{(pid=85458) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 22:00:28 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] thread count: 28 {{(pid=85458) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 22:00:28 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] thread info: [<_MainThread(MainThread, started 127546830999680)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85458) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 22:00:28 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-a838716e-7450-4354-9313-5f6dea6ec2e9 tempest-GroupsV320Test-2027361141 None] Created reservations ['d5095146-18fb-4f9d-b68c-70dc9f421fa2'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:00:28 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-a838716e-7450-4354-9313-5f6dea6ec2e9 tempest-GroupsV320Test-2027361141 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:00:28 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-a838716e-7450-4354-9313-5f6dea6ec2e9 tempest-GroupsV320Test-2027361141 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:00:28 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-a838716e-7450-4354-9313-5f6dea6ec2e9 tempest-GroupsV320Test-2027361141 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:00:28 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-a838716e-7450-4354-9313-5f6dea6ec2e9 tempest-GroupsV320Test-2027361141 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:00:28 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-a838716e-7450-4354-9313-5f6dea6ec2e9 tempest-GroupsV320Test-2027361141 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:00:28 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a838716e-7450-4354-9313-5f6dea6ec2e9 tempest-GroupsV320Test-2027361141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:00:28 devstack sudo[96616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:00:28 devstack sudo[96616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:00:28 devstack sudo[96616]: pam_unix(sudo:session): session closed for user root Sep 17 22:00:28 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a838716e-7450-4354-9313-5f6dea6ec2e9 tempest-GroupsV320Test-2027361141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.412s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:00:28 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-a838716e-7450-4354-9313-5f6dea6ec2e9 tempest-GroupsV320Test-2027361141 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:00:28 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-a838716e-7450-4354-9313-5f6dea6ec2e9 tempest-GroupsV320Test-2027361141 None] Delete group completed successfully. Sep 17 22:00:30 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-59ffd9dc-114d-4122-a853-b1e47480785a tempest-VolumesMetadataTest-489183052 None] Acquiring lock "cinder-e7f91614-bb6e-428c-aa2b-98d51eeac15b-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:00:30 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-59ffd9dc-114d-4122-a853-b1e47480785a tempest-VolumesMetadataTest-489183052 None] Lock "cinder-e7f91614-bb6e-428c-aa2b-98d51eeac15b-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:00:30 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-59ffd9dc-114d-4122-a853-b1e47480785a tempest-VolumesMetadataTest-489183052 None] Acquiring lock "cinder-quobyte-e7f91614-bb6e-428c-aa2b-98d51eeac15b" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:00:30 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-59ffd9dc-114d-4122-a853-b1e47480785a tempest-VolumesMetadataTest-489183052 None] Lock "cinder-quobyte-e7f91614-bb6e-428c-aa2b-98d51eeac15b" acquired by "delete_volume" :: waited 0.017s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:00:30 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[c08ff658-6974-4bce-96c4-093e05a8079d]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:00:30 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-59ffd9dc-114d-4122-a853-b1e47480785a tempest-VolumesMetadataTest-489183052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e7f91614-bb6e-428c-aa2b-98d51eeac15b {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:00:30 devstack sudo[96642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e7f91614-bb6e-428c-aa2b-98d51eeac15b Sep 17 22:00:30 devstack sudo[96642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:00:30 devstack sudo[96642]: pam_unix(sudo:session): session closed for user root Sep 17 22:00:30 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-59ffd9dc-114d-4122-a853-b1e47480785a tempest-VolumesMetadataTest-489183052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e7f91614-bb6e-428c-aa2b-98d51eeac15b" returned: 0 in 0.531s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:00:30 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-59ffd9dc-114d-4122-a853-b1e47480785a tempest-VolumesMetadataTest-489183052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e7f91614-bb6e-428c-aa2b-98d51eeac15b {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:00:30 devstack sudo[96655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e7f91614-bb6e-428c-aa2b-98d51eeac15b Sep 17 22:00:30 devstack sudo[96655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:00:31 devstack sudo[96655]: pam_unix(sudo:session): session closed for user root Sep 17 22:00:31 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-59ffd9dc-114d-4122-a853-b1e47480785a tempest-VolumesMetadataTest-489183052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e7f91614-bb6e-428c-aa2b-98d51eeac15b" returned: 0 in 0.567s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:00:31 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-59ffd9dc-114d-4122-a853-b1e47480785a tempest-VolumesMetadataTest-489183052 None] Lock "cinder-quobyte-e7f91614-bb6e-428c-aa2b-98d51eeac15b" released by "delete_volume" :: held 1.162s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:00:31 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-59ffd9dc-114d-4122-a853-b1e47480785a tempest-VolumesMetadataTest-489183052 None] Created reservations ['74bafbfc-931b-47a9-8bf2-3f1e8af8bfd9', '2f4eb821-2fb4-49db-a7db-901a27f94c5f', '6319a160-9951-4cdc-b911-475288e3b5f7', '43a90b2e-a0b7-4e13-bc25-e67a334d71f3'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:00:31 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-59ffd9dc-114d-4122-a853-b1e47480785a tempest-VolumesMetadataTest-489183052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:00:31 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-59ffd9dc-114d-4122-a853-b1e47480785a tempest-VolumesMetadataTest-489183052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:00:31 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-59ffd9dc-114d-4122-a853-b1e47480785a tempest-VolumesMetadataTest-489183052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:00:31 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-59ffd9dc-114d-4122-a853-b1e47480785a tempest-VolumesMetadataTest-489183052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:00:31 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-59ffd9dc-114d-4122-a853-b1e47480785a tempest-VolumesMetadataTest-489183052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:00:31 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-59ffd9dc-114d-4122-a853-b1e47480785a tempest-VolumesMetadataTest-489183052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:00:31 devstack sudo[96658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:00:31 devstack sudo[96658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:00:31 devstack sudo[96658]: pam_unix(sudo:session): session closed for user root Sep 17 22:00:31 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-59ffd9dc-114d-4122-a853-b1e47480785a tempest-VolumesMetadataTest-489183052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.337s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:00:31 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-59ffd9dc-114d-4122-a853-b1e47480785a tempest-VolumesMetadataTest-489183052 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:00:31 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-59ffd9dc-114d-4122-a853-b1e47480785a tempest-VolumesMetadataTest-489183052 None] Deleted volume successfully. Sep 17 22:00:31 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-59ffd9dc-114d-4122-a853-b1e47480785a tempest-VolumesMetadataTest-489183052 None] Lock "cinder-e7f91614-bb6e-428c-aa2b-98d51eeac15b-delete_volume" released by "delete_volume" :: held 1.872s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:00:33 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-36991983-917b-4e80-8ee4-78a7ee7a2b10 tempest-VolumesActionsTest-1014407808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 22:00:33 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-36991983-917b-4e80-8ee4-78a7ee7a2b10 tempest-VolumesActionsTest-1014407808 None] Flow 'volume_create_manager' (33c43f65-f193-4607-8246-16e987e61ad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:00:33 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-36991983-917b-4e80-8ee4-78a7ee7a2b10 tempest-VolumesActionsTest-1014407808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a938df61-a298-432d-9ec3-025bdda1fb5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:00:33 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-36991983-917b-4e80-8ee4-78a7ee7a2b10 tempest-VolumesActionsTest-1014407808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a938df61-a298-432d-9ec3-025bdda1fb5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:00:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-48814919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d409ff1-60c5-470c-8eb7-44707c40a696,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='029b95d472924e47b850686b44c327c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:00:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:00:33Z,use_quota=True,user_id='7a4b6fdac92c499282a190a384e15972',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:00:33 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-36991983-917b-4e80-8ee4-78a7ee7a2b10 tempest-VolumesActionsTest-1014407808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85e23735-77e2-4fd4-99f3-2ff644c1c559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:00:33 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-36991983-917b-4e80-8ee4-78a7ee7a2b10 tempest-VolumesActionsTest-1014407808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85e23735-77e2-4fd4-99f3-2ff644c1c559) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:00:33 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-36991983-917b-4e80-8ee4-78a7ee7a2b10 tempest-VolumesActionsTest-1014407808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd7d29c6-6f51-471c-acd8-24983116a0c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:00:33 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-36991983-917b-4e80-8ee4-78a7ee7a2b10 tempest-VolumesActionsTest-1014407808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd7d29c6-6f51-471c-acd8-24983116a0c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d409ff1-60c5-470c-8eb7-44707c40a696', 'volume_name': 'volume-6d409ff1-60c5-470c-8eb7-44707c40a696', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:00:33 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-36991983-917b-4e80-8ee4-78a7ee7a2b10 tempest-VolumesActionsTest-1014407808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68262a85-ad0d-40c8-aee7-e743e83d234b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:00:33 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-36991983-917b-4e80-8ee4-78a7ee7a2b10 tempest-VolumesActionsTest-1014407808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68262a85-ad0d-40c8-aee7-e743e83d234b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:00:33 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-36991983-917b-4e80-8ee4-78a7ee7a2b10 tempest-VolumesActionsTest-1014407808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (effaa90a-657e-4974-8e7b-a2b6a03e5a14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:00:33 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-36991983-917b-4e80-8ee4-78a7ee7a2b10 tempest-VolumesActionsTest-1014407808 None] Volume 6d409ff1-60c5-470c-8eb7-44707c40a696: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d409ff1-60c5-470c-8eb7-44707c40a696', 'volume_size': 1} Sep 17 22:00:33 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-36991983-917b-4e80-8ee4-78a7ee7a2b10 tempest-VolumesActionsTest-1014407808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:00:33 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-36991983-917b-4e80-8ee4-78a7ee7a2b10 tempest-VolumesActionsTest-1014407808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:00:33 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-36991983-917b-4e80-8ee4-78a7ee7a2b10 tempest-VolumesActionsTest-1014407808 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:00:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-48814919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d409ff1-60c5-470c-8eb7-44707c40a696,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='029b95d472924e47b850686b44c327c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:00:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:00:33Z,use_quota=True,user_id='7a4b6fdac92c499282a190a384e15972',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 22:00:33 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-36991983-917b-4e80-8ee4-78a7ee7a2b10 tempest-VolumesActionsTest-1014407808 None] Creating volume 6d409ff1-60c5-470c-8eb7-44707c40a696 {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 22:00:33 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-36991983-917b-4e80-8ee4-78a7ee7a2b10 tempest-VolumesActionsTest-1014407808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:00:33 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-36991983-917b-4e80-8ee4-78a7ee7a2b10 tempest-VolumesActionsTest-1014407808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:00:33 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-36991983-917b-4e80-8ee4-78a7ee7a2b10 tempest-VolumesActionsTest-1014407808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:00:33 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-36991983-917b-4e80-8ee4-78a7ee7a2b10 tempest-VolumesActionsTest-1014407808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:00:33 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-36991983-917b-4e80-8ee4-78a7ee7a2b10 tempest-VolumesActionsTest-1014407808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:00:33 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-36991983-917b-4e80-8ee4-78a7ee7a2b10 tempest-VolumesActionsTest-1014407808 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 22:00:33 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-36991983-917b-4e80-8ee4-78a7ee7a2b10 tempest-VolumesActionsTest-1014407808 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 22:00:33 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-36991983-917b-4e80-8ee4-78a7ee7a2b10 tempest-VolumesActionsTest-1014407808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-6d409ff1-60c5-470c-8eb7-44707c40a696 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:00:33 devstack sudo[96661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-6d409ff1-60c5-470c-8eb7-44707c40a696 1073741824 Sep 17 22:00:33 devstack sudo[96661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:00:34 devstack sudo[96661]: pam_unix(sudo:session): session closed for user root Sep 17 22:00:34 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-36991983-917b-4e80-8ee4-78a7ee7a2b10 tempest-VolumesActionsTest-1014407808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-6d409ff1-60c5-470c-8eb7-44707c40a696 1073741824" returned: 0 in 0.620s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:00:34 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-36991983-917b-4e80-8ee4-78a7ee7a2b10 tempest-VolumesActionsTest-1014407808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-6d409ff1-60c5-470c-8eb7-44707c40a696 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:00:34 devstack sudo[96669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-6d409ff1-60c5-470c-8eb7-44707c40a696 Sep 17 22:00:34 devstack sudo[96669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:00:34 devstack sudo[96669]: pam_unix(sudo:session): session closed for user root Sep 17 22:00:34 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-36991983-917b-4e80-8ee4-78a7ee7a2b10 tempest-VolumesActionsTest-1014407808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-6d409ff1-60c5-470c-8eb7-44707c40a696" returned: 0 in 0.391s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:00:34 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-36991983-917b-4e80-8ee4-78a7ee7a2b10 tempest-VolumesActionsTest-1014407808 None] <== create_volume: return (1087ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 22:00:34 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-36991983-917b-4e80-8ee4-78a7ee7a2b10 tempest-VolumesActionsTest-1014407808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.090s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:00:34 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-36991983-917b-4e80-8ee4-78a7ee7a2b10 tempest-VolumesActionsTest-1014407808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (effaa90a-657e-4974-8e7b-a2b6a03e5a14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d409ff1-60c5-470c-8eb7-44707c40a696', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:00:34 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-36991983-917b-4e80-8ee4-78a7ee7a2b10 tempest-VolumesActionsTest-1014407808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe7fcee6-f953-43b4-833d-8cc573a71062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:00:34 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-36991983-917b-4e80-8ee4-78a7ee7a2b10 tempest-VolumesActionsTest-1014407808 None] Volume volume-6d409ff1-60c5-470c-8eb7-44707c40a696 (6d409ff1-60c5-470c-8eb7-44707c40a696): created successfully Sep 17 22:00:34 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-36991983-917b-4e80-8ee4-78a7ee7a2b10 tempest-VolumesActionsTest-1014407808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe7fcee6-f953-43b4-833d-8cc573a71062) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:00:34 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-36991983-917b-4e80-8ee4-78a7ee7a2b10 tempest-VolumesActionsTest-1014407808 None] Flow 'volume_create_manager' (33c43f65-f193-4607-8246-16e987e61ad1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:00:34 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-36991983-917b-4e80-8ee4-78a7ee7a2b10 tempest-VolumesActionsTest-1014407808 None] Created volume successfully. Sep 17 22:00:35 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-bb815e43-81c2-4c09-a05c-a0a0a62dc19f tempest-VolumesActionsTest-1712154832 None] Acquiring lock "cinder-6d409ff1-60c5-470c-8eb7-44707c40a696-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:00:35 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-bb815e43-81c2-4c09-a05c-a0a0a62dc19f tempest-VolumesActionsTest-1712154832 None] Lock "cinder-6d409ff1-60c5-470c-8eb7-44707c40a696-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:00:35 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-bb815e43-81c2-4c09-a05c-a0a0a62dc19f tempest-VolumesActionsTest-1712154832 None] Acquiring lock "cinder-quobyte-6d409ff1-60c5-470c-8eb7-44707c40a696" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:00:35 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-bb815e43-81c2-4c09-a05c-a0a0a62dc19f tempest-VolumesActionsTest-1712154832 None] Lock "cinder-quobyte-6d409ff1-60c5-470c-8eb7-44707c40a696" acquired by "delete_volume" :: waited 0.023s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:00:36 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[21c0cf7f-7945-41c1-bddc-40cd945e29d5]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:00:36 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-bb815e43-81c2-4c09-a05c-a0a0a62dc19f tempest-VolumesActionsTest-1712154832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-6d409ff1-60c5-470c-8eb7-44707c40a696 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:00:36 devstack sudo[96672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-6d409ff1-60c5-470c-8eb7-44707c40a696 Sep 17 22:00:36 devstack sudo[96672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:00:36 devstack sudo[96672]: pam_unix(sudo:session): session closed for user root Sep 17 22:00:36 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-bb815e43-81c2-4c09-a05c-a0a0a62dc19f tempest-VolumesActionsTest-1712154832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-6d409ff1-60c5-470c-8eb7-44707c40a696" returned: 0 in 0.513s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:00:36 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-bb815e43-81c2-4c09-a05c-a0a0a62dc19f tempest-VolumesActionsTest-1712154832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-6d409ff1-60c5-470c-8eb7-44707c40a696 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:00:36 devstack sudo[96677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-6d409ff1-60c5-470c-8eb7-44707c40a696 Sep 17 22:00:36 devstack sudo[96677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:00:36 devstack sudo[96677]: pam_unix(sudo:session): session closed for user root Sep 17 22:00:36 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-bb815e43-81c2-4c09-a05c-a0a0a62dc19f tempest-VolumesActionsTest-1712154832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-6d409ff1-60c5-470c-8eb7-44707c40a696" returned: 0 in 0.352s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:00:36 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-bb815e43-81c2-4c09-a05c-a0a0a62dc19f tempest-VolumesActionsTest-1712154832 None] Lock "cinder-quobyte-6d409ff1-60c5-470c-8eb7-44707c40a696" released by "delete_volume" :: held 0.979s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:00:37 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-bb815e43-81c2-4c09-a05c-a0a0a62dc19f tempest-VolumesActionsTest-1712154832 None] Created reservations ['d592e9b1-d04c-46cf-9f44-209cf976d663', 'ff69f0ed-fe02-48f4-9a54-8f8a88151ecc', 'ba73d32d-f0eb-4859-996d-700845830d88', 'f758d489-5c72-4dac-8e31-a3407f99ce87'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:00:37 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-bb815e43-81c2-4c09-a05c-a0a0a62dc19f tempest-VolumesActionsTest-1712154832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:00:37 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-bb815e43-81c2-4c09-a05c-a0a0a62dc19f tempest-VolumesActionsTest-1712154832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:00:37 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-bb815e43-81c2-4c09-a05c-a0a0a62dc19f tempest-VolumesActionsTest-1712154832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:00:37 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-bb815e43-81c2-4c09-a05c-a0a0a62dc19f tempest-VolumesActionsTest-1712154832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:00:37 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-bb815e43-81c2-4c09-a05c-a0a0a62dc19f tempest-VolumesActionsTest-1712154832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:00:37 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-bb815e43-81c2-4c09-a05c-a0a0a62dc19f tempest-VolumesActionsTest-1712154832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:00:37 devstack sudo[96680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:00:37 devstack sudo[96680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:00:37 devstack sudo[96680]: pam_unix(sudo:session): session closed for user root Sep 17 22:00:37 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-bb815e43-81c2-4c09-a05c-a0a0a62dc19f tempest-VolumesActionsTest-1712154832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.328s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:00:37 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-bb815e43-81c2-4c09-a05c-a0a0a62dc19f tempest-VolumesActionsTest-1712154832 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:00:37 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-bb815e43-81c2-4c09-a05c-a0a0a62dc19f tempest-VolumesActionsTest-1712154832 None] Deleted volume successfully. Sep 17 22:00:37 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-bb815e43-81c2-4c09-a05c-a0a0a62dc19f tempest-VolumesActionsTest-1712154832 None] Lock "cinder-6d409ff1-60c5-470c-8eb7-44707c40a696-delete_volume" released by "delete_volume" :: held 1.681s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:00:39 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e217c13-3729-4b6c-82c7-0ad0870c8670 tempest-VolumesActionsTest-1014407808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 22:00:39 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-5e217c13-3729-4b6c-82c7-0ad0870c8670 tempest-VolumesActionsTest-1014407808 None] Flow 'volume_create_manager' (b12e2a44-f72e-4dc5-8086-dc8e26e44e20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:00:39 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-5e217c13-3729-4b6c-82c7-0ad0870c8670 tempest-VolumesActionsTest-1014407808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88bde735-7cfc-474f-b630-f1e0e4874d44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:00:39 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-5e217c13-3729-4b6c-82c7-0ad0870c8670 tempest-VolumesActionsTest-1014407808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88bde735-7cfc-474f-b630-f1e0e4874d44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:00:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1226385211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e372c09-05e0-4f83-ba9a-3fe34a6c6678,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='029b95d472924e47b850686b44c327c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:00:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:00:39Z,use_quota=True,user_id='7a4b6fdac92c499282a190a384e15972',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:00:39 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-5e217c13-3729-4b6c-82c7-0ad0870c8670 tempest-VolumesActionsTest-1014407808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bd17f9d-f6f4-4589-86bf-93393df9ddd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:00:39 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-5e217c13-3729-4b6c-82c7-0ad0870c8670 tempest-VolumesActionsTest-1014407808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bd17f9d-f6f4-4589-86bf-93393df9ddd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:00:39 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-5e217c13-3729-4b6c-82c7-0ad0870c8670 tempest-VolumesActionsTest-1014407808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a90489a7-fc79-4f80-a891-44226c7b0b4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:00:39 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-5e217c13-3729-4b6c-82c7-0ad0870c8670 tempest-VolumesActionsTest-1014407808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a90489a7-fc79-4f80-a891-44226c7b0b4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e372c09-05e0-4f83-ba9a-3fe34a6c6678', 'volume_name': 'volume-0e372c09-05e0-4f83-ba9a-3fe34a6c6678', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:00:39 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-5e217c13-3729-4b6c-82c7-0ad0870c8670 tempest-VolumesActionsTest-1014407808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63d524df-7025-43ea-9fb1-e36eb6a6a833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:00:39 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-5e217c13-3729-4b6c-82c7-0ad0870c8670 tempest-VolumesActionsTest-1014407808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63d524df-7025-43ea-9fb1-e36eb6a6a833) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:00:39 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-5e217c13-3729-4b6c-82c7-0ad0870c8670 tempest-VolumesActionsTest-1014407808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f6fe4f7-c15d-41d9-91e6-e16334e4b3e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:00:39 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-5e217c13-3729-4b6c-82c7-0ad0870c8670 tempest-VolumesActionsTest-1014407808 None] Volume 0e372c09-05e0-4f83-ba9a-3fe34a6c6678: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e372c09-05e0-4f83-ba9a-3fe34a6c6678', 'volume_size': 1} Sep 17 22:00:39 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-5e217c13-3729-4b6c-82c7-0ad0870c8670 tempest-VolumesActionsTest-1014407808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:00:39 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-5e217c13-3729-4b6c-82c7-0ad0870c8670 tempest-VolumesActionsTest-1014407808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:00:39 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-5e217c13-3729-4b6c-82c7-0ad0870c8670 tempest-VolumesActionsTest-1014407808 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:00:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1226385211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e372c09-05e0-4f83-ba9a-3fe34a6c6678,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='029b95d472924e47b850686b44c327c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:00:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:00:39Z,use_quota=True,user_id='7a4b6fdac92c499282a190a384e15972',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 22:00:39 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-5e217c13-3729-4b6c-82c7-0ad0870c8670 tempest-VolumesActionsTest-1014407808 None] Creating volume 0e372c09-05e0-4f83-ba9a-3fe34a6c6678 {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 22:00:39 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-5e217c13-3729-4b6c-82c7-0ad0870c8670 tempest-VolumesActionsTest-1014407808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:00:39 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-5e217c13-3729-4b6c-82c7-0ad0870c8670 tempest-VolumesActionsTest-1014407808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:00:39 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-5e217c13-3729-4b6c-82c7-0ad0870c8670 tempest-VolumesActionsTest-1014407808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:00:39 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-5e217c13-3729-4b6c-82c7-0ad0870c8670 tempest-VolumesActionsTest-1014407808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:00:39 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-5e217c13-3729-4b6c-82c7-0ad0870c8670 tempest-VolumesActionsTest-1014407808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:00:39 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-5e217c13-3729-4b6c-82c7-0ad0870c8670 tempest-VolumesActionsTest-1014407808 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 22:00:39 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-5e217c13-3729-4b6c-82c7-0ad0870c8670 tempest-VolumesActionsTest-1014407808 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 22:00:39 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-5e217c13-3729-4b6c-82c7-0ad0870c8670 tempest-VolumesActionsTest-1014407808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0e372c09-05e0-4f83-ba9a-3fe34a6c6678 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:00:39 devstack sudo[96684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0e372c09-05e0-4f83-ba9a-3fe34a6c6678 1073741824 Sep 17 22:00:39 devstack sudo[96684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:00:39 devstack sudo[96684]: pam_unix(sudo:session): session closed for user root Sep 17 22:00:39 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-5e217c13-3729-4b6c-82c7-0ad0870c8670 tempest-VolumesActionsTest-1014407808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0e372c09-05e0-4f83-ba9a-3fe34a6c6678 1073741824" returned: 0 in 0.725s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:00:39 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-5e217c13-3729-4b6c-82c7-0ad0870c8670 tempest-VolumesActionsTest-1014407808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0e372c09-05e0-4f83-ba9a-3fe34a6c6678 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:00:40 devstack sudo[96689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0e372c09-05e0-4f83-ba9a-3fe34a6c6678 Sep 17 22:00:40 devstack sudo[96689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:00:40 devstack sudo[96689]: pam_unix(sudo:session): session closed for user root Sep 17 22:00:40 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-5e217c13-3729-4b6c-82c7-0ad0870c8670 tempest-VolumesActionsTest-1014407808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0e372c09-05e0-4f83-ba9a-3fe34a6c6678" returned: 0 in 0.386s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:00:40 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-5e217c13-3729-4b6c-82c7-0ad0870c8670 tempest-VolumesActionsTest-1014407808 None] <== create_volume: return (1185ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 22:00:40 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-5e217c13-3729-4b6c-82c7-0ad0870c8670 tempest-VolumesActionsTest-1014407808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.188s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:00:40 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-5e217c13-3729-4b6c-82c7-0ad0870c8670 tempest-VolumesActionsTest-1014407808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f6fe4f7-c15d-41d9-91e6-e16334e4b3e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e372c09-05e0-4f83-ba9a-3fe34a6c6678', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:00:40 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-5e217c13-3729-4b6c-82c7-0ad0870c8670 tempest-VolumesActionsTest-1014407808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a70d182-3efb-4401-a385-4691cdd4ce98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:00:40 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-5e217c13-3729-4b6c-82c7-0ad0870c8670 tempest-VolumesActionsTest-1014407808 None] Volume volume-0e372c09-05e0-4f83-ba9a-3fe34a6c6678 (0e372c09-05e0-4f83-ba9a-3fe34a6c6678): created successfully Sep 17 22:00:40 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-5e217c13-3729-4b6c-82c7-0ad0870c8670 tempest-VolumesActionsTest-1014407808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a70d182-3efb-4401-a385-4691cdd4ce98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:00:40 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-5e217c13-3729-4b6c-82c7-0ad0870c8670 tempest-VolumesActionsTest-1014407808 None] Flow 'volume_create_manager' (b12e2a44-f72e-4dc5-8086-dc8e26e44e20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:00:40 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-5e217c13-3729-4b6c-82c7-0ad0870c8670 tempest-VolumesActionsTest-1014407808 None] Created volume successfully. Sep 17 22:00:40 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-108f33ee-36fd-48d8-a842-f7cc2f580ada tempest-VolumesTransfersV355Test-1574476971 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 22:00:40 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-108f33ee-36fd-48d8-a842-f7cc2f580ada tempest-VolumesTransfersV355Test-1574476971 None] Flow 'volume_create_manager' (b597d05a-616c-4ffb-afcd-4fb77e9fde55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:00:40 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-108f33ee-36fd-48d8-a842-f7cc2f580ada tempest-VolumesTransfersV355Test-1574476971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c754119-dfea-4cb2-8af0-3906227f4745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:00:40 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-108f33ee-36fd-48d8-a842-f7cc2f580ada tempest-VolumesTransfersV355Test-1574476971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c754119-dfea-4cb2-8af0-3906227f4745) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:00:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1512987725',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1ae9ec1-d76c-48f9-937b-ca502ab3230b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='688bbcf6844e46eba92ba914570231b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:00:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:00:41Z,use_quota=True,user_id='ee019904daa34ba58526421f99070e94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:00:40 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-108f33ee-36fd-48d8-a842-f7cc2f580ada tempest-VolumesTransfersV355Test-1574476971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b32491e-878e-4442-98a9-76b369e91e45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:00:40 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-108f33ee-36fd-48d8-a842-f7cc2f580ada tempest-VolumesTransfersV355Test-1574476971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b32491e-878e-4442-98a9-76b369e91e45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:00:40 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-108f33ee-36fd-48d8-a842-f7cc2f580ada tempest-VolumesTransfersV355Test-1574476971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3187f443-a591-4b75-a50f-24eff99e6bc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:00:40 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-108f33ee-36fd-48d8-a842-f7cc2f580ada tempest-VolumesTransfersV355Test-1574476971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3187f443-a591-4b75-a50f-24eff99e6bc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1ae9ec1-d76c-48f9-937b-ca502ab3230b', 'volume_name': 'volume-e1ae9ec1-d76c-48f9-937b-ca502ab3230b', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:00:40 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-108f33ee-36fd-48d8-a842-f7cc2f580ada tempest-VolumesTransfersV355Test-1574476971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b219110-e32b-4c79-a11e-aa1cc350d907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:00:40 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-108f33ee-36fd-48d8-a842-f7cc2f580ada tempest-VolumesTransfersV355Test-1574476971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b219110-e32b-4c79-a11e-aa1cc350d907) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:00:40 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-108f33ee-36fd-48d8-a842-f7cc2f580ada tempest-VolumesTransfersV355Test-1574476971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (558a1e3e-1c51-4421-91f6-9348bf72e3b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:00:40 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-108f33ee-36fd-48d8-a842-f7cc2f580ada tempest-VolumesTransfersV355Test-1574476971 None] Volume e1ae9ec1-d76c-48f9-937b-ca502ab3230b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1ae9ec1-d76c-48f9-937b-ca502ab3230b', 'volume_size': 1} Sep 17 22:00:40 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-108f33ee-36fd-48d8-a842-f7cc2f580ada tempest-VolumesTransfersV355Test-1574476971 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:00:40 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-108f33ee-36fd-48d8-a842-f7cc2f580ada tempest-VolumesTransfersV355Test-1574476971 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:00:40 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-108f33ee-36fd-48d8-a842-f7cc2f580ada tempest-VolumesTransfersV355Test-1574476971 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:00:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1512987725',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1ae9ec1-d76c-48f9-937b-ca502ab3230b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='688bbcf6844e46eba92ba914570231b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:00:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:00:41Z,use_quota=True,user_id='ee019904daa34ba58526421f99070e94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 22:00:40 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-108f33ee-36fd-48d8-a842-f7cc2f580ada tempest-VolumesTransfersV355Test-1574476971 None] Creating volume e1ae9ec1-d76c-48f9-937b-ca502ab3230b {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 22:00:40 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-108f33ee-36fd-48d8-a842-f7cc2f580ada tempest-VolumesTransfersV355Test-1574476971 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:00:40 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-108f33ee-36fd-48d8-a842-f7cc2f580ada tempest-VolumesTransfersV355Test-1574476971 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:00:40 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-108f33ee-36fd-48d8-a842-f7cc2f580ada tempest-VolumesTransfersV355Test-1574476971 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:00:40 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-108f33ee-36fd-48d8-a842-f7cc2f580ada tempest-VolumesTransfersV355Test-1574476971 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:00:40 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-108f33ee-36fd-48d8-a842-f7cc2f580ada tempest-VolumesTransfersV355Test-1574476971 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:00:40 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-108f33ee-36fd-48d8-a842-f7cc2f580ada tempest-VolumesTransfersV355Test-1574476971 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 22:00:40 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-108f33ee-36fd-48d8-a842-f7cc2f580ada tempest-VolumesTransfersV355Test-1574476971 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 22:00:40 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-108f33ee-36fd-48d8-a842-f7cc2f580ada tempest-VolumesTransfersV355Test-1574476971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e1ae9ec1-d76c-48f9-937b-ca502ab3230b 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:00:40 devstack sudo[96692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e1ae9ec1-d76c-48f9-937b-ca502ab3230b 1073741824 Sep 17 22:00:40 devstack sudo[96692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:00:41 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-103fd4cb-d3ee-41f8-925e-1ec19d5ad7da tempest-VolumesActionsTest-1712154832 None] Acquiring lock "cinder-0e372c09-05e0-4f83-ba9a-3fe34a6c6678-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:00:41 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-103fd4cb-d3ee-41f8-925e-1ec19d5ad7da tempest-VolumesActionsTest-1712154832 None] Lock "cinder-0e372c09-05e0-4f83-ba9a-3fe34a6c6678-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:00:41 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-103fd4cb-d3ee-41f8-925e-1ec19d5ad7da tempest-VolumesActionsTest-1712154832 None] Acquiring lock "cinder-quobyte-0e372c09-05e0-4f83-ba9a-3fe34a6c6678" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:00:41 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-103fd4cb-d3ee-41f8-925e-1ec19d5ad7da tempest-VolumesActionsTest-1712154832 None] Lock "cinder-quobyte-0e372c09-05e0-4f83-ba9a-3fe34a6c6678" acquired by "delete_volume" :: waited 0.029s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:00:41 devstack sudo[96692]: pam_unix(sudo:session): session closed for user root Sep 17 22:00:41 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-108f33ee-36fd-48d8-a842-f7cc2f580ada tempest-VolumesTransfersV355Test-1574476971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e1ae9ec1-d76c-48f9-937b-ca502ab3230b 1073741824" returned: 0 in 0.627s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:00:41 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb04dbcf-3e1c-49e3-a97c-9f5b4a0d11be]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:00:41 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-103fd4cb-d3ee-41f8-925e-1ec19d5ad7da tempest-VolumesActionsTest-1712154832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0e372c09-05e0-4f83-ba9a-3fe34a6c6678 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:00:41 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-108f33ee-36fd-48d8-a842-f7cc2f580ada tempest-VolumesTransfersV355Test-1574476971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e1ae9ec1-d76c-48f9-937b-ca502ab3230b {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:00:41 devstack sudo[96700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e1ae9ec1-d76c-48f9-937b-ca502ab3230b Sep 17 22:00:41 devstack sudo[96700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:00:41 devstack sudo[96699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0e372c09-05e0-4f83-ba9a-3fe34a6c6678 Sep 17 22:00:41 devstack sudo[96699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:00:41 devstack sudo[96700]: pam_unix(sudo:session): session closed for user root Sep 17 22:00:41 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-108f33ee-36fd-48d8-a842-f7cc2f580ada tempest-VolumesTransfersV355Test-1574476971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e1ae9ec1-d76c-48f9-937b-ca502ab3230b" returned: 0 in 0.408s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:00:41 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-108f33ee-36fd-48d8-a842-f7cc2f580ada tempest-VolumesTransfersV355Test-1574476971 None] <== create_volume: return (1104ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 22:00:41 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-108f33ee-36fd-48d8-a842-f7cc2f580ada tempest-VolumesTransfersV355Test-1574476971 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.109s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:00:41 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-108f33ee-36fd-48d8-a842-f7cc2f580ada tempest-VolumesTransfersV355Test-1574476971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (558a1e3e-1c51-4421-91f6-9348bf72e3b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1ae9ec1-d76c-48f9-937b-ca502ab3230b', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:00:41 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-108f33ee-36fd-48d8-a842-f7cc2f580ada tempest-VolumesTransfersV355Test-1574476971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad1aa54c-29c9-44ba-82ec-e2a7a3e2334c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:00:41 devstack sudo[96699]: pam_unix(sudo:session): session closed for user root Sep 17 22:00:41 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-108f33ee-36fd-48d8-a842-f7cc2f580ada tempest-VolumesTransfersV355Test-1574476971 None] Volume volume-e1ae9ec1-d76c-48f9-937b-ca502ab3230b (e1ae9ec1-d76c-48f9-937b-ca502ab3230b): created successfully Sep 17 22:00:41 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-108f33ee-36fd-48d8-a842-f7cc2f580ada tempest-VolumesTransfersV355Test-1574476971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad1aa54c-29c9-44ba-82ec-e2a7a3e2334c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:00:41 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-108f33ee-36fd-48d8-a842-f7cc2f580ada tempest-VolumesTransfersV355Test-1574476971 None] Flow 'volume_create_manager' (b597d05a-616c-4ffb-afcd-4fb77e9fde55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:00:41 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-103fd4cb-d3ee-41f8-925e-1ec19d5ad7da tempest-VolumesActionsTest-1712154832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0e372c09-05e0-4f83-ba9a-3fe34a6c6678" returned: 0 in 0.514s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:00:41 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-103fd4cb-d3ee-41f8-925e-1ec19d5ad7da tempest-VolumesActionsTest-1712154832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0e372c09-05e0-4f83-ba9a-3fe34a6c6678 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:00:42 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-108f33ee-36fd-48d8-a842-f7cc2f580ada tempest-VolumesTransfersV355Test-1574476971 None] Created volume successfully. Sep 17 22:00:42 devstack sudo[96707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0e372c09-05e0-4f83-ba9a-3fe34a6c6678 Sep 17 22:00:42 devstack sudo[96707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:00:42 devstack sudo[96707]: pam_unix(sudo:session): session closed for user root Sep 17 22:00:42 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-103fd4cb-d3ee-41f8-925e-1ec19d5ad7da tempest-VolumesActionsTest-1712154832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0e372c09-05e0-4f83-ba9a-3fe34a6c6678" returned: 0 in 0.336s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:00:42 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-103fd4cb-d3ee-41f8-925e-1ec19d5ad7da tempest-VolumesActionsTest-1712154832 None] Lock "cinder-quobyte-0e372c09-05e0-4f83-ba9a-3fe34a6c6678" released by "delete_volume" :: held 0.912s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:00:42 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-103fd4cb-d3ee-41f8-925e-1ec19d5ad7da tempest-VolumesActionsTest-1712154832 None] Created reservations ['5f9b6eda-296f-42b1-8165-d63a2e7fc66a', 'd42b8c09-5457-44c6-9063-ac4b29f21fbc', '6308545a-0235-4fb4-99c0-219e40a88576', '160a2989-e42f-4f22-9a41-cc86404c6b33'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:00:42 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-103fd4cb-d3ee-41f8-925e-1ec19d5ad7da tempest-VolumesActionsTest-1712154832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:00:42 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-103fd4cb-d3ee-41f8-925e-1ec19d5ad7da tempest-VolumesActionsTest-1712154832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:00:42 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-103fd4cb-d3ee-41f8-925e-1ec19d5ad7da tempest-VolumesActionsTest-1712154832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:00:42 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-103fd4cb-d3ee-41f8-925e-1ec19d5ad7da tempest-VolumesActionsTest-1712154832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:00:42 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-103fd4cb-d3ee-41f8-925e-1ec19d5ad7da tempest-VolumesActionsTest-1712154832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:00:42 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-103fd4cb-d3ee-41f8-925e-1ec19d5ad7da tempest-VolumesActionsTest-1712154832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:00:42 devstack sudo[96710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:00:42 devstack sudo[96710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:00:42 devstack sudo[96710]: pam_unix(sudo:session): session closed for user root Sep 17 22:00:42 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-103fd4cb-d3ee-41f8-925e-1ec19d5ad7da tempest-VolumesActionsTest-1712154832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.418s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:00:42 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-103fd4cb-d3ee-41f8-925e-1ec19d5ad7da tempest-VolumesActionsTest-1712154832 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:00:42 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-103fd4cb-d3ee-41f8-925e-1ec19d5ad7da tempest-VolumesActionsTest-1712154832 None] Deleted volume successfully. Sep 17 22:00:43 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-103fd4cb-d3ee-41f8-925e-1ec19d5ad7da tempest-VolumesActionsTest-1712154832 None] Lock "cinder-0e372c09-05e0-4f83-ba9a-3fe34a6c6678-delete_volume" released by "delete_volume" :: held 1.686s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:00:43 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-718e84c4-a536-40c1-a65a-2c3e492a29c8 tempest-VolumesActionsTest-1014407808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 22:00:43 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-718e84c4-a536-40c1-a65a-2c3e492a29c8 tempest-VolumesActionsTest-1014407808 None] Flow 'volume_create_manager' (1864dd14-1966-40a6-94a7-cc82c184549b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:00:43 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-718e84c4-a536-40c1-a65a-2c3e492a29c8 tempest-VolumesActionsTest-1014407808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (663a4467-2efd-44ca-876a-61a1387620e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:00:43 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-718e84c4-a536-40c1-a65a-2c3e492a29c8 tempest-VolumesActionsTest-1014407808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (663a4467-2efd-44ca-876a-61a1387620e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:00:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-896409927',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c28aedd0-a623-4dca-8354-b92884e4ab0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='029b95d472924e47b850686b44c327c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:00:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:00:43Z,use_quota=True,user_id='7a4b6fdac92c499282a190a384e15972',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:00:43 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-718e84c4-a536-40c1-a65a-2c3e492a29c8 tempest-VolumesActionsTest-1014407808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a046c198-7e30-44e8-9de5-5f8ae7ea37c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:00:43 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-718e84c4-a536-40c1-a65a-2c3e492a29c8 tempest-VolumesActionsTest-1014407808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a046c198-7e30-44e8-9de5-5f8ae7ea37c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:00:43 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-718e84c4-a536-40c1-a65a-2c3e492a29c8 tempest-VolumesActionsTest-1014407808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73c66cdd-a712-405a-a4ef-715484646f05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:00:43 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-718e84c4-a536-40c1-a65a-2c3e492a29c8 tempest-VolumesActionsTest-1014407808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73c66cdd-a712-405a-a4ef-715484646f05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c28aedd0-a623-4dca-8354-b92884e4ab0d', 'volume_name': 'volume-c28aedd0-a623-4dca-8354-b92884e4ab0d', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:00:43 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-718e84c4-a536-40c1-a65a-2c3e492a29c8 tempest-VolumesActionsTest-1014407808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc888a40-f1dc-4acb-8159-ab32fde76a12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:00:43 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-718e84c4-a536-40c1-a65a-2c3e492a29c8 tempest-VolumesActionsTest-1014407808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc888a40-f1dc-4acb-8159-ab32fde76a12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:00:43 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-718e84c4-a536-40c1-a65a-2c3e492a29c8 tempest-VolumesActionsTest-1014407808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20731ff7-80a1-4217-b00f-2bae305d7dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:00:43 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-718e84c4-a536-40c1-a65a-2c3e492a29c8 tempest-VolumesActionsTest-1014407808 None] Volume c28aedd0-a623-4dca-8354-b92884e4ab0d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c28aedd0-a623-4dca-8354-b92884e4ab0d', 'volume_size': 1} Sep 17 22:00:43 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-718e84c4-a536-40c1-a65a-2c3e492a29c8 tempest-VolumesActionsTest-1014407808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:00:43 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-718e84c4-a536-40c1-a65a-2c3e492a29c8 tempest-VolumesActionsTest-1014407808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:00:43 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-718e84c4-a536-40c1-a65a-2c3e492a29c8 tempest-VolumesActionsTest-1014407808 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:00:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-896409927',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c28aedd0-a623-4dca-8354-b92884e4ab0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='029b95d472924e47b850686b44c327c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:00:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:00:43Z,use_quota=True,user_id='7a4b6fdac92c499282a190a384e15972',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 22:00:43 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-718e84c4-a536-40c1-a65a-2c3e492a29c8 tempest-VolumesActionsTest-1014407808 None] Creating volume c28aedd0-a623-4dca-8354-b92884e4ab0d {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 22:00:43 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-718e84c4-a536-40c1-a65a-2c3e492a29c8 tempest-VolumesActionsTest-1014407808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:00:43 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-718e84c4-a536-40c1-a65a-2c3e492a29c8 tempest-VolumesActionsTest-1014407808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:00:43 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-718e84c4-a536-40c1-a65a-2c3e492a29c8 tempest-VolumesActionsTest-1014407808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:00:43 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-718e84c4-a536-40c1-a65a-2c3e492a29c8 tempest-VolumesActionsTest-1014407808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:00:43 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-718e84c4-a536-40c1-a65a-2c3e492a29c8 tempest-VolumesActionsTest-1014407808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:00:43 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-718e84c4-a536-40c1-a65a-2c3e492a29c8 tempest-VolumesActionsTest-1014407808 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 22:00:43 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-718e84c4-a536-40c1-a65a-2c3e492a29c8 tempest-VolumesActionsTest-1014407808 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 22:00:43 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-718e84c4-a536-40c1-a65a-2c3e492a29c8 tempest-VolumesActionsTest-1014407808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c28aedd0-a623-4dca-8354-b92884e4ab0d 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:00:43 devstack sudo[96713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c28aedd0-a623-4dca-8354-b92884e4ab0d 1073741824 Sep 17 22:00:43 devstack sudo[96713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:00:44 devstack sudo[96713]: pam_unix(sudo:session): session closed for user root Sep 17 22:00:44 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-718e84c4-a536-40c1-a65a-2c3e492a29c8 tempest-VolumesActionsTest-1014407808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c28aedd0-a623-4dca-8354-b92884e4ab0d 1073741824" returned: 0 in 0.611s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:00:44 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-718e84c4-a536-40c1-a65a-2c3e492a29c8 tempest-VolumesActionsTest-1014407808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c28aedd0-a623-4dca-8354-b92884e4ab0d {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:00:44 devstack sudo[96719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c28aedd0-a623-4dca-8354-b92884e4ab0d Sep 17 22:00:44 devstack sudo[96719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:00:44 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-6c142d1a-0e27-4a5d-b461-5cf375f548fc tempest-VolumesTransfersV355Test-268606527 None] Transfer volume completed successfully. Sep 17 22:00:44 devstack sudo[96719]: pam_unix(sudo:session): session closed for user root Sep 17 22:00:44 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-718e84c4-a536-40c1-a65a-2c3e492a29c8 tempest-VolumesActionsTest-1014407808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c28aedd0-a623-4dca-8354-b92884e4ab0d" returned: 0 in 0.419s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:00:44 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-718e84c4-a536-40c1-a65a-2c3e492a29c8 tempest-VolumesActionsTest-1014407808 None] <== create_volume: return (1081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 22:00:44 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-718e84c4-a536-40c1-a65a-2c3e492a29c8 tempest-VolumesActionsTest-1014407808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.084s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:00:44 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-718e84c4-a536-40c1-a65a-2c3e492a29c8 tempest-VolumesActionsTest-1014407808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20731ff7-80a1-4217-b00f-2bae305d7dfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c28aedd0-a623-4dca-8354-b92884e4ab0d', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:00:44 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-718e84c4-a536-40c1-a65a-2c3e492a29c8 tempest-VolumesActionsTest-1014407808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aaaeb900-814a-4afe-b748-751a5f40fc39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:00:44 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-718e84c4-a536-40c1-a65a-2c3e492a29c8 tempest-VolumesActionsTest-1014407808 None] Volume volume-c28aedd0-a623-4dca-8354-b92884e4ab0d (c28aedd0-a623-4dca-8354-b92884e4ab0d): created successfully Sep 17 22:00:44 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-718e84c4-a536-40c1-a65a-2c3e492a29c8 tempest-VolumesActionsTest-1014407808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aaaeb900-814a-4afe-b748-751a5f40fc39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:00:44 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-718e84c4-a536-40c1-a65a-2c3e492a29c8 tempest-VolumesActionsTest-1014407808 None] Flow 'volume_create_manager' (1864dd14-1966-40a6-94a7-cc82c184549b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:00:44 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-718e84c4-a536-40c1-a65a-2c3e492a29c8 tempest-VolumesActionsTest-1014407808 None] Created volume successfully. Sep 17 22:00:45 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-f228d8e2-ca50-4e87-a2e4-20622ce42b47 tempest-VolumesTransfersV355Test-239440039 None] Acquiring lock "cinder-e1ae9ec1-d76c-48f9-937b-ca502ab3230b-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:00:45 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-f228d8e2-ca50-4e87-a2e4-20622ce42b47 tempest-VolumesTransfersV355Test-239440039 None] Lock "cinder-e1ae9ec1-d76c-48f9-937b-ca502ab3230b-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:00:45 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-f228d8e2-ca50-4e87-a2e4-20622ce42b47 tempest-VolumesTransfersV355Test-239440039 None] Acquiring lock "cinder-quobyte-e1ae9ec1-d76c-48f9-937b-ca502ab3230b" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:00:45 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-f228d8e2-ca50-4e87-a2e4-20622ce42b47 tempest-VolumesTransfersV355Test-239440039 None] Lock "cinder-quobyte-e1ae9ec1-d76c-48f9-937b-ca502ab3230b" acquired by "delete_volume" :: waited 0.019s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:00:45 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[7766e768-2710-4037-8a08-d941ec0a8e95]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:00:45 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-f228d8e2-ca50-4e87-a2e4-20622ce42b47 tempest-VolumesTransfersV355Test-239440039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e1ae9ec1-d76c-48f9-937b-ca502ab3230b {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:00:45 devstack sudo[96722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e1ae9ec1-d76c-48f9-937b-ca502ab3230b Sep 17 22:00:45 devstack sudo[96722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:00:45 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-4840b4ad-7105-4162-927c-defe6dfdf380 tempest-VolumesActionsTest-1712154832 None] Acquiring lock "cinder-c28aedd0-a623-4dca-8354-b92884e4ab0d-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:00:45 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-4840b4ad-7105-4162-927c-defe6dfdf380 tempest-VolumesActionsTest-1712154832 None] Lock "cinder-c28aedd0-a623-4dca-8354-b92884e4ab0d-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:00:45 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-4840b4ad-7105-4162-927c-defe6dfdf380 tempest-VolumesActionsTest-1712154832 None] Acquiring lock "cinder-quobyte-c28aedd0-a623-4dca-8354-b92884e4ab0d" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:00:45 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-4840b4ad-7105-4162-927c-defe6dfdf380 tempest-VolumesActionsTest-1712154832 None] Lock "cinder-quobyte-c28aedd0-a623-4dca-8354-b92884e4ab0d" acquired by "delete_volume" :: waited 0.024s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:00:45 devstack sudo[96722]: pam_unix(sudo:session): session closed for user root Sep 17 22:00:45 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[deb8cc5c-d635-4b93-8056-d924995b59b0]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:00:45 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-4840b4ad-7105-4162-927c-defe6dfdf380 tempest-VolumesActionsTest-1712154832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c28aedd0-a623-4dca-8354-b92884e4ab0d {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:00:45 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-f228d8e2-ca50-4e87-a2e4-20622ce42b47 tempest-VolumesTransfersV355Test-239440039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e1ae9ec1-d76c-48f9-937b-ca502ab3230b" returned: 0 in 0.536s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:00:45 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-f228d8e2-ca50-4e87-a2e4-20622ce42b47 tempest-VolumesTransfersV355Test-239440039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e1ae9ec1-d76c-48f9-937b-ca502ab3230b {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:00:46 devstack sudo[96728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e1ae9ec1-d76c-48f9-937b-ca502ab3230b Sep 17 22:00:46 devstack sudo[96728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:00:46 devstack sudo[96727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c28aedd0-a623-4dca-8354-b92884e4ab0d Sep 17 22:00:46 devstack sudo[96727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:00:46 devstack sudo[96728]: pam_unix(sudo:session): session closed for user root Sep 17 22:00:46 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-f228d8e2-ca50-4e87-a2e4-20622ce42b47 tempest-VolumesTransfersV355Test-239440039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e1ae9ec1-d76c-48f9-937b-ca502ab3230b" returned: 0 in 0.341s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:00:46 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-f228d8e2-ca50-4e87-a2e4-20622ce42b47 tempest-VolumesTransfersV355Test-239440039 None] Lock "cinder-quobyte-e1ae9ec1-d76c-48f9-937b-ca502ab3230b" released by "delete_volume" :: held 0.945s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:00:46 devstack sudo[96727]: pam_unix(sudo:session): session closed for user root Sep 17 22:00:46 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-f228d8e2-ca50-4e87-a2e4-20622ce42b47 tempest-VolumesTransfersV355Test-239440039 None] Created reservations ['4248958f-ebe1-4dc8-9097-1d8dca8d35de', '8d566c4e-957c-4bcc-9d5f-e0ae5d0b2921', '85edf811-0072-438c-b554-94b27d079b97', '32cce242-d69c-4133-9828-067c4fb9a6ef'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:00:46 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-4840b4ad-7105-4162-927c-defe6dfdf380 tempest-VolumesActionsTest-1712154832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c28aedd0-a623-4dca-8354-b92884e4ab0d" returned: 0 in 0.470s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:00:46 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-4840b4ad-7105-4162-927c-defe6dfdf380 tempest-VolumesActionsTest-1712154832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c28aedd0-a623-4dca-8354-b92884e4ab0d {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:00:46 devstack sudo[96735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c28aedd0-a623-4dca-8354-b92884e4ab0d Sep 17 22:00:46 devstack sudo[96735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:00:46 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-f228d8e2-ca50-4e87-a2e4-20622ce42b47 tempest-VolumesTransfersV355Test-239440039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:00:46 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-f228d8e2-ca50-4e87-a2e4-20622ce42b47 tempest-VolumesTransfersV355Test-239440039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:00:46 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-f228d8e2-ca50-4e87-a2e4-20622ce42b47 tempest-VolumesTransfersV355Test-239440039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:00:46 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-f228d8e2-ca50-4e87-a2e4-20622ce42b47 tempest-VolumesTransfersV355Test-239440039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:00:46 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-f228d8e2-ca50-4e87-a2e4-20622ce42b47 tempest-VolumesTransfersV355Test-239440039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:00:46 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-f228d8e2-ca50-4e87-a2e4-20622ce42b47 tempest-VolumesTransfersV355Test-239440039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:00:46 devstack sudo[96737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:00:46 devstack sudo[96737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:00:46 devstack sudo[96735]: pam_unix(sudo:session): session closed for user root Sep 17 22:00:46 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-4840b4ad-7105-4162-927c-defe6dfdf380 tempest-VolumesActionsTest-1712154832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c28aedd0-a623-4dca-8354-b92884e4ab0d" returned: 0 in 0.324s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:00:46 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-4840b4ad-7105-4162-927c-defe6dfdf380 tempest-VolumesActionsTest-1712154832 None] Lock "cinder-quobyte-c28aedd0-a623-4dca-8354-b92884e4ab0d" released by "delete_volume" :: held 0.866s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:00:46 devstack sudo[96737]: pam_unix(sudo:session): session closed for user root Sep 17 22:00:46 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-f228d8e2-ca50-4e87-a2e4-20622ce42b47 tempest-VolumesTransfersV355Test-239440039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.308s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:00:46 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-f228d8e2-ca50-4e87-a2e4-20622ce42b47 tempest-VolumesTransfersV355Test-239440039 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:00:46 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-f228d8e2-ca50-4e87-a2e4-20622ce42b47 tempest-VolumesTransfersV355Test-239440039 None] Deleted volume successfully. Sep 17 22:00:46 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-4840b4ad-7105-4162-927c-defe6dfdf380 tempest-VolumesActionsTest-1712154832 None] Created reservations ['a0b51b88-f4b5-4e7b-b465-851cea19f979', 'aff25f9a-317d-4826-bd29-fcbd28af5cc3', 'e6df60e4-1d4d-4c96-b743-a27918cd89c7', '07e7a57c-e654-4bb6-bb2e-c61e1b3b30cb'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:00:46 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-f228d8e2-ca50-4e87-a2e4-20622ce42b47 tempest-VolumesTransfersV355Test-239440039 None] Lock "cinder-e1ae9ec1-d76c-48f9-937b-ca502ab3230b-delete_volume" released by "delete_volume" :: held 1.596s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:00:47 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-4840b4ad-7105-4162-927c-defe6dfdf380 tempest-VolumesActionsTest-1712154832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:00:47 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-4840b4ad-7105-4162-927c-defe6dfdf380 tempest-VolumesActionsTest-1712154832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:00:47 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-4840b4ad-7105-4162-927c-defe6dfdf380 tempest-VolumesActionsTest-1712154832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:00:47 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-4840b4ad-7105-4162-927c-defe6dfdf380 tempest-VolumesActionsTest-1712154832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:00:47 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-4840b4ad-7105-4162-927c-defe6dfdf380 tempest-VolumesActionsTest-1712154832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:00:47 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-4840b4ad-7105-4162-927c-defe6dfdf380 tempest-VolumesActionsTest-1712154832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:00:47 devstack sudo[96741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:00:47 devstack sudo[96741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:00:47 devstack sudo[96741]: pam_unix(sudo:session): session closed for user root Sep 17 22:00:47 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-4840b4ad-7105-4162-927c-defe6dfdf380 tempest-VolumesActionsTest-1712154832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.476s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:00:47 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-4840b4ad-7105-4162-927c-defe6dfdf380 tempest-VolumesActionsTest-1712154832 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:00:47 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-4840b4ad-7105-4162-927c-defe6dfdf380 tempest-VolumesActionsTest-1712154832 None] Deleted volume successfully. Sep 17 22:00:47 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-4840b4ad-7105-4162-927c-defe6dfdf380 tempest-VolumesActionsTest-1712154832 None] Lock "cinder-c28aedd0-a623-4dca-8354-b92884e4ab0d-delete_volume" released by "delete_volume" :: held 1.716s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:00:47 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-40b0f94b-adc3-456d-97d2-1644d5bc48b2 tempest-VolumeRetypeWithoutMigrationTest-716898298 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 22:00:47 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-40b0f94b-adc3-456d-97d2-1644d5bc48b2 tempest-VolumeRetypeWithoutMigrationTest-716898298 None] Flow 'volume_create_manager' (52689122-f665-4e6f-845c-777c34517fd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:00:48 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-40b0f94b-adc3-456d-97d2-1644d5bc48b2 tempest-VolumeRetypeWithoutMigrationTest-716898298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72738343-d9d5-4917-a2c5-76c5cb62f678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:00:48 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-40b0f94b-adc3-456d-97d2-1644d5bc48b2 tempest-VolumeRetypeWithoutMigrationTest-716898298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72738343-d9d5-4917-a2c5-76c5cb62f678) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:00:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-196720120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d601cc3-c0a2-4444-93a4-32186f371d01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66ab2f85cabb49a2b582353610315b78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:00:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:00:48Z,use_quota=True,user_id='bb9010fbb55346f8af3da04f89c3f18e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1fb50a9-ebe3-4416-8e3b-fe214e3451ad),volume_type_id=d1fb50a9-ebe3-4416-8e3b-fe214e3451ad)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:00:48 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-40b0f94b-adc3-456d-97d2-1644d5bc48b2 tempest-VolumeRetypeWithoutMigrationTest-716898298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bb49c8e-2a81-4147-a73e-4bae78b5734a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:00:48 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-40b0f94b-adc3-456d-97d2-1644d5bc48b2 tempest-VolumeRetypeWithoutMigrationTest-716898298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bb49c8e-2a81-4147-a73e-4bae78b5734a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:00:48 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-40b0f94b-adc3-456d-97d2-1644d5bc48b2 tempest-VolumeRetypeWithoutMigrationTest-716898298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (072ba1c4-21b1-4b4b-a5e9-8cb7db230a32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:00:48 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-40b0f94b-adc3-456d-97d2-1644d5bc48b2 tempest-VolumeRetypeWithoutMigrationTest-716898298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (072ba1c4-21b1-4b4b-a5e9-8cb7db230a32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d601cc3-c0a2-4444-93a4-32186f371d01', 'volume_name': 'volume-8d601cc3-c0a2-4444-93a4-32186f371d01', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:00:48 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-40b0f94b-adc3-456d-97d2-1644d5bc48b2 tempest-VolumeRetypeWithoutMigrationTest-716898298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41abe904-2747-4dca-bbc7-9e2681ec2eaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:00:48 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-40b0f94b-adc3-456d-97d2-1644d5bc48b2 tempest-VolumeRetypeWithoutMigrationTest-716898298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41abe904-2747-4dca-bbc7-9e2681ec2eaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:00:48 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-40b0f94b-adc3-456d-97d2-1644d5bc48b2 tempest-VolumeRetypeWithoutMigrationTest-716898298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b28cb9d3-4033-45da-bc0d-b10a554170af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:00:48 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-40b0f94b-adc3-456d-97d2-1644d5bc48b2 tempest-VolumeRetypeWithoutMigrationTest-716898298 None] Volume 8d601cc3-c0a2-4444-93a4-32186f371d01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d601cc3-c0a2-4444-93a4-32186f371d01', 'volume_size': 1} Sep 17 22:00:48 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-40b0f94b-adc3-456d-97d2-1644d5bc48b2 tempest-VolumeRetypeWithoutMigrationTest-716898298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:00:48 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-40b0f94b-adc3-456d-97d2-1644d5bc48b2 tempest-VolumeRetypeWithoutMigrationTest-716898298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:00:48 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-40b0f94b-adc3-456d-97d2-1644d5bc48b2 tempest-VolumeRetypeWithoutMigrationTest-716898298 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:00:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-196720120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d601cc3-c0a2-4444-93a4-32186f371d01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66ab2f85cabb49a2b582353610315b78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:00:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:00:48Z,use_quota=True,user_id='bb9010fbb55346f8af3da04f89c3f18e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1fb50a9-ebe3-4416-8e3b-fe214e3451ad),volume_type_id=d1fb50a9-ebe3-4416-8e3b-fe214e3451ad)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 22:00:48 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-40b0f94b-adc3-456d-97d2-1644d5bc48b2 tempest-VolumeRetypeWithoutMigrationTest-716898298 None] Creating volume 8d601cc3-c0a2-4444-93a4-32186f371d01 {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 22:00:48 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-40b0f94b-adc3-456d-97d2-1644d5bc48b2 tempest-VolumeRetypeWithoutMigrationTest-716898298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:00:48 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-40b0f94b-adc3-456d-97d2-1644d5bc48b2 tempest-VolumeRetypeWithoutMigrationTest-716898298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:00:48 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-40b0f94b-adc3-456d-97d2-1644d5bc48b2 tempest-VolumeRetypeWithoutMigrationTest-716898298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:00:48 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-40b0f94b-adc3-456d-97d2-1644d5bc48b2 tempest-VolumeRetypeWithoutMigrationTest-716898298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:00:48 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-40b0f94b-adc3-456d-97d2-1644d5bc48b2 tempest-VolumeRetypeWithoutMigrationTest-716898298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:00:48 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-40b0f94b-adc3-456d-97d2-1644d5bc48b2 tempest-VolumeRetypeWithoutMigrationTest-716898298 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 22:00:48 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-40b0f94b-adc3-456d-97d2-1644d5bc48b2 tempest-VolumeRetypeWithoutMigrationTest-716898298 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 22:00:48 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-40b0f94b-adc3-456d-97d2-1644d5bc48b2 tempest-VolumeRetypeWithoutMigrationTest-716898298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8d601cc3-c0a2-4444-93a4-32186f371d01 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:00:48 devstack sudo[96744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8d601cc3-c0a2-4444-93a4-32186f371d01 1073741824 Sep 17 22:00:48 devstack sudo[96744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:00:48 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-295d0842-bba1-456a-8644-e3e230d71085 tempest-VolumesActionsTest-1014407808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 22:00:48 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-295d0842-bba1-456a-8644-e3e230d71085 tempest-VolumesActionsTest-1014407808 None] Flow 'volume_create_manager' (6fd7de76-288a-48af-b9a9-03b43680f8be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:00:48 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-295d0842-bba1-456a-8644-e3e230d71085 tempest-VolumesActionsTest-1014407808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1dc08ff-d9bd-4714-952f-80cbf932236c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:00:48 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-295d0842-bba1-456a-8644-e3e230d71085 tempest-VolumesActionsTest-1014407808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1dc08ff-d9bd-4714-952f-80cbf932236c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:00:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-465506432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d401d967-5211-49a5-a099-e850935efbd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='029b95d472924e47b850686b44c327c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:00:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:00:48Z,use_quota=True,user_id='7a4b6fdac92c499282a190a384e15972',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:00:48 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-295d0842-bba1-456a-8644-e3e230d71085 tempest-VolumesActionsTest-1014407808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01e55fc6-b911-4a02-8eee-43ec1ee06c59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:00:48 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-295d0842-bba1-456a-8644-e3e230d71085 tempest-VolumesActionsTest-1014407808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01e55fc6-b911-4a02-8eee-43ec1ee06c59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:00:48 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-295d0842-bba1-456a-8644-e3e230d71085 tempest-VolumesActionsTest-1014407808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (718db1f2-f175-4d73-b7ad-085c37c42ed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:00:48 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-295d0842-bba1-456a-8644-e3e230d71085 tempest-VolumesActionsTest-1014407808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (718db1f2-f175-4d73-b7ad-085c37c42ed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd401d967-5211-49a5-a099-e850935efbd3', 'volume_name': 'volume-d401d967-5211-49a5-a099-e850935efbd3', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:00:48 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-295d0842-bba1-456a-8644-e3e230d71085 tempest-VolumesActionsTest-1014407808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed38f88b-dae2-4111-a397-433368edde7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:00:48 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-295d0842-bba1-456a-8644-e3e230d71085 tempest-VolumesActionsTest-1014407808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed38f88b-dae2-4111-a397-433368edde7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:00:48 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-295d0842-bba1-456a-8644-e3e230d71085 tempest-VolumesActionsTest-1014407808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b44da4b4-18c6-45a5-a724-8db9fc8bda24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:00:48 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-295d0842-bba1-456a-8644-e3e230d71085 tempest-VolumesActionsTest-1014407808 None] Volume d401d967-5211-49a5-a099-e850935efbd3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d401d967-5211-49a5-a099-e850935efbd3', 'volume_size': 1} Sep 17 22:00:48 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-295d0842-bba1-456a-8644-e3e230d71085 tempest-VolumesActionsTest-1014407808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:00:48 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4625b5b-374b-440b-af91-20e3c7829716 tempest-VolumesTransfersV355Test-1574476971 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 22:00:48 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-d4625b5b-374b-440b-af91-20e3c7829716 tempest-VolumesTransfersV355Test-1574476971 None] Flow 'volume_create_manager' (02eff204-0d4d-4bd3-a8b8-32fae622a7e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:00:48 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-d4625b5b-374b-440b-af91-20e3c7829716 tempest-VolumesTransfersV355Test-1574476971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6116c28f-6594-4171-8e57-8e31fb532f6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:00:48 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-d4625b5b-374b-440b-af91-20e3c7829716 tempest-VolumesTransfersV355Test-1574476971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6116c28f-6594-4171-8e57-8e31fb532f6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:00:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-207030581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d6fb4a2-b5cb-413e-8f35-c26a71af95c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='688bbcf6844e46eba92ba914570231b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:00:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:00:48Z,use_quota=True,user_id='ee019904daa34ba58526421f99070e94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:00:48 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-d4625b5b-374b-440b-af91-20e3c7829716 tempest-VolumesTransfersV355Test-1574476971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (618a5864-9aaa-45b0-824a-4e288e68eb09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:00:48 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-d4625b5b-374b-440b-af91-20e3c7829716 tempest-VolumesTransfersV355Test-1574476971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (618a5864-9aaa-45b0-824a-4e288e68eb09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:00:48 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-d4625b5b-374b-440b-af91-20e3c7829716 tempest-VolumesTransfersV355Test-1574476971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4a62e6d-7bd9-4c47-bf7d-7fc462a1e213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:00:48 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-d4625b5b-374b-440b-af91-20e3c7829716 tempest-VolumesTransfersV355Test-1574476971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4a62e6d-7bd9-4c47-bf7d-7fc462a1e213) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d6fb4a2-b5cb-413e-8f35-c26a71af95c3', 'volume_name': 'volume-7d6fb4a2-b5cb-413e-8f35-c26a71af95c3', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:00:48 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-d4625b5b-374b-440b-af91-20e3c7829716 tempest-VolumesTransfersV355Test-1574476971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98684dd0-54cc-42b7-9be9-18492c9cbd9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:00:48 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-d4625b5b-374b-440b-af91-20e3c7829716 tempest-VolumesTransfersV355Test-1574476971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98684dd0-54cc-42b7-9be9-18492c9cbd9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:00:48 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-d4625b5b-374b-440b-af91-20e3c7829716 tempest-VolumesTransfersV355Test-1574476971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5976af9-76df-4629-88f1-a726cb2af035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:00:48 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-d4625b5b-374b-440b-af91-20e3c7829716 tempest-VolumesTransfersV355Test-1574476971 None] Volume 7d6fb4a2-b5cb-413e-8f35-c26a71af95c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d6fb4a2-b5cb-413e-8f35-c26a71af95c3', 'volume_size': 1} Sep 17 22:00:48 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-d4625b5b-374b-440b-af91-20e3c7829716 tempest-VolumesTransfersV355Test-1574476971 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:00:48 devstack sudo[96744]: pam_unix(sudo:session): session closed for user root Sep 17 22:00:48 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-40b0f94b-adc3-456d-97d2-1644d5bc48b2 tempest-VolumeRetypeWithoutMigrationTest-716898298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8d601cc3-c0a2-4444-93a4-32186f371d01 1073741824" returned: 0 in 0.621s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:00:48 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-40b0f94b-adc3-456d-97d2-1644d5bc48b2 tempest-VolumeRetypeWithoutMigrationTest-716898298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8d601cc3-c0a2-4444-93a4-32186f371d01 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:00:48 devstack sudo[96751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8d601cc3-c0a2-4444-93a4-32186f371d01 Sep 17 22:00:48 devstack sudo[96751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:00:49 devstack sudo[96751]: pam_unix(sudo:session): session closed for user root Sep 17 22:00:49 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-40b0f94b-adc3-456d-97d2-1644d5bc48b2 tempest-VolumeRetypeWithoutMigrationTest-716898298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8d601cc3-c0a2-4444-93a4-32186f371d01" returned: 0 in 0.283s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:00:49 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-40b0f94b-adc3-456d-97d2-1644d5bc48b2 tempest-VolumeRetypeWithoutMigrationTest-716898298 None] <== create_volume: return (962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 22:00:49 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-40b0f94b-adc3-456d-97d2-1644d5bc48b2 tempest-VolumeRetypeWithoutMigrationTest-716898298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.964s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:00:49 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-295d0842-bba1-456a-8644-e3e230d71085 tempest-VolumesActionsTest-1014407808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.779s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:00:49 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-295d0842-bba1-456a-8644-e3e230d71085 tempest-VolumesActionsTest-1014407808 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:00:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-465506432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d401d967-5211-49a5-a099-e850935efbd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='029b95d472924e47b850686b44c327c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:00:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:00:48Z,use_quota=True,user_id='7a4b6fdac92c499282a190a384e15972',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 22:00:49 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-295d0842-bba1-456a-8644-e3e230d71085 tempest-VolumesActionsTest-1014407808 None] Creating volume d401d967-5211-49a5-a099-e850935efbd3 {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 22:00:49 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-295d0842-bba1-456a-8644-e3e230d71085 tempest-VolumesActionsTest-1014407808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:00:49 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-295d0842-bba1-456a-8644-e3e230d71085 tempest-VolumesActionsTest-1014407808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:00:49 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-295d0842-bba1-456a-8644-e3e230d71085 tempest-VolumesActionsTest-1014407808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:00:49 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-295d0842-bba1-456a-8644-e3e230d71085 tempest-VolumesActionsTest-1014407808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:00:49 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-295d0842-bba1-456a-8644-e3e230d71085 tempest-VolumesActionsTest-1014407808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:00:49 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-295d0842-bba1-456a-8644-e3e230d71085 tempest-VolumesActionsTest-1014407808 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 22:00:49 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-295d0842-bba1-456a-8644-e3e230d71085 tempest-VolumesActionsTest-1014407808 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 22:00:49 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-295d0842-bba1-456a-8644-e3e230d71085 tempest-VolumesActionsTest-1014407808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-d401d967-5211-49a5-a099-e850935efbd3 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:00:49 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-40b0f94b-adc3-456d-97d2-1644d5bc48b2 tempest-VolumeRetypeWithoutMigrationTest-716898298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b28cb9d3-4033-45da-bc0d-b10a554170af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d601cc3-c0a2-4444-93a4-32186f371d01', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:00:49 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-40b0f94b-adc3-456d-97d2-1644d5bc48b2 tempest-VolumeRetypeWithoutMigrationTest-716898298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0b9d974-3cf3-43be-a14c-55f912cc9907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:00:49 devstack sudo[96755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-d401d967-5211-49a5-a099-e850935efbd3 1073741824 Sep 17 22:00:49 devstack sudo[96755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:00:49 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-40b0f94b-adc3-456d-97d2-1644d5bc48b2 tempest-VolumeRetypeWithoutMigrationTest-716898298 None] Volume volume-8d601cc3-c0a2-4444-93a4-32186f371d01 (8d601cc3-c0a2-4444-93a4-32186f371d01): created successfully Sep 17 22:00:49 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-40b0f94b-adc3-456d-97d2-1644d5bc48b2 tempest-VolumeRetypeWithoutMigrationTest-716898298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0b9d974-3cf3-43be-a14c-55f912cc9907) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:00:49 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-40b0f94b-adc3-456d-97d2-1644d5bc48b2 tempest-VolumeRetypeWithoutMigrationTest-716898298 None] Flow 'volume_create_manager' (52689122-f665-4e6f-845c-777c34517fd4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:00:49 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-40b0f94b-adc3-456d-97d2-1644d5bc48b2 tempest-VolumeRetypeWithoutMigrationTest-716898298 None] Created volume successfully. Sep 17 22:00:49 devstack sudo[96755]: pam_unix(sudo:session): session closed for user root Sep 17 22:00:49 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-295d0842-bba1-456a-8644-e3e230d71085 tempest-VolumesActionsTest-1014407808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-d401d967-5211-49a5-a099-e850935efbd3 1073741824" returned: 0 in 0.515s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:00:49 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-295d0842-bba1-456a-8644-e3e230d71085 tempest-VolumesActionsTest-1014407808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-d401d967-5211-49a5-a099-e850935efbd3 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:00:49 devstack sudo[96762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-d401d967-5211-49a5-a099-e850935efbd3 Sep 17 22:00:49 devstack sudo[96762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:00:49 devstack sudo[96762]: pam_unix(sudo:session): session closed for user root Sep 17 22:00:49 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-295d0842-bba1-456a-8644-e3e230d71085 tempest-VolumesActionsTest-1014407808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-d401d967-5211-49a5-a099-e850935efbd3" returned: 0 in 0.321s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:00:49 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-295d0842-bba1-456a-8644-e3e230d71085 tempest-VolumesActionsTest-1014407808 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 22:00:49 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-295d0842-bba1-456a-8644-e3e230d71085 tempest-VolumesActionsTest-1014407808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.883s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:00:49 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-d4625b5b-374b-440b-af91-20e3c7829716 tempest-VolumesTransfersV355Test-1574476971 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.418s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:00:49 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-d4625b5b-374b-440b-af91-20e3c7829716 tempest-VolumesTransfersV355Test-1574476971 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:00:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-207030581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d6fb4a2-b5cb-413e-8f35-c26a71af95c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='688bbcf6844e46eba92ba914570231b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:00:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:00:48Z,use_quota=True,user_id='ee019904daa34ba58526421f99070e94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 22:00:49 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-d4625b5b-374b-440b-af91-20e3c7829716 tempest-VolumesTransfersV355Test-1574476971 None] Creating volume 7d6fb4a2-b5cb-413e-8f35-c26a71af95c3 {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 22:00:49 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-d4625b5b-374b-440b-af91-20e3c7829716 tempest-VolumesTransfersV355Test-1574476971 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:00:49 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-d4625b5b-374b-440b-af91-20e3c7829716 tempest-VolumesTransfersV355Test-1574476971 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:00:49 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-d4625b5b-374b-440b-af91-20e3c7829716 tempest-VolumesTransfersV355Test-1574476971 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:00:49 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-d4625b5b-374b-440b-af91-20e3c7829716 tempest-VolumesTransfersV355Test-1574476971 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:00:49 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-d4625b5b-374b-440b-af91-20e3c7829716 tempest-VolumesTransfersV355Test-1574476971 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:00:49 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-d4625b5b-374b-440b-af91-20e3c7829716 tempest-VolumesTransfersV355Test-1574476971 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 22:00:49 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-d4625b5b-374b-440b-af91-20e3c7829716 tempest-VolumesTransfersV355Test-1574476971 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 22:00:49 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-d4625b5b-374b-440b-af91-20e3c7829716 tempest-VolumesTransfersV355Test-1574476971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7d6fb4a2-b5cb-413e-8f35-c26a71af95c3 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:00:49 devstack sudo[96765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7d6fb4a2-b5cb-413e-8f35-c26a71af95c3 1073741824 Sep 17 22:00:49 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-295d0842-bba1-456a-8644-e3e230d71085 tempest-VolumesActionsTest-1014407808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b44da4b4-18c6-45a5-a724-8db9fc8bda24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d401d967-5211-49a5-a099-e850935efbd3', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:00:49 devstack sudo[96765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:00:50 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-295d0842-bba1-456a-8644-e3e230d71085 tempest-VolumesActionsTest-1014407808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a66efd3c-3651-488b-a8ca-d5b32074fd0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:00:50 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-295d0842-bba1-456a-8644-e3e230d71085 tempest-VolumesActionsTest-1014407808 None] Volume volume-d401d967-5211-49a5-a099-e850935efbd3 (d401d967-5211-49a5-a099-e850935efbd3): created successfully Sep 17 22:00:50 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-295d0842-bba1-456a-8644-e3e230d71085 tempest-VolumesActionsTest-1014407808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a66efd3c-3651-488b-a8ca-d5b32074fd0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:00:50 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-295d0842-bba1-456a-8644-e3e230d71085 tempest-VolumesActionsTest-1014407808 None] Flow 'volume_create_manager' (6fd7de76-288a-48af-b9a9-03b43680f8be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:00:50 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-295d0842-bba1-456a-8644-e3e230d71085 tempest-VolumesActionsTest-1014407808 None] Created volume successfully. Sep 17 22:00:50 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-579466de-e8ef-440e-9297-466ce55178fd tempest-VolumeRetypeWithoutMigrationTest-716898298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:00:50 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-579466de-e8ef-440e-9297-466ce55178fd tempest-VolumeRetypeWithoutMigrationTest-716898298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:00:50 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-579466de-e8ef-440e-9297-466ce55178fd tempest-VolumeRetypeWithoutMigrationTest-716898298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:00:50 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-579466de-e8ef-440e-9297-466ce55178fd tempest-VolumeRetypeWithoutMigrationTest-716898298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:00:50 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-579466de-e8ef-440e-9297-466ce55178fd tempest-VolumeRetypeWithoutMigrationTest-716898298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:00:50 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-579466de-e8ef-440e-9297-466ce55178fd tempest-VolumeRetypeWithoutMigrationTest-716898298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:00:50 devstack sudo[96771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:00:50 devstack sudo[96771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:00:50 devstack sudo[96765]: pam_unix(sudo:session): session closed for user root Sep 17 22:00:50 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-d4625b5b-374b-440b-af91-20e3c7829716 tempest-VolumesTransfersV355Test-1574476971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7d6fb4a2-b5cb-413e-8f35-c26a71af95c3 1073741824" returned: 0 in 0.560s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:00:50 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-d4625b5b-374b-440b-af91-20e3c7829716 tempest-VolumesTransfersV355Test-1574476971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7d6fb4a2-b5cb-413e-8f35-c26a71af95c3 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:00:50 devstack sudo[96773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7d6fb4a2-b5cb-413e-8f35-c26a71af95c3 Sep 17 22:00:50 devstack sudo[96773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:00:50 devstack sudo[96771]: pam_unix(sudo:session): session closed for user root Sep 17 22:00:50 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-579466de-e8ef-440e-9297-466ce55178fd tempest-VolumeRetypeWithoutMigrationTest-716898298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.277s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:00:50 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-579466de-e8ef-440e-9297-466ce55178fd tempest-VolumeRetypeWithoutMigrationTest-716898298 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:00:50 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-579466de-e8ef-440e-9297-466ce55178fd tempest-VolumeRetypeWithoutMigrationTest-716898298 None] Retype volume completed successfully. Sep 17 22:00:50 devstack sudo[96773]: pam_unix(sudo:session): session closed for user root Sep 17 22:00:50 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-d4625b5b-374b-440b-af91-20e3c7829716 tempest-VolumesTransfersV355Test-1574476971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7d6fb4a2-b5cb-413e-8f35-c26a71af95c3" returned: 0 in 0.257s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:00:50 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-d4625b5b-374b-440b-af91-20e3c7829716 tempest-VolumesTransfersV355Test-1574476971 None] <== create_volume: return (886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 22:00:50 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-d4625b5b-374b-440b-af91-20e3c7829716 tempest-VolumesTransfersV355Test-1574476971 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:00:50 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-d4625b5b-374b-440b-af91-20e3c7829716 tempest-VolumesTransfersV355Test-1574476971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5976af9-76df-4629-88f1-a726cb2af035) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d6fb4a2-b5cb-413e-8f35-c26a71af95c3', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:00:50 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-d4625b5b-374b-440b-af91-20e3c7829716 tempest-VolumesTransfersV355Test-1574476971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eff9e81d-d080-49eb-821b-ba306672f277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:00:50 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-d4625b5b-374b-440b-af91-20e3c7829716 tempest-VolumesTransfersV355Test-1574476971 None] Volume volume-7d6fb4a2-b5cb-413e-8f35-c26a71af95c3 (7d6fb4a2-b5cb-413e-8f35-c26a71af95c3): created successfully Sep 17 22:00:50 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-d4625b5b-374b-440b-af91-20e3c7829716 tempest-VolumesTransfersV355Test-1574476971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eff9e81d-d080-49eb-821b-ba306672f277) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:00:50 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-d4625b5b-374b-440b-af91-20e3c7829716 tempest-VolumesTransfersV355Test-1574476971 None] Flow 'volume_create_manager' (02eff204-0d4d-4bd3-a8b8-32fae622a7e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:00:50 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-d4625b5b-374b-440b-af91-20e3c7829716 tempest-VolumesTransfersV355Test-1574476971 None] Created volume successfully. Sep 17 22:00:51 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-f01f1dfb-7350-4550-9bbf-4233771fae4f tempest-VolumesActionsTest-1712154832 None] Acquiring lock "cinder-d401d967-5211-49a5-a099-e850935efbd3-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:00:51 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-f01f1dfb-7350-4550-9bbf-4233771fae4f tempest-VolumesActionsTest-1712154832 None] Lock "cinder-d401d967-5211-49a5-a099-e850935efbd3-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:00:51 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-f01f1dfb-7350-4550-9bbf-4233771fae4f tempest-VolumesActionsTest-1712154832 None] Acquiring lock "cinder-quobyte-d401d967-5211-49a5-a099-e850935efbd3" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:00:51 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-f01f1dfb-7350-4550-9bbf-4233771fae4f tempest-VolumesActionsTest-1712154832 None] Lock "cinder-quobyte-d401d967-5211-49a5-a099-e850935efbd3" acquired by "delete_volume" :: waited 0.021s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:00:51 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[6be823fb-aa75-4fa0-a30e-eae3a8876397]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:00:51 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-f01f1dfb-7350-4550-9bbf-4233771fae4f tempest-VolumesActionsTest-1712154832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-d401d967-5211-49a5-a099-e850935efbd3 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:00:51 devstack sudo[96777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-d401d967-5211-49a5-a099-e850935efbd3 Sep 17 22:00:51 devstack sudo[96777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:00:51 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-7661e8bb-424a-4a89-960f-f20047575fb9 tempest-VolumeRetypeWithoutMigrationTest-716898298 None] Acquiring lock "cinder-8d601cc3-c0a2-4444-93a4-32186f371d01-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:00:51 devstack sudo[96777]: pam_unix(sudo:session): session closed for user root Sep 17 22:00:51 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-f01f1dfb-7350-4550-9bbf-4233771fae4f tempest-VolumesActionsTest-1712154832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-d401d967-5211-49a5-a099-e850935efbd3" returned: 0 in 0.439s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:00:51 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-f01f1dfb-7350-4550-9bbf-4233771fae4f tempest-VolumesActionsTest-1712154832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-d401d967-5211-49a5-a099-e850935efbd3 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:00:51 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-7661e8bb-424a-4a89-960f-f20047575fb9 tempest-VolumeRetypeWithoutMigrationTest-716898298 None] Lock "cinder-8d601cc3-c0a2-4444-93a4-32186f371d01-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:00:51 devstack sudo[96782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-d401d967-5211-49a5-a099-e850935efbd3 Sep 17 22:00:51 devstack sudo[96782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:00:51 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-7661e8bb-424a-4a89-960f-f20047575fb9 tempest-VolumeRetypeWithoutMigrationTest-716898298 None] Acquiring lock "cinder-quobyte-8d601cc3-c0a2-4444-93a4-32186f371d01" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:00:51 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-7661e8bb-424a-4a89-960f-f20047575fb9 tempest-VolumeRetypeWithoutMigrationTest-716898298 None] Lock "cinder-quobyte-8d601cc3-c0a2-4444-93a4-32186f371d01" acquired by "delete_volume" :: waited 0.021s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:00:51 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[495be8fe-47f7-4a4a-8a38-672c19cdc674]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:00:51 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-7661e8bb-424a-4a89-960f-f20047575fb9 tempest-VolumeRetypeWithoutMigrationTest-716898298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8d601cc3-c0a2-4444-93a4-32186f371d01 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:00:52 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-482c48ce-4997-4a0d-b9be-a18db4a0edcc tempest-VolumesTransfersV355Test-239440039 None] Acquiring lock "cinder-7d6fb4a2-b5cb-413e-8f35-c26a71af95c3-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:00:52 devstack sudo[96782]: pam_unix(sudo:session): session closed for user root Sep 17 22:00:52 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-f01f1dfb-7350-4550-9bbf-4233771fae4f tempest-VolumesActionsTest-1712154832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-d401d967-5211-49a5-a099-e850935efbd3" returned: 0 in 0.352s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:00:52 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-482c48ce-4997-4a0d-b9be-a18db4a0edcc tempest-VolumesTransfersV355Test-239440039 None] Lock "cinder-7d6fb4a2-b5cb-413e-8f35-c26a71af95c3-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:00:52 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-f01f1dfb-7350-4550-9bbf-4233771fae4f tempest-VolumesActionsTest-1712154832 None] Lock "cinder-quobyte-d401d967-5211-49a5-a099-e850935efbd3" released by "delete_volume" :: held 0.859s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:00:52 devstack sudo[96785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8d601cc3-c0a2-4444-93a4-32186f371d01 Sep 17 22:00:52 devstack sudo[96785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:00:52 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-482c48ce-4997-4a0d-b9be-a18db4a0edcc tempest-VolumesTransfersV355Test-239440039 None] Acquiring lock "cinder-quobyte-7d6fb4a2-b5cb-413e-8f35-c26a71af95c3" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:00:52 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-482c48ce-4997-4a0d-b9be-a18db4a0edcc tempest-VolumesTransfersV355Test-239440039 None] Lock "cinder-quobyte-7d6fb4a2-b5cb-413e-8f35-c26a71af95c3" acquired by "delete_volume" :: waited 0.020s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:00:52 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[14692632-90a9-4d8d-8c0c-2ed5780ba9fc]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:00:52 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-482c48ce-4997-4a0d-b9be-a18db4a0edcc tempest-VolumesTransfersV355Test-239440039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7d6fb4a2-b5cb-413e-8f35-c26a71af95c3 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:00:52 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-f01f1dfb-7350-4550-9bbf-4233771fae4f tempest-VolumesActionsTest-1712154832 None] Created reservations ['9dd383b2-1c20-4acd-b27f-48ff51910654', 'f89ab894-3808-46d6-a605-25e03e0f7eef', 'ba5dab41-ff6b-4c43-9e2a-a40f79e83c8d', '10aeabbb-8a5d-489f-9647-f1e190bd6154'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:00:52 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-f01f1dfb-7350-4550-9bbf-4233771fae4f tempest-VolumesActionsTest-1712154832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:00:52 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-f01f1dfb-7350-4550-9bbf-4233771fae4f tempest-VolumesActionsTest-1712154832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:00:52 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-f01f1dfb-7350-4550-9bbf-4233771fae4f tempest-VolumesActionsTest-1712154832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:00:52 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-f01f1dfb-7350-4550-9bbf-4233771fae4f tempest-VolumesActionsTest-1712154832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:00:52 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-f01f1dfb-7350-4550-9bbf-4233771fae4f tempest-VolumesActionsTest-1712154832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:00:52 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-f01f1dfb-7350-4550-9bbf-4233771fae4f tempest-VolumesActionsTest-1712154832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:00:52 devstack sudo[96788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7d6fb4a2-b5cb-413e-8f35-c26a71af95c3 Sep 17 22:00:52 devstack sudo[96788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:00:52 devstack sudo[96789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:00:52 devstack sudo[96789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:00:52 devstack sudo[96785]: pam_unix(sudo:session): session closed for user root Sep 17 22:00:52 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-7661e8bb-424a-4a89-960f-f20047575fb9 tempest-VolumeRetypeWithoutMigrationTest-716898298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8d601cc3-c0a2-4444-93a4-32186f371d01" returned: 0 in 0.642s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:00:52 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-7661e8bb-424a-4a89-960f-f20047575fb9 tempest-VolumeRetypeWithoutMigrationTest-716898298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8d601cc3-c0a2-4444-93a4-32186f371d01 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:00:52 devstack sudo[96795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8d601cc3-c0a2-4444-93a4-32186f371d01 Sep 17 22:00:52 devstack sudo[96795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:00:52 devstack sudo[96789]: pam_unix(sudo:session): session closed for user root Sep 17 22:00:52 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-f01f1dfb-7350-4550-9bbf-4233771fae4f tempest-VolumesActionsTest-1712154832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.359s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:00:52 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-f01f1dfb-7350-4550-9bbf-4233771fae4f tempest-VolumesActionsTest-1712154832 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:00:52 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-f01f1dfb-7350-4550-9bbf-4233771fae4f tempest-VolumesActionsTest-1712154832 None] Deleted volume successfully. Sep 17 22:00:52 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-f01f1dfb-7350-4550-9bbf-4233771fae4f tempest-VolumesActionsTest-1712154832 None] Lock "cinder-d401d967-5211-49a5-a099-e850935efbd3-delete_volume" released by "delete_volume" :: held 1.585s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:00:52 devstack sudo[96788]: pam_unix(sudo:session): session closed for user root Sep 17 22:00:52 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-482c48ce-4997-4a0d-b9be-a18db4a0edcc tempest-VolumesTransfersV355Test-239440039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7d6fb4a2-b5cb-413e-8f35-c26a71af95c3" returned: 0 in 0.615s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:00:52 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-482c48ce-4997-4a0d-b9be-a18db4a0edcc tempest-VolumesTransfersV355Test-239440039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7d6fb4a2-b5cb-413e-8f35-c26a71af95c3 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:00:52 devstack sudo[96801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7d6fb4a2-b5cb-413e-8f35-c26a71af95c3 Sep 17 22:00:52 devstack sudo[96801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:00:53 devstack sudo[96795]: pam_unix(sudo:session): session closed for user root Sep 17 22:00:53 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-7661e8bb-424a-4a89-960f-f20047575fb9 tempest-VolumeRetypeWithoutMigrationTest-716898298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8d601cc3-c0a2-4444-93a4-32186f371d01" returned: 0 in 0.473s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:00:53 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-7661e8bb-424a-4a89-960f-f20047575fb9 tempest-VolumeRetypeWithoutMigrationTest-716898298 None] Lock "cinder-quobyte-8d601cc3-c0a2-4444-93a4-32186f371d01" released by "delete_volume" :: held 1.198s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:00:53 devstack cinder-volume[85458]: WARNING cinder.quota [None req-7661e8bb-424a-4a89-960f-f20047575fb9 tempest-VolumeRetypeWithoutMigrationTest-716898298 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 17 22:00:53 devstack cinder-volume[85458]: WARNING cinder.quota [None req-7661e8bb-424a-4a89-960f-f20047575fb9 tempest-VolumeRetypeWithoutMigrationTest-716898298 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 17 22:00:53 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-7661e8bb-424a-4a89-960f-f20047575fb9 tempest-VolumeRetypeWithoutMigrationTest-716898298 None] Created reservations ['ef4d0808-e14e-40f3-a4b2-081af32add38', '6e43ad24-3275-4366-8cb4-e45841572541', '98ce3689-f4c4-4910-8984-b102af098fe7', 'a2cc233f-65d6-4f54-a5da-e3e19ad26dcb'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:00:53 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea5ca072-9ace-4fde-9b5b-0f01f79298be tempest-VolumesActionsTest-1014407808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 22:00:53 devstack sudo[96801]: pam_unix(sudo:session): session closed for user root Sep 17 22:00:53 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-ea5ca072-9ace-4fde-9b5b-0f01f79298be tempest-VolumesActionsTest-1014407808 None] Flow 'volume_create_manager' (93f4c03e-9318-4c6f-8a7e-3ded820d01f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:00:53 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-ea5ca072-9ace-4fde-9b5b-0f01f79298be tempest-VolumesActionsTest-1014407808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc340e89-18fe-4b44-afcc-396170f497a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:00:53 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-482c48ce-4997-4a0d-b9be-a18db4a0edcc tempest-VolumesTransfersV355Test-239440039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7d6fb4a2-b5cb-413e-8f35-c26a71af95c3" returned: 0 in 0.401s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:00:53 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-ea5ca072-9ace-4fde-9b5b-0f01f79298be tempest-VolumesActionsTest-1014407808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc340e89-18fe-4b44-afcc-396170f497a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:00:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-430300097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d18e345-0d3c-4661-9b95-605c6d8e305c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='029b95d472924e47b850686b44c327c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:00:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:00:53Z,use_quota=True,user_id='7a4b6fdac92c499282a190a384e15972',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:00:53 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-ea5ca072-9ace-4fde-9b5b-0f01f79298be tempest-VolumesActionsTest-1014407808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eab8020a-0015-4957-878b-6ddf9ebec49f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:00:53 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-ea5ca072-9ace-4fde-9b5b-0f01f79298be tempest-VolumesActionsTest-1014407808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eab8020a-0015-4957-878b-6ddf9ebec49f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:00:53 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-ea5ca072-9ace-4fde-9b5b-0f01f79298be tempest-VolumesActionsTest-1014407808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb4b1ff0-f23c-4d43-8f45-0faac85991a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:00:53 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-ea5ca072-9ace-4fde-9b5b-0f01f79298be tempest-VolumesActionsTest-1014407808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb4b1ff0-f23c-4d43-8f45-0faac85991a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d18e345-0d3c-4661-9b95-605c6d8e305c', 'volume_name': 'volume-5d18e345-0d3c-4661-9b95-605c6d8e305c', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:00:53 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-ea5ca072-9ace-4fde-9b5b-0f01f79298be tempest-VolumesActionsTest-1014407808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60a70939-0000-485c-bf40-7617c57388f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:00:53 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-ea5ca072-9ace-4fde-9b5b-0f01f79298be tempest-VolumesActionsTest-1014407808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60a70939-0000-485c-bf40-7617c57388f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:00:53 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-ea5ca072-9ace-4fde-9b5b-0f01f79298be tempest-VolumesActionsTest-1014407808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c682925-ca69-4f56-8129-4d012d71daff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:00:53 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-ea5ca072-9ace-4fde-9b5b-0f01f79298be tempest-VolumesActionsTest-1014407808 None] Volume 5d18e345-0d3c-4661-9b95-605c6d8e305c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d18e345-0d3c-4661-9b95-605c6d8e305c', 'volume_size': 1} Sep 17 22:00:53 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-ea5ca072-9ace-4fde-9b5b-0f01f79298be tempest-VolumesActionsTest-1014407808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:00:53 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-ea5ca072-9ace-4fde-9b5b-0f01f79298be tempest-VolumesActionsTest-1014407808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:00:53 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-ea5ca072-9ace-4fde-9b5b-0f01f79298be tempest-VolumesActionsTest-1014407808 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:00:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-430300097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d18e345-0d3c-4661-9b95-605c6d8e305c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='029b95d472924e47b850686b44c327c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:00:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:00:53Z,use_quota=True,user_id='7a4b6fdac92c499282a190a384e15972',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 22:00:53 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-ea5ca072-9ace-4fde-9b5b-0f01f79298be tempest-VolumesActionsTest-1014407808 None] Creating volume 5d18e345-0d3c-4661-9b95-605c6d8e305c {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 22:00:53 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-ea5ca072-9ace-4fde-9b5b-0f01f79298be tempest-VolumesActionsTest-1014407808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:00:53 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-ea5ca072-9ace-4fde-9b5b-0f01f79298be tempest-VolumesActionsTest-1014407808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:00:53 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-ea5ca072-9ace-4fde-9b5b-0f01f79298be tempest-VolumesActionsTest-1014407808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:00:53 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-ea5ca072-9ace-4fde-9b5b-0f01f79298be tempest-VolumesActionsTest-1014407808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:00:53 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-ea5ca072-9ace-4fde-9b5b-0f01f79298be tempest-VolumesActionsTest-1014407808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:00:53 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-ea5ca072-9ace-4fde-9b5b-0f01f79298be tempest-VolumesActionsTest-1014407808 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 22:00:53 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-ea5ca072-9ace-4fde-9b5b-0f01f79298be tempest-VolumesActionsTest-1014407808 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 22:00:53 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-ea5ca072-9ace-4fde-9b5b-0f01f79298be tempest-VolumesActionsTest-1014407808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-5d18e345-0d3c-4661-9b95-605c6d8e305c 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:00:53 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-482c48ce-4997-4a0d-b9be-a18db4a0edcc tempest-VolumesTransfersV355Test-239440039 None] Lock "cinder-quobyte-7d6fb4a2-b5cb-413e-8f35-c26a71af95c3" released by "delete_volume" :: held 1.143s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:00:53 devstack sudo[96805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-5d18e345-0d3c-4661-9b95-605c6d8e305c 1073741824 Sep 17 22:00:53 devstack sudo[96805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:00:53 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-7661e8bb-424a-4a89-960f-f20047575fb9 tempest-VolumeRetypeWithoutMigrationTest-716898298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:00:53 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-7661e8bb-424a-4a89-960f-f20047575fb9 tempest-VolumeRetypeWithoutMigrationTest-716898298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:00:53 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-7661e8bb-424a-4a89-960f-f20047575fb9 tempest-VolumeRetypeWithoutMigrationTest-716898298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:00:53 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-7661e8bb-424a-4a89-960f-f20047575fb9 tempest-VolumeRetypeWithoutMigrationTest-716898298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:00:53 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-7661e8bb-424a-4a89-960f-f20047575fb9 tempest-VolumeRetypeWithoutMigrationTest-716898298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:00:53 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-7661e8bb-424a-4a89-960f-f20047575fb9 tempest-VolumeRetypeWithoutMigrationTest-716898298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:00:53 devstack sudo[96807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:00:53 devstack sudo[96807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:00:53 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-482c48ce-4997-4a0d-b9be-a18db4a0edcc tempest-VolumesTransfersV355Test-239440039 None] Created reservations ['713b6640-5764-4cca-aa83-c473ba5cd3bb', 'b77bd02f-20c2-46b1-bfdb-4e146acaaa13', '6c14c5fa-fd41-46d6-8183-4af93a4d27e6', '6414a5b1-c9c6-49dd-a1f9-ba22364c402c'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:00:53 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-482c48ce-4997-4a0d-b9be-a18db4a0edcc tempest-VolumesTransfersV355Test-239440039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:00:53 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-482c48ce-4997-4a0d-b9be-a18db4a0edcc tempest-VolumesTransfersV355Test-239440039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:00:53 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-482c48ce-4997-4a0d-b9be-a18db4a0edcc tempest-VolumesTransfersV355Test-239440039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:00:53 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-482c48ce-4997-4a0d-b9be-a18db4a0edcc tempest-VolumesTransfersV355Test-239440039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:00:53 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-482c48ce-4997-4a0d-b9be-a18db4a0edcc tempest-VolumesTransfersV355Test-239440039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:00:53 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-482c48ce-4997-4a0d-b9be-a18db4a0edcc tempest-VolumesTransfersV355Test-239440039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:00:53 devstack sudo[96809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:00:53 devstack sudo[96809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:00:53 devstack sudo[96807]: pam_unix(sudo:session): session closed for user root Sep 17 22:00:53 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-7661e8bb-424a-4a89-960f-f20047575fb9 tempest-VolumeRetypeWithoutMigrationTest-716898298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.337s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:00:53 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-7661e8bb-424a-4a89-960f-f20047575fb9 tempest-VolumeRetypeWithoutMigrationTest-716898298 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:00:53 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-7661e8bb-424a-4a89-960f-f20047575fb9 tempest-VolumeRetypeWithoutMigrationTest-716898298 None] Deleted volume successfully. Sep 17 22:00:53 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-7661e8bb-424a-4a89-960f-f20047575fb9 tempest-VolumeRetypeWithoutMigrationTest-716898298 None] Lock "cinder-8d601cc3-c0a2-4444-93a4-32186f371d01-delete_volume" released by "delete_volume" :: held 1.996s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:00:54 devstack sudo[96809]: pam_unix(sudo:session): session closed for user root Sep 17 22:00:54 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-482c48ce-4997-4a0d-b9be-a18db4a0edcc tempest-VolumesTransfersV355Test-239440039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.431s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:00:54 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-482c48ce-4997-4a0d-b9be-a18db4a0edcc tempest-VolumesTransfersV355Test-239440039 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:00:54 devstack sudo[96805]: pam_unix(sudo:session): session closed for user root Sep 17 22:00:54 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-ea5ca072-9ace-4fde-9b5b-0f01f79298be tempest-VolumesActionsTest-1014407808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-5d18e345-0d3c-4661-9b95-605c6d8e305c 1073741824" returned: 0 in 0.683s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:00:54 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-482c48ce-4997-4a0d-b9be-a18db4a0edcc tempest-VolumesTransfersV355Test-239440039 None] Deleted volume successfully. Sep 17 22:00:54 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-482c48ce-4997-4a0d-b9be-a18db4a0edcc tempest-VolumesTransfersV355Test-239440039 None] Lock "cinder-7d6fb4a2-b5cb-413e-8f35-c26a71af95c3-delete_volume" released by "delete_volume" :: held 1.952s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:00:54 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-ea5ca072-9ace-4fde-9b5b-0f01f79298be tempest-VolumesActionsTest-1014407808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-5d18e345-0d3c-4661-9b95-605c6d8e305c {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:00:54 devstack sudo[96817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-5d18e345-0d3c-4661-9b95-605c6d8e305c Sep 17 22:00:54 devstack sudo[96817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:00:54 devstack sudo[96817]: pam_unix(sudo:session): session closed for user root Sep 17 22:00:54 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-ea5ca072-9ace-4fde-9b5b-0f01f79298be tempest-VolumesActionsTest-1014407808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-5d18e345-0d3c-4661-9b95-605c6d8e305c" returned: 0 in 0.312s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:00:54 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-ea5ca072-9ace-4fde-9b5b-0f01f79298be tempest-VolumesActionsTest-1014407808 None] <== create_volume: return (1064ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 22:00:54 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-ea5ca072-9ace-4fde-9b5b-0f01f79298be tempest-VolumesActionsTest-1014407808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.068s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:00:54 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-ea5ca072-9ace-4fde-9b5b-0f01f79298be tempest-VolumesActionsTest-1014407808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c682925-ca69-4f56-8129-4d012d71daff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d18e345-0d3c-4661-9b95-605c6d8e305c', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:00:54 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-ea5ca072-9ace-4fde-9b5b-0f01f79298be tempest-VolumesActionsTest-1014407808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c896b8d7-720d-42d2-b3ad-13a5658aa0e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:00:54 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-ea5ca072-9ace-4fde-9b5b-0f01f79298be tempest-VolumesActionsTest-1014407808 None] Volume volume-5d18e345-0d3c-4661-9b95-605c6d8e305c (5d18e345-0d3c-4661-9b95-605c6d8e305c): created successfully Sep 17 22:00:54 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-ea5ca072-9ace-4fde-9b5b-0f01f79298be tempest-VolumesActionsTest-1014407808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c896b8d7-720d-42d2-b3ad-13a5658aa0e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:00:54 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-ea5ca072-9ace-4fde-9b5b-0f01f79298be tempest-VolumesActionsTest-1014407808 None] Flow 'volume_create_manager' (93f4c03e-9318-4c6f-8a7e-3ded820d01f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:00:54 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-ea5ca072-9ace-4fde-9b5b-0f01f79298be tempest-VolumesActionsTest-1014407808 None] Created volume successfully. Sep 17 22:00:56 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-a38ce94f-271b-4d75-af80-5f9786d6b65b tempest-VolumesActionsTest-1014407808 None] Acquiring lock "cinder-5d18e345-0d3c-4661-9b95-605c6d8e305c-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:00:56 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-a38ce94f-271b-4d75-af80-5f9786d6b65b tempest-VolumesActionsTest-1014407808 None] Lock "cinder-5d18e345-0d3c-4661-9b95-605c6d8e305c-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:00:56 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-a38ce94f-271b-4d75-af80-5f9786d6b65b tempest-VolumesActionsTest-1014407808 None] Acquiring lock "cinder-quobyte-5d18e345-0d3c-4661-9b95-605c6d8e305c" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:00:56 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-a38ce94f-271b-4d75-af80-5f9786d6b65b tempest-VolumesActionsTest-1014407808 None] Lock "cinder-quobyte-5d18e345-0d3c-4661-9b95-605c6d8e305c" acquired by "delete_volume" :: waited 0.019s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:00:56 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[788d8da4-191f-426c-8ee2-bf86bd63c1af]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:00:56 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a38ce94f-271b-4d75-af80-5f9786d6b65b tempest-VolumesActionsTest-1014407808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-5d18e345-0d3c-4661-9b95-605c6d8e305c {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:00:56 devstack sudo[96820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-5d18e345-0d3c-4661-9b95-605c6d8e305c Sep 17 22:00:56 devstack sudo[96820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:00:56 devstack sudo[96820]: pam_unix(sudo:session): session closed for user root Sep 17 22:00:56 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a38ce94f-271b-4d75-af80-5f9786d6b65b tempest-VolumesActionsTest-1014407808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-5d18e345-0d3c-4661-9b95-605c6d8e305c" returned: 0 in 0.485s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:00:56 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a38ce94f-271b-4d75-af80-5f9786d6b65b tempest-VolumesActionsTest-1014407808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-5d18e345-0d3c-4661-9b95-605c6d8e305c {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:00:56 devstack sudo[96825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-5d18e345-0d3c-4661-9b95-605c6d8e305c Sep 17 22:00:56 devstack sudo[96825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:00:57 devstack sudo[96825]: pam_unix(sudo:session): session closed for user root Sep 17 22:00:57 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a38ce94f-271b-4d75-af80-5f9786d6b65b tempest-VolumesActionsTest-1014407808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-5d18e345-0d3c-4661-9b95-605c6d8e305c" returned: 0 in 0.315s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:00:57 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-a38ce94f-271b-4d75-af80-5f9786d6b65b tempest-VolumesActionsTest-1014407808 None] Lock "cinder-quobyte-5d18e345-0d3c-4661-9b95-605c6d8e305c" released by "delete_volume" :: held 0.870s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:00:57 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-a38ce94f-271b-4d75-af80-5f9786d6b65b tempest-VolumesActionsTest-1014407808 None] Created reservations ['96629b14-4e99-4f74-9bfb-fcfb87a60e70', 'd6b56077-b0cb-4b42-83ed-445fea150464', '15c5ae2c-cea6-4102-bad8-4e3d359d7daa', '1ee96cd0-cecf-45fa-80c5-076bcf203e6a'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:00:57 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-a38ce94f-271b-4d75-af80-5f9786d6b65b tempest-VolumesActionsTest-1014407808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:00:57 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-a38ce94f-271b-4d75-af80-5f9786d6b65b tempest-VolumesActionsTest-1014407808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:00:57 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-a38ce94f-271b-4d75-af80-5f9786d6b65b tempest-VolumesActionsTest-1014407808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:00:57 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-a38ce94f-271b-4d75-af80-5f9786d6b65b tempest-VolumesActionsTest-1014407808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:00:57 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-a38ce94f-271b-4d75-af80-5f9786d6b65b tempest-VolumesActionsTest-1014407808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:00:57 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a38ce94f-271b-4d75-af80-5f9786d6b65b tempest-VolumesActionsTest-1014407808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:00:57 devstack sudo[96828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:00:57 devstack sudo[96828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:00:57 devstack sudo[96828]: pam_unix(sudo:session): session closed for user root Sep 17 22:00:57 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a38ce94f-271b-4d75-af80-5f9786d6b65b tempest-VolumesActionsTest-1014407808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.257s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:00:57 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-a38ce94f-271b-4d75-af80-5f9786d6b65b tempest-VolumesActionsTest-1014407808 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:00:57 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-a38ce94f-271b-4d75-af80-5f9786d6b65b tempest-VolumesActionsTest-1014407808 None] Deleted volume successfully. Sep 17 22:00:57 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-a38ce94f-271b-4d75-af80-5f9786d6b65b tempest-VolumesActionsTest-1014407808 None] Lock "cinder-5d18e345-0d3c-4661-9b95-605c6d8e305c-delete_volume" released by "delete_volume" :: held 1.375s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:01:05 devstack cinder-volume[85458]: DEBUG dbcounter [-] [85458] Writing DB stats cinder:SELECT=120,cinder:UPDATE=136,cinder:INSERT=30,cinder:DELETE=12 {{(pid=85458) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 22:01:05 devstack cinder-volume[85458]: DEBUG dbcounter [-] [85458] Writing DB stats cinder:SELECT=97,cinder:UPDATE=145,cinder:INSERT=33,cinder:DELETE=11 {{(pid=85458) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 22:01:05 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-45f17729-b04b-4b63-a696-a356dc260676 tempest-VolumesCloneTest-301007338 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 22:01:05 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-45f17729-b04b-4b63-a696-a356dc260676 tempest-VolumesCloneTest-301007338 None] Flow 'volume_create_manager' (5158b939-4b6f-4a81-9560-2003d283b984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:01:05 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-45f17729-b04b-4b63-a696-a356dc260676 tempest-VolumesCloneTest-301007338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8984c824-10ac-4f70-b33a-4bec638667ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:01:05 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-45f17729-b04b-4b63-a696-a356dc260676 tempest-VolumesCloneTest-301007338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8984c824-10ac-4f70-b33a-4bec638667ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:01:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-3047982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed59c75a-759a-4472-9263-dca50d71a1e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bb909c920214aec8d317bacd5329180',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:01:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:01:05Z,use_quota=True,user_id='f2cb77493ef74afcba885aa2a6b74127',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:01:05 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-45f17729-b04b-4b63-a696-a356dc260676 tempest-VolumesCloneTest-301007338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab644a25-61b4-4000-8639-531008bad58e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:01:05 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-45f17729-b04b-4b63-a696-a356dc260676 tempest-VolumesCloneTest-301007338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab644a25-61b4-4000-8639-531008bad58e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:01:05 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-45f17729-b04b-4b63-a696-a356dc260676 tempest-VolumesCloneTest-301007338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (280fd908-c9e6-4018-a266-1952471a635c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:01:05 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-45f17729-b04b-4b63-a696-a356dc260676 tempest-VolumesCloneTest-301007338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (280fd908-c9e6-4018-a266-1952471a635c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed59c75a-759a-4472-9263-dca50d71a1e2', 'volume_name': 'volume-ed59c75a-759a-4472-9263-dca50d71a1e2', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:01:05 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-45f17729-b04b-4b63-a696-a356dc260676 tempest-VolumesCloneTest-301007338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8676de29-65ae-468a-8041-57b1641cb885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:01:05 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-45f17729-b04b-4b63-a696-a356dc260676 tempest-VolumesCloneTest-301007338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8676de29-65ae-468a-8041-57b1641cb885) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:01:05 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-45f17729-b04b-4b63-a696-a356dc260676 tempest-VolumesCloneTest-301007338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8826f169-f807-4bb8-a1bd-2c9e8b4f458d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:01:05 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-45f17729-b04b-4b63-a696-a356dc260676 tempest-VolumesCloneTest-301007338 None] Volume ed59c75a-759a-4472-9263-dca50d71a1e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed59c75a-759a-4472-9263-dca50d71a1e2', 'volume_size': 1} Sep 17 22:01:05 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-45f17729-b04b-4b63-a696-a356dc260676 tempest-VolumesCloneTest-301007338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:01:05 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-45f17729-b04b-4b63-a696-a356dc260676 tempest-VolumesCloneTest-301007338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:01:05 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-45f17729-b04b-4b63-a696-a356dc260676 tempest-VolumesCloneTest-301007338 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:01:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-3047982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed59c75a-759a-4472-9263-dca50d71a1e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bb909c920214aec8d317bacd5329180',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:01:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:01:05Z,use_quota=True,user_id='f2cb77493ef74afcba885aa2a6b74127',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 22:01:05 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-45f17729-b04b-4b63-a696-a356dc260676 tempest-VolumesCloneTest-301007338 None] Creating volume ed59c75a-759a-4472-9263-dca50d71a1e2 {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 22:01:05 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-45f17729-b04b-4b63-a696-a356dc260676 tempest-VolumesCloneTest-301007338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:01:05 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-45f17729-b04b-4b63-a696-a356dc260676 tempest-VolumesCloneTest-301007338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:01:05 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-45f17729-b04b-4b63-a696-a356dc260676 tempest-VolumesCloneTest-301007338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:01:05 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-45f17729-b04b-4b63-a696-a356dc260676 tempest-VolumesCloneTest-301007338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:01:05 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-45f17729-b04b-4b63-a696-a356dc260676 tempest-VolumesCloneTest-301007338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:01:05 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-45f17729-b04b-4b63-a696-a356dc260676 tempest-VolumesCloneTest-301007338 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 22:01:05 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-45f17729-b04b-4b63-a696-a356dc260676 tempest-VolumesCloneTest-301007338 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 22:01:05 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-45f17729-b04b-4b63-a696-a356dc260676 tempest-VolumesCloneTest-301007338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ed59c75a-759a-4472-9263-dca50d71a1e2 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:01:05 devstack sudo[96853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ed59c75a-759a-4472-9263-dca50d71a1e2 1073741824 Sep 17 22:01:05 devstack sudo[96853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:01:05 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7f5dd4d-c3a7-4737-b74b-bad911f3784e tempest-VolumesServicesTestJSON-403469777 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 22:01:05 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e7f5dd4d-c3a7-4737-b74b-bad911f3784e tempest-VolumesServicesTestJSON-403469777 None] Flow 'volume_create_manager' (80e94a18-ab49-4cf0-a095-b573cae39532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:01:05 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e7f5dd4d-c3a7-4737-b74b-bad911f3784e tempest-VolumesServicesTestJSON-403469777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2420d112-2e76-464d-9b74-bba29e2d5bc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:01:05 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e7f5dd4d-c3a7-4737-b74b-bad911f3784e tempest-VolumesServicesTestJSON-403469777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2420d112-2e76-464d-9b74-bba29e2d5bc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:01:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1073609785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a37952ac-0758-4d9d-aa23-90f74668766d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb227b81d3e743c3ac4388b89b6dc7f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:01:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:01:06Z,use_quota=True,user_id='8b601de8ebbc4a36a77e7d6e68514306',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:01:05 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e7f5dd4d-c3a7-4737-b74b-bad911f3784e tempest-VolumesServicesTestJSON-403469777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af16d6c3-ee09-46ea-8c33-3cad3bdc3907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:01:05 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e7f5dd4d-c3a7-4737-b74b-bad911f3784e tempest-VolumesServicesTestJSON-403469777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af16d6c3-ee09-46ea-8c33-3cad3bdc3907) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:01:05 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e7f5dd4d-c3a7-4737-b74b-bad911f3784e tempest-VolumesServicesTestJSON-403469777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ec3e41e-7673-491a-b573-10971bcdc442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:01:05 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e7f5dd4d-c3a7-4737-b74b-bad911f3784e tempest-VolumesServicesTestJSON-403469777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ec3e41e-7673-491a-b573-10971bcdc442) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a37952ac-0758-4d9d-aa23-90f74668766d', 'volume_name': 'volume-a37952ac-0758-4d9d-aa23-90f74668766d', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:01:05 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e7f5dd4d-c3a7-4737-b74b-bad911f3784e tempest-VolumesServicesTestJSON-403469777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6195abe2-46a3-4ff0-bcbc-07920958bccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:01:05 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e7f5dd4d-c3a7-4737-b74b-bad911f3784e tempest-VolumesServicesTestJSON-403469777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6195abe2-46a3-4ff0-bcbc-07920958bccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:01:05 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e7f5dd4d-c3a7-4737-b74b-bad911f3784e tempest-VolumesServicesTestJSON-403469777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (432b60e6-27a7-42c5-9b14-5284a6787bd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:01:05 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-e7f5dd4d-c3a7-4737-b74b-bad911f3784e tempest-VolumesServicesTestJSON-403469777 None] Volume a37952ac-0758-4d9d-aa23-90f74668766d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a37952ac-0758-4d9d-aa23-90f74668766d', 'volume_size': 1} Sep 17 22:01:05 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e7f5dd4d-c3a7-4737-b74b-bad911f3784e tempest-VolumesServicesTestJSON-403469777 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:01:05 devstack sudo[96853]: pam_unix(sudo:session): session closed for user root Sep 17 22:01:05 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-45f17729-b04b-4b63-a696-a356dc260676 tempest-VolumesCloneTest-301007338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ed59c75a-759a-4472-9263-dca50d71a1e2 1073741824" returned: 0 in 0.603s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:01:05 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-45f17729-b04b-4b63-a696-a356dc260676 tempest-VolumesCloneTest-301007338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ed59c75a-759a-4472-9263-dca50d71a1e2 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:01:05 devstack sudo[96859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ed59c75a-759a-4472-9263-dca50d71a1e2 Sep 17 22:01:05 devstack sudo[96859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:01:06 devstack sudo[96859]: pam_unix(sudo:session): session closed for user root Sep 17 22:01:06 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-45f17729-b04b-4b63-a696-a356dc260676 tempest-VolumesCloneTest-301007338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ed59c75a-759a-4472-9263-dca50d71a1e2" returned: 0 in 0.343s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:01:06 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-45f17729-b04b-4b63-a696-a356dc260676 tempest-VolumesCloneTest-301007338 None] <== create_volume: return (1025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 22:01:06 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-45f17729-b04b-4b63-a696-a356dc260676 tempest-VolumesCloneTest-301007338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.029s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:01:06 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e7f5dd4d-c3a7-4737-b74b-bad911f3784e tempest-VolumesServicesTestJSON-403469777 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.591s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:01:06 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-e7f5dd4d-c3a7-4737-b74b-bad911f3784e tempest-VolumesServicesTestJSON-403469777 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:01:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1073609785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a37952ac-0758-4d9d-aa23-90f74668766d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb227b81d3e743c3ac4388b89b6dc7f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:01:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:01:06Z,use_quota=True,user_id='8b601de8ebbc4a36a77e7d6e68514306',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 22:01:06 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-e7f5dd4d-c3a7-4737-b74b-bad911f3784e tempest-VolumesServicesTestJSON-403469777 None] Creating volume a37952ac-0758-4d9d-aa23-90f74668766d {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 22:01:06 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e7f5dd4d-c3a7-4737-b74b-bad911f3784e tempest-VolumesServicesTestJSON-403469777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:01:06 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e7f5dd4d-c3a7-4737-b74b-bad911f3784e tempest-VolumesServicesTestJSON-403469777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:01:06 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-e7f5dd4d-c3a7-4737-b74b-bad911f3784e tempest-VolumesServicesTestJSON-403469777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:01:06 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-e7f5dd4d-c3a7-4737-b74b-bad911f3784e tempest-VolumesServicesTestJSON-403469777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:01:06 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e7f5dd4d-c3a7-4737-b74b-bad911f3784e tempest-VolumesServicesTestJSON-403469777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:01:06 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-e7f5dd4d-c3a7-4737-b74b-bad911f3784e tempest-VolumesServicesTestJSON-403469777 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 22:01:06 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-e7f5dd4d-c3a7-4737-b74b-bad911f3784e tempest-VolumesServicesTestJSON-403469777 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 22:01:06 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e7f5dd4d-c3a7-4737-b74b-bad911f3784e tempest-VolumesServicesTestJSON-403469777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a37952ac-0758-4d9d-aa23-90f74668766d 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:01:06 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-45f17729-b04b-4b63-a696-a356dc260676 tempest-VolumesCloneTest-301007338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8826f169-f807-4bb8-a1bd-2c9e8b4f458d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed59c75a-759a-4472-9263-dca50d71a1e2', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:01:06 devstack sudo[96863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a37952ac-0758-4d9d-aa23-90f74668766d 1073741824 Sep 17 22:01:06 devstack sudo[96863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:01:06 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-45f17729-b04b-4b63-a696-a356dc260676 tempest-VolumesCloneTest-301007338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af857100-7cab-4a77-8670-220636b8484d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:01:06 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-45f17729-b04b-4b63-a696-a356dc260676 tempest-VolumesCloneTest-301007338 None] Volume volume-ed59c75a-759a-4472-9263-dca50d71a1e2 (ed59c75a-759a-4472-9263-dca50d71a1e2): created successfully Sep 17 22:01:06 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-45f17729-b04b-4b63-a696-a356dc260676 tempest-VolumesCloneTest-301007338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af857100-7cab-4a77-8670-220636b8484d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:01:06 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-45f17729-b04b-4b63-a696-a356dc260676 tempest-VolumesCloneTest-301007338 None] Flow 'volume_create_manager' (5158b939-4b6f-4a81-9560-2003d283b984) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:01:06 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-45f17729-b04b-4b63-a696-a356dc260676 tempest-VolumesCloneTest-301007338 None] Created volume successfully. Sep 17 22:01:06 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e7f5dd4d-c3a7-4737-b74b-bad911f3784e tempest-VolumesServicesTestJSON-403469777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a37952ac-0758-4d9d-aa23-90f74668766d 1073741824" returned: 0 in 0.559s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:01:06 devstack sudo[96863]: pam_unix(sudo:session): session closed for user root Sep 17 22:01:06 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e7f5dd4d-c3a7-4737-b74b-bad911f3784e tempest-VolumesServicesTestJSON-403469777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a37952ac-0758-4d9d-aa23-90f74668766d {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:01:06 devstack sudo[96873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a37952ac-0758-4d9d-aa23-90f74668766d Sep 17 22:01:06 devstack sudo[96873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:01:07 devstack sudo[96873]: pam_unix(sudo:session): session closed for user root Sep 17 22:01:07 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e7f5dd4d-c3a7-4737-b74b-bad911f3784e tempest-VolumesServicesTestJSON-403469777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a37952ac-0758-4d9d-aa23-90f74668766d" returned: 0 in 0.540s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:01:07 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-e7f5dd4d-c3a7-4737-b74b-bad911f3784e tempest-VolumesServicesTestJSON-403469777 None] <== create_volume: return (1164ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 22:01:07 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e7f5dd4d-c3a7-4737-b74b-bad911f3784e tempest-VolumesServicesTestJSON-403469777 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.167s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:01:07 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e7f5dd4d-c3a7-4737-b74b-bad911f3784e tempest-VolumesServicesTestJSON-403469777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (432b60e6-27a7-42c5-9b14-5284a6787bd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a37952ac-0758-4d9d-aa23-90f74668766d', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:01:07 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e7f5dd4d-c3a7-4737-b74b-bad911f3784e tempest-VolumesServicesTestJSON-403469777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98b3df4f-0758-4d83-8dca-419f25a9b5c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:01:07 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-e7f5dd4d-c3a7-4737-b74b-bad911f3784e tempest-VolumesServicesTestJSON-403469777 None] Volume volume-a37952ac-0758-4d9d-aa23-90f74668766d (a37952ac-0758-4d9d-aa23-90f74668766d): created successfully Sep 17 22:01:07 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e7f5dd4d-c3a7-4737-b74b-bad911f3784e tempest-VolumesServicesTestJSON-403469777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98b3df4f-0758-4d83-8dca-419f25a9b5c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:01:07 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e7f5dd4d-c3a7-4737-b74b-bad911f3784e tempest-VolumesServicesTestJSON-403469777 None] Flow 'volume_create_manager' (80e94a18-ab49-4cf0-a095-b573cae39532) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:01:07 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-e7f5dd4d-c3a7-4737-b74b-bad911f3784e tempest-VolumesServicesTestJSON-403469777 None] Created volume successfully. Sep 17 22:01:08 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-625ad294-0580-4d38-8331-52a5f927c36c tempest-VolumesServicesTestJSON-403469777 None] Acquiring lock "cinder-a37952ac-0758-4d9d-aa23-90f74668766d-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:01:08 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-625ad294-0580-4d38-8331-52a5f927c36c tempest-VolumesServicesTestJSON-403469777 None] Lock "cinder-a37952ac-0758-4d9d-aa23-90f74668766d-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:01:08 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-625ad294-0580-4d38-8331-52a5f927c36c tempest-VolumesServicesTestJSON-403469777 None] Acquiring lock "cinder-quobyte-a37952ac-0758-4d9d-aa23-90f74668766d" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:01:08 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-625ad294-0580-4d38-8331-52a5f927c36c tempest-VolumesServicesTestJSON-403469777 None] Lock "cinder-quobyte-a37952ac-0758-4d9d-aa23-90f74668766d" acquired by "delete_volume" :: waited 0.027s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:01:08 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1de5f8f-9cd4-42e2-a31c-48b9d2fe5296]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:01:08 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-625ad294-0580-4d38-8331-52a5f927c36c tempest-VolumesServicesTestJSON-403469777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a37952ac-0758-4d9d-aa23-90f74668766d {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:01:08 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8f3eaf7-760f-4369-98d9-cd3c530efa75 tempest-VolumesCloneTest-301007338 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 22:01:08 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-a8f3eaf7-760f-4369-98d9-cd3c530efa75 tempest-VolumesCloneTest-301007338 None] Flow 'volume_create_manager' (f8a91a20-e283-487d-b3da-cab73c034ccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:01:08 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-a8f3eaf7-760f-4369-98d9-cd3c530efa75 tempest-VolumesCloneTest-301007338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3ea2e4f-5aa3-4035-8088-d7296bbf1bb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:01:08 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-a8f3eaf7-760f-4369-98d9-cd3c530efa75 tempest-VolumesCloneTest-301007338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3ea2e4f-5aa3-4035-8088-d7296bbf1bb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:01:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1074666128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66b98721-9dc0-4fdf-aa83-739f28847ab5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bb909c920214aec8d317bacd5329180',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:01:08Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=ed59c75a-759a-4472-9263-dca50d71a1e2,status='creating',terminated_at=None,updated_at=2026-09-17T20:01:08Z,use_quota=True,user_id='f2cb77493ef74afcba885aa2a6b74127',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:01:08 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-a8f3eaf7-760f-4369-98d9-cd3c530efa75 tempest-VolumesCloneTest-301007338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc23e19d-6c87-4666-9fe7-179e7f4a1d0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:01:08 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-a8f3eaf7-760f-4369-98d9-cd3c530efa75 tempest-VolumesCloneTest-301007338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc23e19d-6c87-4666-9fe7-179e7f4a1d0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:01:08 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-a8f3eaf7-760f-4369-98d9-cd3c530efa75 tempest-VolumesCloneTest-301007338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13924693-4792-4583-8632-fbc33d9e59ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:01:08 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-a8f3eaf7-760f-4369-98d9-cd3c530efa75 tempest-VolumesCloneTest-301007338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13924693-4792-4583-8632-fbc33d9e59ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '66b98721-9dc0-4fdf-aa83-739f28847ab5', 'volume_name': 'volume-66b98721-9dc0-4fdf-aa83-739f28847ab5', 'volume_size': 2, 'source_volid': 'ed59c75a-759a-4472-9263-dca50d71a1e2', 'source_volstatus': 'available'}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:01:08 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-a8f3eaf7-760f-4369-98d9-cd3c530efa75 tempest-VolumesCloneTest-301007338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c692dda2-c636-4812-9561-6035447fbe0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:01:08 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-a8f3eaf7-760f-4369-98d9-cd3c530efa75 tempest-VolumesCloneTest-301007338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c692dda2-c636-4812-9561-6035447fbe0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:01:08 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-a8f3eaf7-760f-4369-98d9-cd3c530efa75 tempest-VolumesCloneTest-301007338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d198055-a77f-4022-842d-8de106fd6a11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:01:08 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-a8f3eaf7-760f-4369-98d9-cd3c530efa75 tempest-VolumesCloneTest-301007338 None] Volume 66b98721-9dc0-4fdf-aa83-739f28847ab5: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-66b98721-9dc0-4fdf-aa83-739f28847ab5', 'volume_size': 2, 'source_volid': 'ed59c75a-759a-4472-9263-dca50d71a1e2', 'source_volstatus': 'available'} Sep 17 22:01:08 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-a8f3eaf7-760f-4369-98d9-cd3c530efa75 tempest-VolumesCloneTest-301007338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:01:08 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-a8f3eaf7-760f-4369-98d9-cd3c530efa75 tempest-VolumesCloneTest-301007338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:01:08 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-a8f3eaf7-760f-4369-98d9-cd3c530efa75 tempest-VolumesCloneTest-301007338 None] Cloning volume ed59c75a-759a-4472-9263-dca50d71a1e2 to volume 66b98721-9dc0-4fdf-aa83-739f28847ab5 Sep 17 22:01:08 devstack sudo[96937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a37952ac-0758-4d9d-aa23-90f74668766d Sep 17 22:01:08 devstack sudo[96937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:01:08 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-a8f3eaf7-760f-4369-98d9-cd3c530efa75 tempest-VolumesCloneTest-301007338 None] Creating offline snapshot 3a633637-9531-4c37-bc72-5044b2924112 of volume ed59c75a-759a-4472-9263-dca50d71a1e2 {{(pid=85458) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 22:01:08 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[2db00327-20c4-46b8-9847-b98ed3eb0004]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:01:08 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a8f3eaf7-760f-4369-98d9-cd3c530efa75 tempest-VolumesCloneTest-301007338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ed59c75a-759a-4472-9263-dca50d71a1e2 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:01:08 devstack sudo[96942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ed59c75a-759a-4472-9263-dca50d71a1e2 Sep 17 22:01:08 devstack sudo[96942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:01:09 devstack sudo[96937]: pam_unix(sudo:session): session closed for user root Sep 17 22:01:09 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-625ad294-0580-4d38-8331-52a5f927c36c tempest-VolumesServicesTestJSON-403469777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a37952ac-0758-4d9d-aa23-90f74668766d" returned: 0 in 0.899s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:01:09 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-625ad294-0580-4d38-8331-52a5f927c36c tempest-VolumesServicesTestJSON-403469777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a37952ac-0758-4d9d-aa23-90f74668766d {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:01:09 devstack sudo[96953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a37952ac-0758-4d9d-aa23-90f74668766d Sep 17 22:01:09 devstack sudo[96953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:01:09 devstack sudo[96942]: pam_unix(sudo:session): session closed for user root Sep 17 22:01:09 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a8f3eaf7-760f-4369-98d9-cd3c530efa75 tempest-VolumesCloneTest-301007338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ed59c75a-759a-4472-9263-dca50d71a1e2" returned: 0 in 0.704s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:01:09 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a8f3eaf7-760f-4369-98d9-cd3c530efa75 tempest-VolumesCloneTest-301007338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ed59c75a-759a-4472-9263-dca50d71a1e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ed59c75a-759a-4472-9263-dca50d71a1e2.3a633637-9531-4c37-bc72-5044b2924112 1G {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:01:09 devstack sudo[96955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ed59c75a-759a-4472-9263-dca50d71a1e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ed59c75a-759a-4472-9263-dca50d71a1e2.3a633637-9531-4c37-bc72-5044b2924112 1G Sep 17 22:01:09 devstack sudo[96955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:01:09 devstack sudo[96953]: pam_unix(sudo:session): session closed for user root Sep 17 22:01:09 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-625ad294-0580-4d38-8331-52a5f927c36c tempest-VolumesServicesTestJSON-403469777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a37952ac-0758-4d9d-aa23-90f74668766d" returned: 0 in 0.377s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:01:09 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-625ad294-0580-4d38-8331-52a5f927c36c tempest-VolumesServicesTestJSON-403469777 None] Lock "cinder-quobyte-a37952ac-0758-4d9d-aa23-90f74668766d" released by "delete_volume" :: held 1.358s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:01:09 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-625ad294-0580-4d38-8331-52a5f927c36c tempest-VolumesServicesTestJSON-403469777 None] Created reservations ['5919b5f9-92b9-4bd9-91aa-a93f2745aa28', '11ab31cb-c711-4022-9032-fe8e788af5de', '3f43751d-e8e6-49c4-9b43-3968911e6f45', 'c187c797-4eb6-47c4-8cd8-7e85c759fd14'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:01:09 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-625ad294-0580-4d38-8331-52a5f927c36c tempest-VolumesServicesTestJSON-403469777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:01:09 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-625ad294-0580-4d38-8331-52a5f927c36c tempest-VolumesServicesTestJSON-403469777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:01:09 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-625ad294-0580-4d38-8331-52a5f927c36c tempest-VolumesServicesTestJSON-403469777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:01:09 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-625ad294-0580-4d38-8331-52a5f927c36c tempest-VolumesServicesTestJSON-403469777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:01:09 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-625ad294-0580-4d38-8331-52a5f927c36c tempest-VolumesServicesTestJSON-403469777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:01:09 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-625ad294-0580-4d38-8331-52a5f927c36c tempest-VolumesServicesTestJSON-403469777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:01:09 devstack sudo[96962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:01:09 devstack sudo[96962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:01:10 devstack sudo[96955]: pam_unix(sudo:session): session closed for user root Sep 17 22:01:10 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a8f3eaf7-760f-4369-98d9-cd3c530efa75 tempest-VolumesCloneTest-301007338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ed59c75a-759a-4472-9263-dca50d71a1e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ed59c75a-759a-4472-9263-dca50d71a1e2.3a633637-9531-4c37-bc72-5044b2924112 1G" returned: 0 in 0.613s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:01:10 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a8f3eaf7-760f-4369-98d9-cd3c530efa75 tempest-VolumesCloneTest-301007338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed59c75a-759a-4472-9263-dca50d71a1e2 -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ed59c75a-759a-4472-9263-dca50d71a1e2.3a633637-9531-4c37-bc72-5044b2924112 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:01:10 devstack sudo[96964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed59c75a-759a-4472-9263-dca50d71a1e2 -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ed59c75a-759a-4472-9263-dca50d71a1e2.3a633637-9531-4c37-bc72-5044b2924112 Sep 17 22:01:10 devstack sudo[96964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:01:10 devstack sudo[96962]: pam_unix(sudo:session): session closed for user root Sep 17 22:01:10 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-625ad294-0580-4d38-8331-52a5f927c36c tempest-VolumesServicesTestJSON-403469777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.459s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:01:10 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-625ad294-0580-4d38-8331-52a5f927c36c tempest-VolumesServicesTestJSON-403469777 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:01:10 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-625ad294-0580-4d38-8331-52a5f927c36c tempest-VolumesServicesTestJSON-403469777 None] Deleted volume successfully. Sep 17 22:01:10 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-625ad294-0580-4d38-8331-52a5f927c36c tempest-VolumesServicesTestJSON-403469777 None] Lock "cinder-a37952ac-0758-4d9d-aa23-90f74668766d-delete_volume" released by "delete_volume" :: held 2.249s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:01:10 devstack sudo[96964]: pam_unix(sudo:session): session closed for user root Sep 17 22:01:10 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a8f3eaf7-760f-4369-98d9-cd3c530efa75 tempest-VolumesCloneTest-301007338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed59c75a-759a-4472-9263-dca50d71a1e2 -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ed59c75a-759a-4472-9263-dca50d71a1e2.3a633637-9531-4c37-bc72-5044b2924112" returned: 0 in 0.718s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:01:10 devstack cinder-volume[85458]: WARNING cinder.volume.drivers.remotefs [None req-a8f3eaf7-760f-4369-98d9-cd3c530efa75 tempest-VolumesCloneTest-301007338 None] /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ed59c75a-759a-4472-9263-dca50d71a1e2.3a633637-9531-4c37-bc72-5044b2924112 is being set with open permissions: ugo+rw Sep 17 22:01:10 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a8f3eaf7-760f-4369-98d9-cd3c530efa75 tempest-VolumesCloneTest-301007338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ed59c75a-759a-4472-9263-dca50d71a1e2.3a633637-9531-4c37-bc72-5044b2924112 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:01:10 devstack sudo[96971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ed59c75a-759a-4472-9263-dca50d71a1e2.3a633637-9531-4c37-bc72-5044b2924112 Sep 17 22:01:10 devstack sudo[96971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:01:11 devstack sudo[96971]: pam_unix(sudo:session): session closed for user root Sep 17 22:01:11 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a8f3eaf7-760f-4369-98d9-cd3c530efa75 tempest-VolumesCloneTest-301007338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ed59c75a-759a-4472-9263-dca50d71a1e2.3a633637-9531-4c37-bc72-5044b2924112" returned: 0 in 0.412s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:01:11 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a8f3eaf7-760f-4369-98d9-cd3c530efa75 tempest-VolumesCloneTest-301007338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ed59c75a-759a-4472-9263-dca50d71a1e2.info {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:01:11 devstack sudo[96974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ed59c75a-759a-4472-9263-dca50d71a1e2.info Sep 17 22:01:11 devstack sudo[96974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:01:11 devstack sudo[96974]: pam_unix(sudo:session): session closed for user root Sep 17 22:01:11 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a8f3eaf7-760f-4369-98d9-cd3c530efa75 tempest-VolumesCloneTest-301007338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ed59c75a-759a-4472-9263-dca50d71a1e2.info" returned: 0 in 0.530s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:01:11 devstack cinder-volume[85458]: WARNING cinder.volume.drivers.remotefs [None req-a8f3eaf7-760f-4369-98d9-cd3c530efa75 tempest-VolumesCloneTest-301007338 None] /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ed59c75a-759a-4472-9263-dca50d71a1e2.info is being set with open permissions: ugo+rw Sep 17 22:01:11 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a8f3eaf7-760f-4369-98d9-cd3c530efa75 tempest-VolumesCloneTest-301007338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ed59c75a-759a-4472-9263-dca50d71a1e2.info {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:01:11 devstack sudo[96978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ed59c75a-759a-4472-9263-dca50d71a1e2.info Sep 17 22:01:11 devstack sudo[96978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:01:12 devstack sudo[96978]: pam_unix(sudo:session): session closed for user root Sep 17 22:01:12 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a8f3eaf7-760f-4369-98d9-cd3c530efa75 tempest-VolumesCloneTest-301007338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ed59c75a-759a-4472-9263-dca50d71a1e2.info" returned: 0 in 0.541s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:01:12 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-a8f3eaf7-760f-4369-98d9-cd3c530efa75 tempest-VolumesCloneTest-301007338 None] Acquiring lock "cinder-quobyte-66b98721-9dc0-4fdf-aa83-739f28847ab5" by "_copy_volume_from_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:01:12 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-a8f3eaf7-760f-4369-98d9-cd3c530efa75 tempest-VolumesCloneTest-301007338 None] Lock "cinder-quobyte-66b98721-9dc0-4fdf-aa83-739f28847ab5" acquired by "_copy_volume_from_snapshot" :: waited 0.042s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:01:12 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-a8f3eaf7-760f-4369-98d9-cd3c530efa75 tempest-VolumesCloneTest-301007338 None] snapshot: 3a633637-9531-4c37-bc72-5044b2924112, volume: 66b98721-9dc0-4fdf-aa83-739f28847ab5, {{(pid=85458) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 17 22:01:12 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-a8f3eaf7-760f-4369-98d9-cd3c530efa75 tempest-VolumesCloneTest-301007338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:01:12 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-a8f3eaf7-760f-4369-98d9-cd3c530efa75 tempest-VolumesCloneTest-301007338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:01:12 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-a8f3eaf7-760f-4369-98d9-cd3c530efa75 tempest-VolumesCloneTest-301007338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:01:12 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-a8f3eaf7-760f-4369-98d9-cd3c530efa75 tempest-VolumesCloneTest-301007338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:01:12 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-a8f3eaf7-760f-4369-98d9-cd3c530efa75 tempest-VolumesCloneTest-301007338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:01:12 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ee87974-5c6c-451e-bd7f-c69a096e9890]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:01:12 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a8f3eaf7-760f-4369-98d9-cd3c530efa75 tempest-VolumesCloneTest-301007338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ed59c75a-759a-4472-9263-dca50d71a1e2.3a633637-9531-4c37-bc72-5044b2924112 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:01:12 devstack sudo[96982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ed59c75a-759a-4472-9263-dca50d71a1e2.3a633637-9531-4c37-bc72-5044b2924112 Sep 17 22:01:12 devstack sudo[96982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:01:13 devstack sudo[96982]: pam_unix(sudo:session): session closed for user root Sep 17 22:01:13 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a8f3eaf7-760f-4369-98d9-cd3c530efa75 tempest-VolumesCloneTest-301007338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ed59c75a-759a-4472-9263-dca50d71a1e2.3a633637-9531-4c37-bc72-5044b2924112" returned: 0 in 0.699s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:01:13 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-a8f3eaf7-760f-4369-98d9-cd3c530efa75 tempest-VolumesCloneTest-301007338 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ed59c75a-759a-4472-9263-dca50d71a1e2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85458) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 22:01:13 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[0014293b-943d-4f5c-89c4-97345efa9f94]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:01:13 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a8f3eaf7-760f-4369-98d9-cd3c530efa75 tempest-VolumesCloneTest-301007338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ed59c75a-759a-4472-9263-dca50d71a1e2 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:01:13 devstack sudo[96989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ed59c75a-759a-4472-9263-dca50d71a1e2 Sep 17 22:01:13 devstack sudo[96989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:01:13 devstack sudo[96989]: pam_unix(sudo:session): session closed for user root Sep 17 22:01:13 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a8f3eaf7-760f-4369-98d9-cd3c530efa75 tempest-VolumesCloneTest-301007338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ed59c75a-759a-4472-9263-dca50d71a1e2" returned: 0 in 0.482s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:01:13 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-a8f3eaf7-760f-4369-98d9-cd3c530efa75 tempest-VolumesCloneTest-301007338 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ed59c75a-759a-4472-9263-dca50d71a1e2 {{(pid=85458) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 17 22:01:13 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-a8f3eaf7-760f-4369-98d9-cd3c530efa75 tempest-VolumesCloneTest-301007338 None] Creating direct copy from snapshot {{(pid=85458) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 17 22:01:13 devstack cinder-volume[85458]: DEBUG cinder.utils [None req-a8f3eaf7-760f-4369-98d9-cd3c530efa75 tempest-VolumesCloneTest-301007338 None] Path /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-66b98721-9dc0-4fdf-aa83-739f28847ab5 not found in is_blk_device check {{(pid=85458) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 17 22:01:13 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a8f3eaf7-760f-4369-98d9-cd3c530efa75 tempest-VolumesCloneTest-301007338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ed59c75a-759a-4472-9263-dca50d71a1e2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-66b98721-9dc0-4fdf-aa83-739f28847ab5 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:01:13 devstack sudo[96995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ed59c75a-759a-4472-9263-dca50d71a1e2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-66b98721-9dc0-4fdf-aa83-739f28847ab5 Sep 17 22:01:13 devstack sudo[96995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:01:21 devstack cinder-volume[85458]: DEBUG dbcounter [-] [85458] Writing DB stats cinder:SELECT=13,cinder:UPDATE=12,cinder:INSERT=1,cinder:DELETE=1 {{(pid=85458) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 22:01:21 devstack cinder-volume[85458]: DEBUG dbcounter [-] [85458] Writing DB stats cinder:SELECT=12,cinder:INSERT=7,cinder:UPDATE=17,cinder:DELETE=2 {{(pid=85458) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 22:01:23 devstack sudo[96995]: pam_unix(sudo:session): session closed for user root Sep 17 22:01:23 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a8f3eaf7-760f-4369-98d9-cd3c530efa75 tempest-VolumesCloneTest-301007338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ed59c75a-759a-4472-9263-dca50d71a1e2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-66b98721-9dc0-4fdf-aa83-739f28847ab5" returned: 0 in 9.491s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:01:23 devstack cinder-volume[85458]: DEBUG cinder.image.image_utils [None req-a8f3eaf7-760f-4369-98d9-cd3c530efa75 tempest-VolumesCloneTest-301007338 None] Image conversion details: src /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ed59c75a-759a-4472-9263-dca50d71a1e2, size 1024.00 MB, duration 9.49 sec, destination /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-66b98721-9dc0-4fdf-aa83-739f28847ab5 {{(pid=85458) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 17 22:01:23 devstack cinder-volume[85458]: INFO cinder.image.image_utils [None req-a8f3eaf7-760f-4369-98d9-cd3c530efa75 tempest-VolumesCloneTest-301007338 None] Converted 1024.00 MB image at 107.88 MB/s Sep 17 22:01:23 devstack cinder-volume[85458]: WARNING cinder.volume.drivers.remotefs [None req-a8f3eaf7-760f-4369-98d9-cd3c530efa75 tempest-VolumesCloneTest-301007338 None] /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-66b98721-9dc0-4fdf-aa83-739f28847ab5 is being set with open permissions: ugo+rw Sep 17 22:01:23 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a8f3eaf7-760f-4369-98d9-cd3c530efa75 tempest-VolumesCloneTest-301007338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-66b98721-9dc0-4fdf-aa83-739f28847ab5 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:01:23 devstack sudo[97060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-66b98721-9dc0-4fdf-aa83-739f28847ab5 Sep 17 22:01:23 devstack sudo[97060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:01:23 devstack sudo[97060]: pam_unix(sudo:session): session closed for user root Sep 17 22:01:23 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a8f3eaf7-760f-4369-98d9-cd3c530efa75 tempest-VolumesCloneTest-301007338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-66b98721-9dc0-4fdf-aa83-739f28847ab5" returned: 0 in 0.264s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:01:23 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-a8f3eaf7-760f-4369-98d9-cd3c530efa75 tempest-VolumesCloneTest-301007338 None] Lock "cinder-quobyte-66b98721-9dc0-4fdf-aa83-739f28847ab5" released by "_copy_volume_from_snapshot" :: held 11.050s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:01:23 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-a8f3eaf7-760f-4369-98d9-cd3c530efa75 tempest-VolumesCloneTest-301007338 None] Acquiring lock "cinder-quobyte-3a633637-9531-4c37-bc72-5044b2924112" by "_delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:01:23 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-a8f3eaf7-760f-4369-98d9-cd3c530efa75 tempest-VolumesCloneTest-301007338 None] Lock "cinder-quobyte-3a633637-9531-4c37-bc72-5044b2924112" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:01:23 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-a8f3eaf7-760f-4369-98d9-cd3c530efa75 tempest-VolumesCloneTest-301007338 None] Deleting offline snapshot 3a633637-9531-4c37-bc72-5044b2924112 of volume ed59c75a-759a-4472-9263-dca50d71a1e2 {{(pid=85458) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 22:01:23 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-a8f3eaf7-760f-4369-98d9-cd3c530efa75 tempest-VolumesCloneTest-301007338 None] snapshot_file for this snap is: volume-ed59c75a-759a-4472-9263-dca50d71a1e2.3a633637-9531-4c37-bc72-5044b2924112 {{(pid=85458) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 22:01:23 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6ac9e50-9470-4719-8fe5-059abc7246cd]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:01:23 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a8f3eaf7-760f-4369-98d9-cd3c530efa75 tempest-VolumesCloneTest-301007338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ed59c75a-759a-4472-9263-dca50d71a1e2.3a633637-9531-4c37-bc72-5044b2924112 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:01:23 devstack sudo[97063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ed59c75a-759a-4472-9263-dca50d71a1e2.3a633637-9531-4c37-bc72-5044b2924112 Sep 17 22:01:23 devstack sudo[97063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:01:23 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-166a56bc-3cad-491c-880d-83aca78dc0cf tempest-VolumesListAdminTestJSON-1251321820 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 22:01:23 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-166a56bc-3cad-491c-880d-83aca78dc0cf tempest-VolumesListAdminTestJSON-1251321820 None] Flow 'volume_create_manager' (955db0f6-f4bc-430b-b681-2b042605db7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:01:23 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-166a56bc-3cad-491c-880d-83aca78dc0cf tempest-VolumesListAdminTestJSON-1251321820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12091202-42d7-4290-b4b3-83a1b5a1c962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:01:23 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-166a56bc-3cad-491c-880d-83aca78dc0cf tempest-VolumesListAdminTestJSON-1251321820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12091202-42d7-4290-b4b3-83a1b5a1c962) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:01:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-452002600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08413218-0cb1-4135-bd69-5e08630e659c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82f47e62e7704f1aa54f5f43a96805d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:01:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:01:24Z,use_quota=True,user_id='af6d48c900a545af8d26d332d9b3e353',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:01:23 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-166a56bc-3cad-491c-880d-83aca78dc0cf tempest-VolumesListAdminTestJSON-1251321820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e1d747c-ede9-443c-a526-89df430a578b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:01:23 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-166a56bc-3cad-491c-880d-83aca78dc0cf tempest-VolumesListAdminTestJSON-1251321820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e1d747c-ede9-443c-a526-89df430a578b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:01:23 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-166a56bc-3cad-491c-880d-83aca78dc0cf tempest-VolumesListAdminTestJSON-1251321820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3e8431d-b584-47c8-9285-730bd5ef3062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:01:23 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-166a56bc-3cad-491c-880d-83aca78dc0cf tempest-VolumesListAdminTestJSON-1251321820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3e8431d-b584-47c8-9285-730bd5ef3062) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08413218-0cb1-4135-bd69-5e08630e659c', 'volume_name': 'volume-08413218-0cb1-4135-bd69-5e08630e659c', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:01:23 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-166a56bc-3cad-491c-880d-83aca78dc0cf tempest-VolumesListAdminTestJSON-1251321820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b45ba92-bd65-4d0b-98f8-e4471ce15dfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:01:23 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-166a56bc-3cad-491c-880d-83aca78dc0cf tempest-VolumesListAdminTestJSON-1251321820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b45ba92-bd65-4d0b-98f8-e4471ce15dfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:01:23 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-166a56bc-3cad-491c-880d-83aca78dc0cf tempest-VolumesListAdminTestJSON-1251321820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (345abad6-9714-4333-906f-91cd8eb49d7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:01:23 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-166a56bc-3cad-491c-880d-83aca78dc0cf tempest-VolumesListAdminTestJSON-1251321820 None] Volume 08413218-0cb1-4135-bd69-5e08630e659c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08413218-0cb1-4135-bd69-5e08630e659c', 'volume_size': 1} Sep 17 22:01:23 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-166a56bc-3cad-491c-880d-83aca78dc0cf tempest-VolumesListAdminTestJSON-1251321820 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:01:23 devstack sudo[97063]: pam_unix(sudo:session): session closed for user root Sep 17 22:01:23 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a8f3eaf7-760f-4369-98d9-cd3c530efa75 tempest-VolumesCloneTest-301007338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ed59c75a-759a-4472-9263-dca50d71a1e2.3a633637-9531-4c37-bc72-5044b2924112" returned: 0 in 0.386s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:01:23 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-a8f3eaf7-760f-4369-98d9-cd3c530efa75 tempest-VolumesCloneTest-301007338 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ed59c75a-759a-4472-9263-dca50d71a1e2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85458) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 22:01:23 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[7131f715-a78c-4469-b7b4-19802c6badcb]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:01:23 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a8f3eaf7-760f-4369-98d9-cd3c530efa75 tempest-VolumesCloneTest-301007338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ed59c75a-759a-4472-9263-dca50d71a1e2 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:01:24 devstack sudo[97068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ed59c75a-759a-4472-9263-dca50d71a1e2 Sep 17 22:01:24 devstack sudo[97068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:01:24 devstack sudo[97068]: pam_unix(sudo:session): session closed for user root Sep 17 22:01:24 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a8f3eaf7-760f-4369-98d9-cd3c530efa75 tempest-VolumesCloneTest-301007338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ed59c75a-759a-4472-9263-dca50d71a1e2" returned: 0 in 0.525s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:01:24 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a8f3eaf7-760f-4369-98d9-cd3c530efa75 tempest-VolumesCloneTest-301007338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ed59c75a-759a-4472-9263-dca50d71a1e2.3a633637-9531-4c37-bc72-5044b2924112 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:01:24 devstack sudo[97073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ed59c75a-759a-4472-9263-dca50d71a1e2.3a633637-9531-4c37-bc72-5044b2924112 Sep 17 22:01:24 devstack sudo[97073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:01:24 devstack sudo[97073]: pam_unix(sudo:session): session closed for user root Sep 17 22:01:24 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a8f3eaf7-760f-4369-98d9-cd3c530efa75 tempest-VolumesCloneTest-301007338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ed59c75a-759a-4472-9263-dca50d71a1e2.3a633637-9531-4c37-bc72-5044b2924112" returned: 0 in 0.380s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:01:24 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a8f3eaf7-760f-4369-98d9-cd3c530efa75 tempest-VolumesCloneTest-301007338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ed59c75a-759a-4472-9263-dca50d71a1e2.3a633637-9531-4c37-bc72-5044b2924112 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:01:24 devstack sudo[97078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ed59c75a-759a-4472-9263-dca50d71a1e2.3a633637-9531-4c37-bc72-5044b2924112 Sep 17 22:01:24 devstack sudo[97078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:01:25 devstack sudo[97078]: pam_unix(sudo:session): session closed for user root Sep 17 22:01:25 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a8f3eaf7-760f-4369-98d9-cd3c530efa75 tempest-VolumesCloneTest-301007338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ed59c75a-759a-4472-9263-dca50d71a1e2.3a633637-9531-4c37-bc72-5044b2924112" returned: 0 in 0.265s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:01:25 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-a8f3eaf7-760f-4369-98d9-cd3c530efa75 tempest-VolumesCloneTest-301007338 None] Lock "cinder-quobyte-3a633637-9531-4c37-bc72-5044b2924112" released by "_delete_snapshot" :: held 1.672s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:01:25 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-a8f3eaf7-760f-4369-98d9-cd3c530efa75 tempest-VolumesCloneTest-301007338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.556s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:01:25 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-166a56bc-3cad-491c-880d-83aca78dc0cf tempest-VolumesListAdminTestJSON-1251321820 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.422s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:01:25 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-166a56bc-3cad-491c-880d-83aca78dc0cf tempest-VolumesListAdminTestJSON-1251321820 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:01:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-452002600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08413218-0cb1-4135-bd69-5e08630e659c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82f47e62e7704f1aa54f5f43a96805d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:01:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:01:24Z,use_quota=True,user_id='af6d48c900a545af8d26d332d9b3e353',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 22:01:25 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-166a56bc-3cad-491c-880d-83aca78dc0cf tempest-VolumesListAdminTestJSON-1251321820 None] Creating volume 08413218-0cb1-4135-bd69-5e08630e659c {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 22:01:25 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-166a56bc-3cad-491c-880d-83aca78dc0cf tempest-VolumesListAdminTestJSON-1251321820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:01:25 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-166a56bc-3cad-491c-880d-83aca78dc0cf tempest-VolumesListAdminTestJSON-1251321820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:01:25 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-166a56bc-3cad-491c-880d-83aca78dc0cf tempest-VolumesListAdminTestJSON-1251321820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:01:25 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-166a56bc-3cad-491c-880d-83aca78dc0cf tempest-VolumesListAdminTestJSON-1251321820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:01:25 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-166a56bc-3cad-491c-880d-83aca78dc0cf tempest-VolumesListAdminTestJSON-1251321820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:01:25 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-166a56bc-3cad-491c-880d-83aca78dc0cf tempest-VolumesListAdminTestJSON-1251321820 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 22:01:25 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-166a56bc-3cad-491c-880d-83aca78dc0cf tempest-VolumesListAdminTestJSON-1251321820 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 22:01:25 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-166a56bc-3cad-491c-880d-83aca78dc0cf tempest-VolumesListAdminTestJSON-1251321820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-08413218-0cb1-4135-bd69-5e08630e659c 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:01:25 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-a8f3eaf7-760f-4369-98d9-cd3c530efa75 tempest-VolumesCloneTest-301007338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d198055-a77f-4022-842d-8de106fd6a11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66b98721-9dc0-4fdf-aa83-739f28847ab5', 'volume_size': 2, 'source_volid': 'ed59c75a-759a-4472-9263-dca50d71a1e2', 'source_volstatus': 'available'}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:01:25 devstack sudo[97081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-08413218-0cb1-4135-bd69-5e08630e659c 1073741824 Sep 17 22:01:25 devstack sudo[97081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:01:25 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-a8f3eaf7-760f-4369-98d9-cd3c530efa75 tempest-VolumesCloneTest-301007338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c6658a8-0439-46b7-8dc7-e546543b288f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:01:25 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-a8f3eaf7-760f-4369-98d9-cd3c530efa75 tempest-VolumesCloneTest-301007338 None] Volume volume-66b98721-9dc0-4fdf-aa83-739f28847ab5 (66b98721-9dc0-4fdf-aa83-739f28847ab5): created successfully Sep 17 22:01:25 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-a8f3eaf7-760f-4369-98d9-cd3c530efa75 tempest-VolumesCloneTest-301007338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c6658a8-0439-46b7-8dc7-e546543b288f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:01:25 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-a8f3eaf7-760f-4369-98d9-cd3c530efa75 tempest-VolumesCloneTest-301007338 None] Flow 'volume_create_manager' (f8a91a20-e283-487d-b3da-cab73c034ccf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:01:25 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-a8f3eaf7-760f-4369-98d9-cd3c530efa75 tempest-VolumesCloneTest-301007338 None] Created volume successfully. Sep 17 22:01:25 devstack sudo[97081]: pam_unix(sudo:session): session closed for user root Sep 17 22:01:25 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-166a56bc-3cad-491c-880d-83aca78dc0cf tempest-VolumesListAdminTestJSON-1251321820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-08413218-0cb1-4135-bd69-5e08630e659c 1073741824" returned: 0 in 0.495s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:01:25 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-166a56bc-3cad-491c-880d-83aca78dc0cf tempest-VolumesListAdminTestJSON-1251321820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-08413218-0cb1-4135-bd69-5e08630e659c {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:01:25 devstack sudo[97087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-08413218-0cb1-4135-bd69-5e08630e659c Sep 17 22:01:25 devstack sudo[97087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:01:26 devstack sudo[97087]: pam_unix(sudo:session): session closed for user root Sep 17 22:01:26 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-166a56bc-3cad-491c-880d-83aca78dc0cf tempest-VolumesListAdminTestJSON-1251321820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-08413218-0cb1-4135-bd69-5e08630e659c" returned: 0 in 0.262s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:01:26 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-166a56bc-3cad-491c-880d-83aca78dc0cf tempest-VolumesListAdminTestJSON-1251321820 None] <== create_volume: return (810ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 22:01:26 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-166a56bc-3cad-491c-880d-83aca78dc0cf tempest-VolumesListAdminTestJSON-1251321820 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.813s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:01:26 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-166a56bc-3cad-491c-880d-83aca78dc0cf tempest-VolumesListAdminTestJSON-1251321820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (345abad6-9714-4333-906f-91cd8eb49d7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08413218-0cb1-4135-bd69-5e08630e659c', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:01:26 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-166a56bc-3cad-491c-880d-83aca78dc0cf tempest-VolumesListAdminTestJSON-1251321820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86787fb5-2b45-4f39-8437-dbb97417ae60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:01:26 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-166a56bc-3cad-491c-880d-83aca78dc0cf tempest-VolumesListAdminTestJSON-1251321820 None] Volume volume-08413218-0cb1-4135-bd69-5e08630e659c (08413218-0cb1-4135-bd69-5e08630e659c): created successfully Sep 17 22:01:26 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-166a56bc-3cad-491c-880d-83aca78dc0cf tempest-VolumesListAdminTestJSON-1251321820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86787fb5-2b45-4f39-8437-dbb97417ae60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:01:26 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-166a56bc-3cad-491c-880d-83aca78dc0cf tempest-VolumesListAdminTestJSON-1251321820 None] Flow 'volume_create_manager' (955db0f6-f4bc-430b-b681-2b042605db7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:01:26 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-166a56bc-3cad-491c-880d-83aca78dc0cf tempest-VolumesListAdminTestJSON-1251321820 None] Created volume successfully. Sep 17 22:01:26 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-6afe7ba9-2579-40e8-99c0-8342e2a4f595 tempest-VolumesCloneTest-301007338 None] Acquiring lock "cinder-66b98721-9dc0-4fdf-aa83-739f28847ab5-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:01:26 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-6afe7ba9-2579-40e8-99c0-8342e2a4f595 tempest-VolumesCloneTest-301007338 None] Lock "cinder-66b98721-9dc0-4fdf-aa83-739f28847ab5-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:01:26 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-6afe7ba9-2579-40e8-99c0-8342e2a4f595 tempest-VolumesCloneTest-301007338 None] Acquiring lock "cinder-quobyte-66b98721-9dc0-4fdf-aa83-739f28847ab5" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:01:26 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-6afe7ba9-2579-40e8-99c0-8342e2a4f595 tempest-VolumesCloneTest-301007338 None] Lock "cinder-quobyte-66b98721-9dc0-4fdf-aa83-739f28847ab5" acquired by "delete_volume" :: waited 0.024s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:01:26 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c87f86c-06fb-4dc2-abce-e2dfbff3ea7e]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:01:26 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-6afe7ba9-2579-40e8-99c0-8342e2a4f595 tempest-VolumesCloneTest-301007338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-66b98721-9dc0-4fdf-aa83-739f28847ab5 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:01:27 devstack sudo[97090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-66b98721-9dc0-4fdf-aa83-739f28847ab5 Sep 17 22:01:27 devstack sudo[97090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:01:27 devstack sudo[97090]: pam_unix(sudo:session): session closed for user root Sep 17 22:01:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-6afe7ba9-2579-40e8-99c0-8342e2a4f595 tempest-VolumesCloneTest-301007338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-66b98721-9dc0-4fdf-aa83-739f28847ab5" returned: 0 in 0.496s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:01:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-6afe7ba9-2579-40e8-99c0-8342e2a4f595 tempest-VolumesCloneTest-301007338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-66b98721-9dc0-4fdf-aa83-739f28847ab5 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:01:27 devstack sudo[97095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-66b98721-9dc0-4fdf-aa83-739f28847ab5 Sep 17 22:01:27 devstack sudo[97095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:01:27 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ab3d0b1-28b0-4b66-9397-9861f632772b tempest-VolumesListAdminTestJSON-1251321820 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 22:01:27 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-5ab3d0b1-28b0-4b66-9397-9861f632772b tempest-VolumesListAdminTestJSON-1251321820 None] Flow 'volume_create_manager' (0958f331-8b1c-4ae5-a4d4-6739483e15d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:01:27 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-5ab3d0b1-28b0-4b66-9397-9861f632772b tempest-VolumesListAdminTestJSON-1251321820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adb14fb6-6184-4ffe-bab9-7d5c54c99f01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:01:27 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-5ab3d0b1-28b0-4b66-9397-9861f632772b tempest-VolumesListAdminTestJSON-1251321820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adb14fb6-6184-4ffe-bab9-7d5c54c99f01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:01:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1264019379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61c82f6a-d8ec-4ab3-ac7e-89dc923a8909,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82f47e62e7704f1aa54f5f43a96805d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:01:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:01:27Z,use_quota=True,user_id='af6d48c900a545af8d26d332d9b3e353',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:01:27 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-5ab3d0b1-28b0-4b66-9397-9861f632772b tempest-VolumesListAdminTestJSON-1251321820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94736c56-5ece-496f-8d9f-b1a4551328c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:01:27 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-5ab3d0b1-28b0-4b66-9397-9861f632772b tempest-VolumesListAdminTestJSON-1251321820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94736c56-5ece-496f-8d9f-b1a4551328c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:01:27 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-5ab3d0b1-28b0-4b66-9397-9861f632772b tempest-VolumesListAdminTestJSON-1251321820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93d79376-02c8-4fbe-acae-11e8c89e3fd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:01:27 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-5ab3d0b1-28b0-4b66-9397-9861f632772b tempest-VolumesListAdminTestJSON-1251321820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93d79376-02c8-4fbe-acae-11e8c89e3fd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61c82f6a-d8ec-4ab3-ac7e-89dc923a8909', 'volume_name': 'volume-61c82f6a-d8ec-4ab3-ac7e-89dc923a8909', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:01:27 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-5ab3d0b1-28b0-4b66-9397-9861f632772b tempest-VolumesListAdminTestJSON-1251321820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (448b7b9c-eb8a-4d3a-8e79-fd572c5ff02d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:01:27 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-5ab3d0b1-28b0-4b66-9397-9861f632772b tempest-VolumesListAdminTestJSON-1251321820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (448b7b9c-eb8a-4d3a-8e79-fd572c5ff02d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:01:27 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-5ab3d0b1-28b0-4b66-9397-9861f632772b tempest-VolumesListAdminTestJSON-1251321820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc78159f-f9d4-4ed3-a98c-0b08fce763d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:01:27 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-5ab3d0b1-28b0-4b66-9397-9861f632772b tempest-VolumesListAdminTestJSON-1251321820 None] Volume 61c82f6a-d8ec-4ab3-ac7e-89dc923a8909: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61c82f6a-d8ec-4ab3-ac7e-89dc923a8909', 'volume_size': 1} Sep 17 22:01:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-5ab3d0b1-28b0-4b66-9397-9861f632772b tempest-VolumesListAdminTestJSON-1251321820 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:01:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-5ab3d0b1-28b0-4b66-9397-9861f632772b tempest-VolumesListAdminTestJSON-1251321820 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:01:27 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-5ab3d0b1-28b0-4b66-9397-9861f632772b tempest-VolumesListAdminTestJSON-1251321820 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:01:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1264019379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61c82f6a-d8ec-4ab3-ac7e-89dc923a8909,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82f47e62e7704f1aa54f5f43a96805d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:01:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:01:27Z,use_quota=True,user_id='af6d48c900a545af8d26d332d9b3e353',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 22:01:27 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-5ab3d0b1-28b0-4b66-9397-9861f632772b tempest-VolumesListAdminTestJSON-1251321820 None] Creating volume 61c82f6a-d8ec-4ab3-ac7e-89dc923a8909 {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 22:01:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-5ab3d0b1-28b0-4b66-9397-9861f632772b tempest-VolumesListAdminTestJSON-1251321820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:01:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-5ab3d0b1-28b0-4b66-9397-9861f632772b tempest-VolumesListAdminTestJSON-1251321820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:01:27 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-5ab3d0b1-28b0-4b66-9397-9861f632772b tempest-VolumesListAdminTestJSON-1251321820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:01:27 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-5ab3d0b1-28b0-4b66-9397-9861f632772b tempest-VolumesListAdminTestJSON-1251321820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:01:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-5ab3d0b1-28b0-4b66-9397-9861f632772b tempest-VolumesListAdminTestJSON-1251321820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:01:27 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-5ab3d0b1-28b0-4b66-9397-9861f632772b tempest-VolumesListAdminTestJSON-1251321820 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 22:01:27 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-5ab3d0b1-28b0-4b66-9397-9861f632772b tempest-VolumesListAdminTestJSON-1251321820 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 22:01:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-5ab3d0b1-28b0-4b66-9397-9861f632772b tempest-VolumesListAdminTestJSON-1251321820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-61c82f6a-d8ec-4ab3-ac7e-89dc923a8909 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:01:27 devstack sudo[97097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-61c82f6a-d8ec-4ab3-ac7e-89dc923a8909 1073741824 Sep 17 22:01:27 devstack sudo[97097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:01:27 devstack sudo[97095]: pam_unix(sudo:session): session closed for user root Sep 17 22:01:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-6afe7ba9-2579-40e8-99c0-8342e2a4f595 tempest-VolumesCloneTest-301007338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-66b98721-9dc0-4fdf-aa83-739f28847ab5" returned: 0 in 0.285s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:01:27 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-6afe7ba9-2579-40e8-99c0-8342e2a4f595 tempest-VolumesCloneTest-301007338 None] Lock "cinder-quobyte-66b98721-9dc0-4fdf-aa83-739f28847ab5" released by "delete_volume" :: held 0.849s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:01:27 devstack cinder-volume[85458]: DEBUG oslo_service.periodic_task [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85458) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 22:01:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:01:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:01:27 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:01:27 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:01:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:01:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:01:27 devstack sudo[97100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:01:27 devstack sudo[97100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:01:27 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-6afe7ba9-2579-40e8-99c0-8342e2a4f595 tempest-VolumesCloneTest-301007338 None] Created reservations ['898412aa-b716-4d1f-9e1e-01149f21eda0', '5093c565-0c41-40d7-837a-3b50a6ad3b8a', 'b0bab921-04e6-490d-b4bd-b43e160dd85f', 'bd7b393d-a590-4ceb-a717-d7d9002916c8'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:01:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-6afe7ba9-2579-40e8-99c0-8342e2a4f595 tempest-VolumesCloneTest-301007338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:01:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-6afe7ba9-2579-40e8-99c0-8342e2a4f595 tempest-VolumesCloneTest-301007338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:01:27 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-6afe7ba9-2579-40e8-99c0-8342e2a4f595 tempest-VolumesCloneTest-301007338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:01:27 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-6afe7ba9-2579-40e8-99c0-8342e2a4f595 tempest-VolumesCloneTest-301007338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:01:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-6afe7ba9-2579-40e8-99c0-8342e2a4f595 tempest-VolumesCloneTest-301007338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:01:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-6afe7ba9-2579-40e8-99c0-8342e2a4f595 tempest-VolumesCloneTest-301007338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:01:28 devstack sudo[97106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:01:28 devstack sudo[97106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:01:28 devstack sudo[97097]: pam_unix(sudo:session): session closed for user root Sep 17 22:01:28 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-5ab3d0b1-28b0-4b66-9397-9861f632772b tempest-VolumesListAdminTestJSON-1251321820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-61c82f6a-d8ec-4ab3-ac7e-89dc923a8909 1073741824" returned: 0 in 0.580s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:01:28 devstack sudo[97100]: pam_unix(sudo:session): session closed for user root Sep 17 22:01:28 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.415s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:01:28 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:01:28 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-f1304839-ce58-4086-aaf1-0e1c3c1eed2d tempest-VolumesCloneTest-301007338 None] Acquiring lock "cinder-ed59c75a-759a-4472-9263-dca50d71a1e2-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:01:28 devstack cinder-volume[85458]: DEBUG oslo_service.periodic_task [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Running periodic task VolumeManager._thread_info {{(pid=85458) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 22:01:28 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] thread count: 28 {{(pid=85458) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 22:01:28 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] thread info: [<_MainThread(MainThread, started 127546830999680)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85458) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 22:01:28 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-f1304839-ce58-4086-aaf1-0e1c3c1eed2d tempest-VolumesCloneTest-301007338 None] Lock "cinder-ed59c75a-759a-4472-9263-dca50d71a1e2-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:01:28 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-5ab3d0b1-28b0-4b66-9397-9861f632772b tempest-VolumesListAdminTestJSON-1251321820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-61c82f6a-d8ec-4ab3-ac7e-89dc923a8909 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:01:28 devstack sudo[97106]: pam_unix(sudo:session): session closed for user root Sep 17 22:01:28 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-6afe7ba9-2579-40e8-99c0-8342e2a4f595 tempest-VolumesCloneTest-301007338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.314s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:01:28 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-6afe7ba9-2579-40e8-99c0-8342e2a4f595 tempest-VolumesCloneTest-301007338 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:01:28 devstack sudo[97112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-61c82f6a-d8ec-4ab3-ac7e-89dc923a8909 Sep 17 22:01:28 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-f1304839-ce58-4086-aaf1-0e1c3c1eed2d tempest-VolumesCloneTest-301007338 None] Acquiring lock "cinder-quobyte-ed59c75a-759a-4472-9263-dca50d71a1e2" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:01:28 devstack sudo[97112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:01:28 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-6afe7ba9-2579-40e8-99c0-8342e2a4f595 tempest-VolumesCloneTest-301007338 None] Deleted volume successfully. Sep 17 22:01:28 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-f1304839-ce58-4086-aaf1-0e1c3c1eed2d tempest-VolumesCloneTest-301007338 None] Lock "cinder-quobyte-ed59c75a-759a-4472-9263-dca50d71a1e2" acquired by "delete_volume" :: waited 0.024s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:01:28 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-6afe7ba9-2579-40e8-99c0-8342e2a4f595 tempest-VolumesCloneTest-301007338 None] Lock "cinder-66b98721-9dc0-4fdf-aa83-739f28847ab5-delete_volume" released by "delete_volume" :: held 1.543s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:01:28 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[62ed1dcb-1a80-494e-a8f2-3ca9e9015ea9]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:01:28 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-f1304839-ce58-4086-aaf1-0e1c3c1eed2d tempest-VolumesCloneTest-301007338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ed59c75a-759a-4472-9263-dca50d71a1e2 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:01:28 devstack sudo[97114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ed59c75a-759a-4472-9263-dca50d71a1e2 Sep 17 22:01:28 devstack sudo[97114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:01:28 devstack sudo[97112]: pam_unix(sudo:session): session closed for user root Sep 17 22:01:28 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-5ab3d0b1-28b0-4b66-9397-9861f632772b tempest-VolumesListAdminTestJSON-1251321820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-61c82f6a-d8ec-4ab3-ac7e-89dc923a8909" returned: 0 in 0.293s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:01:28 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-5ab3d0b1-28b0-4b66-9397-9861f632772b tempest-VolumesListAdminTestJSON-1251321820 None] <== create_volume: return (975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 22:01:28 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-5ab3d0b1-28b0-4b66-9397-9861f632772b tempest-VolumesListAdminTestJSON-1251321820 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.977s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:01:28 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-5ab3d0b1-28b0-4b66-9397-9861f632772b tempest-VolumesListAdminTestJSON-1251321820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc78159f-f9d4-4ed3-a98c-0b08fce763d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61c82f6a-d8ec-4ab3-ac7e-89dc923a8909', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:01:28 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-5ab3d0b1-28b0-4b66-9397-9861f632772b tempest-VolumesListAdminTestJSON-1251321820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2435e13-cdf0-4e50-ac8d-b574b9b5a426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:01:28 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-5ab3d0b1-28b0-4b66-9397-9861f632772b tempest-VolumesListAdminTestJSON-1251321820 None] Volume volume-61c82f6a-d8ec-4ab3-ac7e-89dc923a8909 (61c82f6a-d8ec-4ab3-ac7e-89dc923a8909): created successfully Sep 17 22:01:28 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-5ab3d0b1-28b0-4b66-9397-9861f632772b tempest-VolumesListAdminTestJSON-1251321820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2435e13-cdf0-4e50-ac8d-b574b9b5a426) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:01:28 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-5ab3d0b1-28b0-4b66-9397-9861f632772b tempest-VolumesListAdminTestJSON-1251321820 None] Flow 'volume_create_manager' (0958f331-8b1c-4ae5-a4d4-6739483e15d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:01:28 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-5ab3d0b1-28b0-4b66-9397-9861f632772b tempest-VolumesListAdminTestJSON-1251321820 None] Created volume successfully. Sep 17 22:01:28 devstack sudo[97114]: pam_unix(sudo:session): session closed for user root Sep 17 22:01:28 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-f1304839-ce58-4086-aaf1-0e1c3c1eed2d tempest-VolumesCloneTest-301007338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ed59c75a-759a-4472-9263-dca50d71a1e2" returned: 0 in 0.377s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:01:28 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-f1304839-ce58-4086-aaf1-0e1c3c1eed2d tempest-VolumesCloneTest-301007338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ed59c75a-759a-4472-9263-dca50d71a1e2 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:01:28 devstack sudo[97120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ed59c75a-759a-4472-9263-dca50d71a1e2 Sep 17 22:01:28 devstack sudo[97120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:01:28 devstack sudo[97120]: pam_unix(sudo:session): session closed for user root Sep 17 22:01:29 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-f1304839-ce58-4086-aaf1-0e1c3c1eed2d tempest-VolumesCloneTest-301007338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ed59c75a-759a-4472-9263-dca50d71a1e2" returned: 0 in 0.248s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:01:29 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-f1304839-ce58-4086-aaf1-0e1c3c1eed2d tempest-VolumesCloneTest-301007338 None] Lock "cinder-quobyte-ed59c75a-759a-4472-9263-dca50d71a1e2" released by "delete_volume" :: held 0.701s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:01:29 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-f1304839-ce58-4086-aaf1-0e1c3c1eed2d tempest-VolumesCloneTest-301007338 None] Created reservations ['b57aa97b-bc6c-4d3d-8cb5-dc97827a1869', '99fc7868-bbb6-446e-a941-e76104be36bd', '44508bdf-3556-4629-8cc0-a636012da257', '82646771-f91f-4f59-8a82-b47d1bc51d24'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:01:29 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-f1304839-ce58-4086-aaf1-0e1c3c1eed2d tempest-VolumesCloneTest-301007338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:01:29 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-f1304839-ce58-4086-aaf1-0e1c3c1eed2d tempest-VolumesCloneTest-301007338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:01:29 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-f1304839-ce58-4086-aaf1-0e1c3c1eed2d tempest-VolumesCloneTest-301007338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:01:29 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-f1304839-ce58-4086-aaf1-0e1c3c1eed2d tempest-VolumesCloneTest-301007338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:01:29 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-f1304839-ce58-4086-aaf1-0e1c3c1eed2d tempest-VolumesCloneTest-301007338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:01:29 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-f1304839-ce58-4086-aaf1-0e1c3c1eed2d tempest-VolumesCloneTest-301007338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:01:29 devstack sudo[97124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:01:29 devstack sudo[97124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:01:29 devstack sudo[97124]: pam_unix(sudo:session): session closed for user root Sep 17 22:01:29 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-f1304839-ce58-4086-aaf1-0e1c3c1eed2d tempest-VolumesCloneTest-301007338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.262s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:01:29 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-f1304839-ce58-4086-aaf1-0e1c3c1eed2d tempest-VolumesCloneTest-301007338 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:01:29 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-f1304839-ce58-4086-aaf1-0e1c3c1eed2d tempest-VolumesCloneTest-301007338 None] Deleted volume successfully. Sep 17 22:01:29 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-f1304839-ce58-4086-aaf1-0e1c3c1eed2d tempest-VolumesCloneTest-301007338 None] Lock "cinder-ed59c75a-759a-4472-9263-dca50d71a1e2-delete_volume" released by "delete_volume" :: held 1.225s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:01:30 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfc2b284-ca18-469a-8ef5-4bdfc5e753b3 tempest-VolumesListAdminTestJSON-1251321820 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 22:01:30 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-cfc2b284-ca18-469a-8ef5-4bdfc5e753b3 tempest-VolumesListAdminTestJSON-1251321820 None] Flow 'volume_create_manager' (0aa30d04-10cd-46a3-bf68-cdd8cd6fa144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:01:30 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-cfc2b284-ca18-469a-8ef5-4bdfc5e753b3 tempest-VolumesListAdminTestJSON-1251321820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bccf88e-71f0-4cea-aa4a-bb765836bb3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:01:30 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-cfc2b284-ca18-469a-8ef5-4bdfc5e753b3 tempest-VolumesListAdminTestJSON-1251321820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bccf88e-71f0-4cea-aa4a-bb765836bb3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:01:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1809892974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b57804c-692c-4ff4-a5b3-56d84f74379d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82f47e62e7704f1aa54f5f43a96805d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:01:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:01:30Z,use_quota=True,user_id='af6d48c900a545af8d26d332d9b3e353',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:01:30 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-cfc2b284-ca18-469a-8ef5-4bdfc5e753b3 tempest-VolumesListAdminTestJSON-1251321820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (449eb1cb-ad81-4822-8f9a-9c8c282c44c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:01:30 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-cfc2b284-ca18-469a-8ef5-4bdfc5e753b3 tempest-VolumesListAdminTestJSON-1251321820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (449eb1cb-ad81-4822-8f9a-9c8c282c44c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:01:30 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-cfc2b284-ca18-469a-8ef5-4bdfc5e753b3 tempest-VolumesListAdminTestJSON-1251321820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2f4c972-17fc-4f90-8dbe-ff5790546420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:01:30 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-cfc2b284-ca18-469a-8ef5-4bdfc5e753b3 tempest-VolumesListAdminTestJSON-1251321820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2f4c972-17fc-4f90-8dbe-ff5790546420) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b57804c-692c-4ff4-a5b3-56d84f74379d', 'volume_name': 'volume-0b57804c-692c-4ff4-a5b3-56d84f74379d', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:01:30 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-cfc2b284-ca18-469a-8ef5-4bdfc5e753b3 tempest-VolumesListAdminTestJSON-1251321820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90ea361c-c08b-43e7-b49e-8b1407bd8277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:01:30 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-cfc2b284-ca18-469a-8ef5-4bdfc5e753b3 tempest-VolumesListAdminTestJSON-1251321820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90ea361c-c08b-43e7-b49e-8b1407bd8277) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:01:30 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-cfc2b284-ca18-469a-8ef5-4bdfc5e753b3 tempest-VolumesListAdminTestJSON-1251321820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49e18930-360b-4f44-90cd-7923eae8342b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:01:30 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-cfc2b284-ca18-469a-8ef5-4bdfc5e753b3 tempest-VolumesListAdminTestJSON-1251321820 None] Volume 0b57804c-692c-4ff4-a5b3-56d84f74379d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b57804c-692c-4ff4-a5b3-56d84f74379d', 'volume_size': 1} Sep 17 22:01:30 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-cfc2b284-ca18-469a-8ef5-4bdfc5e753b3 tempest-VolumesListAdminTestJSON-1251321820 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:01:30 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-cfc2b284-ca18-469a-8ef5-4bdfc5e753b3 tempest-VolumesListAdminTestJSON-1251321820 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:01:30 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-cfc2b284-ca18-469a-8ef5-4bdfc5e753b3 tempest-VolumesListAdminTestJSON-1251321820 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:01:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1809892974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b57804c-692c-4ff4-a5b3-56d84f74379d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82f47e62e7704f1aa54f5f43a96805d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:01:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:01:30Z,use_quota=True,user_id='af6d48c900a545af8d26d332d9b3e353',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 22:01:30 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-cfc2b284-ca18-469a-8ef5-4bdfc5e753b3 tempest-VolumesListAdminTestJSON-1251321820 None] Creating volume 0b57804c-692c-4ff4-a5b3-56d84f74379d {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 22:01:30 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-cfc2b284-ca18-469a-8ef5-4bdfc5e753b3 tempest-VolumesListAdminTestJSON-1251321820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:01:30 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-cfc2b284-ca18-469a-8ef5-4bdfc5e753b3 tempest-VolumesListAdminTestJSON-1251321820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:01:30 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-cfc2b284-ca18-469a-8ef5-4bdfc5e753b3 tempest-VolumesListAdminTestJSON-1251321820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:01:30 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-cfc2b284-ca18-469a-8ef5-4bdfc5e753b3 tempest-VolumesListAdminTestJSON-1251321820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:01:30 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-cfc2b284-ca18-469a-8ef5-4bdfc5e753b3 tempest-VolumesListAdminTestJSON-1251321820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:01:30 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-cfc2b284-ca18-469a-8ef5-4bdfc5e753b3 tempest-VolumesListAdminTestJSON-1251321820 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 22:01:30 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-cfc2b284-ca18-469a-8ef5-4bdfc5e753b3 tempest-VolumesListAdminTestJSON-1251321820 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 22:01:30 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-cfc2b284-ca18-469a-8ef5-4bdfc5e753b3 tempest-VolumesListAdminTestJSON-1251321820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0b57804c-692c-4ff4-a5b3-56d84f74379d 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:01:30 devstack sudo[97136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0b57804c-692c-4ff4-a5b3-56d84f74379d 1073741824 Sep 17 22:01:30 devstack sudo[97136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:01:31 devstack sudo[97136]: pam_unix(sudo:session): session closed for user root Sep 17 22:01:31 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-cfc2b284-ca18-469a-8ef5-4bdfc5e753b3 tempest-VolumesListAdminTestJSON-1251321820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0b57804c-692c-4ff4-a5b3-56d84f74379d 1073741824" returned: 0 in 0.718s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:01:31 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-cfc2b284-ca18-469a-8ef5-4bdfc5e753b3 tempest-VolumesListAdminTestJSON-1251321820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0b57804c-692c-4ff4-a5b3-56d84f74379d {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:01:31 devstack sudo[97142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0b57804c-692c-4ff4-a5b3-56d84f74379d Sep 17 22:01:31 devstack sudo[97142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:01:31 devstack sudo[97142]: pam_unix(sudo:session): session closed for user root Sep 17 22:01:31 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-cfc2b284-ca18-469a-8ef5-4bdfc5e753b3 tempest-VolumesListAdminTestJSON-1251321820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0b57804c-692c-4ff4-a5b3-56d84f74379d" returned: 0 in 0.364s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:01:31 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-cfc2b284-ca18-469a-8ef5-4bdfc5e753b3 tempest-VolumesListAdminTestJSON-1251321820 None] <== create_volume: return (1182ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 22:01:31 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-cfc2b284-ca18-469a-8ef5-4bdfc5e753b3 tempest-VolumesListAdminTestJSON-1251321820 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.185s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:01:31 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-cfc2b284-ca18-469a-8ef5-4bdfc5e753b3 tempest-VolumesListAdminTestJSON-1251321820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49e18930-360b-4f44-90cd-7923eae8342b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b57804c-692c-4ff4-a5b3-56d84f74379d', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:01:31 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-cfc2b284-ca18-469a-8ef5-4bdfc5e753b3 tempest-VolumesListAdminTestJSON-1251321820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d5c06a6-85d1-4998-ac59-376a98ff3c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:01:31 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-cfc2b284-ca18-469a-8ef5-4bdfc5e753b3 tempest-VolumesListAdminTestJSON-1251321820 None] Volume volume-0b57804c-692c-4ff4-a5b3-56d84f74379d (0b57804c-692c-4ff4-a5b3-56d84f74379d): created successfully Sep 17 22:01:31 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-cfc2b284-ca18-469a-8ef5-4bdfc5e753b3 tempest-VolumesListAdminTestJSON-1251321820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d5c06a6-85d1-4998-ac59-376a98ff3c3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:01:31 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-cfc2b284-ca18-469a-8ef5-4bdfc5e753b3 tempest-VolumesListAdminTestJSON-1251321820 None] Flow 'volume_create_manager' (0aa30d04-10cd-46a3-bf68-cdd8cd6fa144) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:01:31 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-cfc2b284-ca18-469a-8ef5-4bdfc5e753b3 tempest-VolumesListAdminTestJSON-1251321820 None] Created volume successfully. Sep 17 22:01:33 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-71860aab-2cb5-4ca4-8b50-a00278a16b1c tempest-VolumesListAdminTestJSON-575169026 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 22:01:33 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-71860aab-2cb5-4ca4-8b50-a00278a16b1c tempest-VolumesListAdminTestJSON-575169026 None] Flow 'volume_create_manager' (c4c2911f-4837-4d27-aa5e-248531f49aeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:01:33 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-71860aab-2cb5-4ca4-8b50-a00278a16b1c tempest-VolumesListAdminTestJSON-575169026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6916a432-2974-4aea-9d37-04a44bab18d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:01:33 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-71860aab-2cb5-4ca4-8b50-a00278a16b1c tempest-VolumesListAdminTestJSON-575169026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6916a432-2974-4aea-9d37-04a44bab18d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:01:33Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60b78020-feef-49a1-b034-9c5ff6fb6e9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='815edc163a8a4220985a20338ac10b20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:01:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:01:34Z,use_quota=True,user_id='3188e41c72bd473fbd36aff7bfd5a1f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:01:33 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-71860aab-2cb5-4ca4-8b50-a00278a16b1c tempest-VolumesListAdminTestJSON-575169026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9471399-d5ac-4792-aa9b-89b571da469f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:01:33 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-71860aab-2cb5-4ca4-8b50-a00278a16b1c tempest-VolumesListAdminTestJSON-575169026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9471399-d5ac-4792-aa9b-89b571da469f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:01:33 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-71860aab-2cb5-4ca4-8b50-a00278a16b1c tempest-VolumesListAdminTestJSON-575169026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea425c50-a29b-4452-9ad1-48e5c1f2f24a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:01:33 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-71860aab-2cb5-4ca4-8b50-a00278a16b1c tempest-VolumesListAdminTestJSON-575169026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea425c50-a29b-4452-9ad1-48e5c1f2f24a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60b78020-feef-49a1-b034-9c5ff6fb6e9d', 'volume_name': 'volume-60b78020-feef-49a1-b034-9c5ff6fb6e9d', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:01:33 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-71860aab-2cb5-4ca4-8b50-a00278a16b1c tempest-VolumesListAdminTestJSON-575169026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15d6b712-ae97-4c81-8f57-ae46a91cb312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:01:33 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-71860aab-2cb5-4ca4-8b50-a00278a16b1c tempest-VolumesListAdminTestJSON-575169026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15d6b712-ae97-4c81-8f57-ae46a91cb312) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:01:33 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-71860aab-2cb5-4ca4-8b50-a00278a16b1c tempest-VolumesListAdminTestJSON-575169026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (356941af-964c-4172-9714-71a8a1df26ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:01:33 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-71860aab-2cb5-4ca4-8b50-a00278a16b1c tempest-VolumesListAdminTestJSON-575169026 None] Volume 60b78020-feef-49a1-b034-9c5ff6fb6e9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60b78020-feef-49a1-b034-9c5ff6fb6e9d', 'volume_size': 1} Sep 17 22:01:33 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-71860aab-2cb5-4ca4-8b50-a00278a16b1c tempest-VolumesListAdminTestJSON-575169026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:01:33 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-71860aab-2cb5-4ca4-8b50-a00278a16b1c tempest-VolumesListAdminTestJSON-575169026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:01:33 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-71860aab-2cb5-4ca4-8b50-a00278a16b1c tempest-VolumesListAdminTestJSON-575169026 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:01:33Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60b78020-feef-49a1-b034-9c5ff6fb6e9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='815edc163a8a4220985a20338ac10b20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:01:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:01:34Z,use_quota=True,user_id='3188e41c72bd473fbd36aff7bfd5a1f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 22:01:33 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-71860aab-2cb5-4ca4-8b50-a00278a16b1c tempest-VolumesListAdminTestJSON-575169026 None] Creating volume 60b78020-feef-49a1-b034-9c5ff6fb6e9d {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 22:01:33 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-71860aab-2cb5-4ca4-8b50-a00278a16b1c tempest-VolumesListAdminTestJSON-575169026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:01:33 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-71860aab-2cb5-4ca4-8b50-a00278a16b1c tempest-VolumesListAdminTestJSON-575169026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:01:33 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-71860aab-2cb5-4ca4-8b50-a00278a16b1c tempest-VolumesListAdminTestJSON-575169026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:01:33 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-71860aab-2cb5-4ca4-8b50-a00278a16b1c tempest-VolumesListAdminTestJSON-575169026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:01:33 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-71860aab-2cb5-4ca4-8b50-a00278a16b1c tempest-VolumesListAdminTestJSON-575169026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:01:33 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-71860aab-2cb5-4ca4-8b50-a00278a16b1c tempest-VolumesListAdminTestJSON-575169026 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 22:01:33 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-71860aab-2cb5-4ca4-8b50-a00278a16b1c tempest-VolumesListAdminTestJSON-575169026 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 22:01:33 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-71860aab-2cb5-4ca4-8b50-a00278a16b1c tempest-VolumesListAdminTestJSON-575169026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-60b78020-feef-49a1-b034-9c5ff6fb6e9d 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:01:33 devstack sudo[97145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-60b78020-feef-49a1-b034-9c5ff6fb6e9d 1073741824 Sep 17 22:01:33 devstack sudo[97145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:01:34 devstack sudo[97145]: pam_unix(sudo:session): session closed for user root Sep 17 22:01:34 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-71860aab-2cb5-4ca4-8b50-a00278a16b1c tempest-VolumesListAdminTestJSON-575169026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-60b78020-feef-49a1-b034-9c5ff6fb6e9d 1073741824" returned: 0 in 0.542s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:01:34 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-71860aab-2cb5-4ca4-8b50-a00278a16b1c tempest-VolumesListAdminTestJSON-575169026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-60b78020-feef-49a1-b034-9c5ff6fb6e9d {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:01:34 devstack sudo[97151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-60b78020-feef-49a1-b034-9c5ff6fb6e9d Sep 17 22:01:34 devstack sudo[97151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:01:34 devstack sudo[97151]: pam_unix(sudo:session): session closed for user root Sep 17 22:01:34 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-71860aab-2cb5-4ca4-8b50-a00278a16b1c tempest-VolumesListAdminTestJSON-575169026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-60b78020-feef-49a1-b034-9c5ff6fb6e9d" returned: 0 in 0.374s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:01:34 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-71860aab-2cb5-4ca4-8b50-a00278a16b1c tempest-VolumesListAdminTestJSON-575169026 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 22:01:34 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-71860aab-2cb5-4ca4-8b50-a00278a16b1c tempest-VolumesListAdminTestJSON-575169026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.978s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:01:34 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-71860aab-2cb5-4ca4-8b50-a00278a16b1c tempest-VolumesListAdminTestJSON-575169026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (356941af-964c-4172-9714-71a8a1df26ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60b78020-feef-49a1-b034-9c5ff6fb6e9d', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:01:34 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-71860aab-2cb5-4ca4-8b50-a00278a16b1c tempest-VolumesListAdminTestJSON-575169026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4392c096-a6ef-4bf1-9add-d77008b649f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:01:34 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-0710aa0b-f2a5-40d3-82db-b2ebe2d32ad7 tempest-VolumesGetTest-1858470535 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 22:01:34 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-0710aa0b-f2a5-40d3-82db-b2ebe2d32ad7 tempest-VolumesGetTest-1858470535 None] Flow 'volume_create_manager' (60ffb759-a63b-4df8-bde4-02232a69c08c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:01:34 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-0710aa0b-f2a5-40d3-82db-b2ebe2d32ad7 tempest-VolumesGetTest-1858470535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (deb383c4-8944-4783-8fa5-5da16df39ec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:01:34 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-71860aab-2cb5-4ca4-8b50-a00278a16b1c tempest-VolumesListAdminTestJSON-575169026 None] Volume volume-60b78020-feef-49a1-b034-9c5ff6fb6e9d (60b78020-feef-49a1-b034-9c5ff6fb6e9d): created successfully Sep 17 22:01:34 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-71860aab-2cb5-4ca4-8b50-a00278a16b1c tempest-VolumesListAdminTestJSON-575169026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4392c096-a6ef-4bf1-9add-d77008b649f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:01:34 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-71860aab-2cb5-4ca4-8b50-a00278a16b1c tempest-VolumesListAdminTestJSON-575169026 None] Flow 'volume_create_manager' (c4c2911f-4837-4d27-aa5e-248531f49aeb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:01:34 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-0710aa0b-f2a5-40d3-82db-b2ebe2d32ad7 tempest-VolumesGetTest-1858470535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (deb383c4-8944-4783-8fa5-5da16df39ec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:01:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1304150927',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=336f56bd-8c20-4f02-a7b3-dd06237677ee,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='cfeba540fd8a4d37b58b43b2b38ce1e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:01:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:01:35Z,use_quota=True,user_id='5c1a5bbe85894370877379762b25947b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:01:34 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-0710aa0b-f2a5-40d3-82db-b2ebe2d32ad7 tempest-VolumesGetTest-1858470535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55d60b22-3428-4079-9870-af3ef6538a45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:01:34 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-0710aa0b-f2a5-40d3-82db-b2ebe2d32ad7 tempest-VolumesGetTest-1858470535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55d60b22-3428-4079-9870-af3ef6538a45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:01:34 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-0710aa0b-f2a5-40d3-82db-b2ebe2d32ad7 tempest-VolumesGetTest-1858470535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f27ffae-6630-4b61-8b3c-c8b723b26cd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:01:34 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-0710aa0b-f2a5-40d3-82db-b2ebe2d32ad7 tempest-VolumesGetTest-1858470535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f27ffae-6630-4b61-8b3c-c8b723b26cd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '336f56bd-8c20-4f02-a7b3-dd06237677ee', 'volume_name': 'volume-336f56bd-8c20-4f02-a7b3-dd06237677ee', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:01:34 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-0710aa0b-f2a5-40d3-82db-b2ebe2d32ad7 tempest-VolumesGetTest-1858470535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4afcd95e-42a9-4211-9576-8fed0a3c96df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:01:34 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-0710aa0b-f2a5-40d3-82db-b2ebe2d32ad7 tempest-VolumesGetTest-1858470535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4afcd95e-42a9-4211-9576-8fed0a3c96df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:01:34 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-0710aa0b-f2a5-40d3-82db-b2ebe2d32ad7 tempest-VolumesGetTest-1858470535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea8efdf7-6383-4b00-9c0a-8cdd7b7bf4bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:01:34 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-0710aa0b-f2a5-40d3-82db-b2ebe2d32ad7 tempest-VolumesGetTest-1858470535 None] Volume 336f56bd-8c20-4f02-a7b3-dd06237677ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-336f56bd-8c20-4f02-a7b3-dd06237677ee', 'volume_size': 1} Sep 17 22:01:34 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-0710aa0b-f2a5-40d3-82db-b2ebe2d32ad7 tempest-VolumesGetTest-1858470535 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:01:34 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-0710aa0b-f2a5-40d3-82db-b2ebe2d32ad7 tempest-VolumesGetTest-1858470535 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:01:34 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-0710aa0b-f2a5-40d3-82db-b2ebe2d32ad7 tempest-VolumesGetTest-1858470535 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:01:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1304150927',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=336f56bd-8c20-4f02-a7b3-dd06237677ee,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='cfeba540fd8a4d37b58b43b2b38ce1e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:01:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:01:35Z,use_quota=True,user_id='5c1a5bbe85894370877379762b25947b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 22:01:34 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-0710aa0b-f2a5-40d3-82db-b2ebe2d32ad7 tempest-VolumesGetTest-1858470535 None] Creating volume 336f56bd-8c20-4f02-a7b3-dd06237677ee {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 22:01:34 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-0710aa0b-f2a5-40d3-82db-b2ebe2d32ad7 tempest-VolumesGetTest-1858470535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:01:34 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-0710aa0b-f2a5-40d3-82db-b2ebe2d32ad7 tempest-VolumesGetTest-1858470535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:01:34 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-0710aa0b-f2a5-40d3-82db-b2ebe2d32ad7 tempest-VolumesGetTest-1858470535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:01:34 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-0710aa0b-f2a5-40d3-82db-b2ebe2d32ad7 tempest-VolumesGetTest-1858470535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:01:34 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-0710aa0b-f2a5-40d3-82db-b2ebe2d32ad7 tempest-VolumesGetTest-1858470535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:01:34 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-0710aa0b-f2a5-40d3-82db-b2ebe2d32ad7 tempest-VolumesGetTest-1858470535 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 22:01:34 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-0710aa0b-f2a5-40d3-82db-b2ebe2d32ad7 tempest-VolumesGetTest-1858470535 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 22:01:34 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-0710aa0b-f2a5-40d3-82db-b2ebe2d32ad7 tempest-VolumesGetTest-1858470535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-336f56bd-8c20-4f02-a7b3-dd06237677ee 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:01:34 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-71860aab-2cb5-4ca4-8b50-a00278a16b1c tempest-VolumesListAdminTestJSON-575169026 None] Created volume successfully. Sep 17 22:01:34 devstack sudo[97156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-336f56bd-8c20-4f02-a7b3-dd06237677ee 1073741824 Sep 17 22:01:34 devstack sudo[97156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:01:35 devstack sudo[97156]: pam_unix(sudo:session): session closed for user root Sep 17 22:01:35 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-0710aa0b-f2a5-40d3-82db-b2ebe2d32ad7 tempest-VolumesGetTest-1858470535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-336f56bd-8c20-4f02-a7b3-dd06237677ee 1073741824" returned: 0 in 0.522s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:01:35 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-0710aa0b-f2a5-40d3-82db-b2ebe2d32ad7 tempest-VolumesGetTest-1858470535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-336f56bd-8c20-4f02-a7b3-dd06237677ee {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:01:35 devstack sudo[97162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-336f56bd-8c20-4f02-a7b3-dd06237677ee Sep 17 22:01:35 devstack sudo[97162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:01:35 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-204691ac-f62f-4e18-98be-3368683063b1 tempest-VolumesListAdminTestJSON-575169026 None] Acquiring lock "cinder-60b78020-feef-49a1-b034-9c5ff6fb6e9d-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:01:35 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-204691ac-f62f-4e18-98be-3368683063b1 tempest-VolumesListAdminTestJSON-575169026 None] Lock "cinder-60b78020-feef-49a1-b034-9c5ff6fb6e9d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:01:35 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-204691ac-f62f-4e18-98be-3368683063b1 tempest-VolumesListAdminTestJSON-575169026 None] Acquiring lock "cinder-quobyte-60b78020-feef-49a1-b034-9c5ff6fb6e9d" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:01:35 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-204691ac-f62f-4e18-98be-3368683063b1 tempest-VolumesListAdminTestJSON-575169026 None] Lock "cinder-quobyte-60b78020-feef-49a1-b034-9c5ff6fb6e9d" acquired by "delete_volume" :: waited 0.027s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:01:35 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cb850b0-e87d-4ba1-983b-06c8f97cac9e]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:01:35 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-204691ac-f62f-4e18-98be-3368683063b1 tempest-VolumesListAdminTestJSON-575169026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-60b78020-feef-49a1-b034-9c5ff6fb6e9d {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:01:35 devstack sudo[97162]: pam_unix(sudo:session): session closed for user root Sep 17 22:01:35 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-0710aa0b-f2a5-40d3-82db-b2ebe2d32ad7 tempest-VolumesGetTest-1858470535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-336f56bd-8c20-4f02-a7b3-dd06237677ee" returned: 0 in 0.551s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:01:35 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-0710aa0b-f2a5-40d3-82db-b2ebe2d32ad7 tempest-VolumesGetTest-1858470535 None] <== create_volume: return (1136ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 22:01:35 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-0710aa0b-f2a5-40d3-82db-b2ebe2d32ad7 tempest-VolumesGetTest-1858470535 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.139s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:01:36 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-7834a542-1e8a-41bc-81ad-220ad7ee8520 tempest-VolumesListAdminTestJSON-1251321820 None] Acquiring lock "cinder-0b57804c-692c-4ff4-a5b3-56d84f74379d-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:01:36 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-0710aa0b-f2a5-40d3-82db-b2ebe2d32ad7 tempest-VolumesGetTest-1858470535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea8efdf7-6383-4b00-9c0a-8cdd7b7bf4bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-336f56bd-8c20-4f02-a7b3-dd06237677ee', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:01:36 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-0710aa0b-f2a5-40d3-82db-b2ebe2d32ad7 tempest-VolumesGetTest-1858470535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0741a1e3-e59a-4d6e-bc7d-96f19adc4055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:01:36 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-7834a542-1e8a-41bc-81ad-220ad7ee8520 tempest-VolumesListAdminTestJSON-1251321820 None] Lock "cinder-0b57804c-692c-4ff4-a5b3-56d84f74379d-delete_volume" acquired by "delete_volume" :: waited 0.084s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:01:36 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-0710aa0b-f2a5-40d3-82db-b2ebe2d32ad7 tempest-VolumesGetTest-1858470535 None] Volume volume-336f56bd-8c20-4f02-a7b3-dd06237677ee (336f56bd-8c20-4f02-a7b3-dd06237677ee): created successfully Sep 17 22:01:36 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-0710aa0b-f2a5-40d3-82db-b2ebe2d32ad7 tempest-VolumesGetTest-1858470535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0741a1e3-e59a-4d6e-bc7d-96f19adc4055) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:01:36 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-0710aa0b-f2a5-40d3-82db-b2ebe2d32ad7 tempest-VolumesGetTest-1858470535 None] Flow 'volume_create_manager' (60ffb759-a63b-4df8-bde4-02232a69c08c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:01:36 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-7998ebbd-7a14-4ebe-a22c-ad73bf5e5cb8 tempest-TestServerVolumeAttachScenarioOldVersion-962422284 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 22:01:36 devstack sudo[97165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-60b78020-feef-49a1-b034-9c5ff6fb6e9d Sep 17 22:01:36 devstack sudo[97165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:01:36 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-7998ebbd-7a14-4ebe-a22c-ad73bf5e5cb8 tempest-TestServerVolumeAttachScenarioOldVersion-962422284 None] Flow 'volume_create_manager' (4429bebc-d47c-4fd0-8622-686622439c5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:01:36 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-7998ebbd-7a14-4ebe-a22c-ad73bf5e5cb8 tempest-TestServerVolumeAttachScenarioOldVersion-962422284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb25745d-4d0a-41da-95c3-2fd4ce55c63f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:01:36 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-7998ebbd-7a14-4ebe-a22c-ad73bf5e5cb8 tempest-TestServerVolumeAttachScenarioOldVersion-962422284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb25745d-4d0a-41da-95c3-2fd4ce55c63f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:01:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1494777287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b56f47df-f201-408d-8c2f-013b6969d37d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d19b8383fbbc41faa9a0ae9ac8af52d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:01:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:01:36Z,use_quota=True,user_id='3630ab2c47014738899fd8d09eed7549',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:01:36 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-7998ebbd-7a14-4ebe-a22c-ad73bf5e5cb8 tempest-TestServerVolumeAttachScenarioOldVersion-962422284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (650c8240-dbac-4fee-8e31-ccb08e766513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:01:36 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-7998ebbd-7a14-4ebe-a22c-ad73bf5e5cb8 tempest-TestServerVolumeAttachScenarioOldVersion-962422284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (650c8240-dbac-4fee-8e31-ccb08e766513) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:01:36 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-7998ebbd-7a14-4ebe-a22c-ad73bf5e5cb8 tempest-TestServerVolumeAttachScenarioOldVersion-962422284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (234126fa-f095-4078-8a5d-fb3e80c9ffad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:01:36 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-7998ebbd-7a14-4ebe-a22c-ad73bf5e5cb8 tempest-TestServerVolumeAttachScenarioOldVersion-962422284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (234126fa-f095-4078-8a5d-fb3e80c9ffad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b56f47df-f201-408d-8c2f-013b6969d37d', 'volume_name': 'volume-b56f47df-f201-408d-8c2f-013b6969d37d', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:01:36 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-7998ebbd-7a14-4ebe-a22c-ad73bf5e5cb8 tempest-TestServerVolumeAttachScenarioOldVersion-962422284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe0e5f57-fd6b-409b-8d21-16e0e0be286e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:01:36 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-7998ebbd-7a14-4ebe-a22c-ad73bf5e5cb8 tempest-TestServerVolumeAttachScenarioOldVersion-962422284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe0e5f57-fd6b-409b-8d21-16e0e0be286e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:01:36 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-7998ebbd-7a14-4ebe-a22c-ad73bf5e5cb8 tempest-TestServerVolumeAttachScenarioOldVersion-962422284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8acaf499-1ee0-4609-8bf9-b955a496bb32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:01:36 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-7998ebbd-7a14-4ebe-a22c-ad73bf5e5cb8 tempest-TestServerVolumeAttachScenarioOldVersion-962422284 None] Volume b56f47df-f201-408d-8c2f-013b6969d37d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b56f47df-f201-408d-8c2f-013b6969d37d', 'volume_size': 1} Sep 17 22:01:36 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-7998ebbd-7a14-4ebe-a22c-ad73bf5e5cb8 tempest-TestServerVolumeAttachScenarioOldVersion-962422284 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:01:36 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-7998ebbd-7a14-4ebe-a22c-ad73bf5e5cb8 tempest-TestServerVolumeAttachScenarioOldVersion-962422284 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:01:36 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-7998ebbd-7a14-4ebe-a22c-ad73bf5e5cb8 tempest-TestServerVolumeAttachScenarioOldVersion-962422284 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:01:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1494777287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b56f47df-f201-408d-8c2f-013b6969d37d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d19b8383fbbc41faa9a0ae9ac8af52d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:01:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:01:36Z,use_quota=True,user_id='3630ab2c47014738899fd8d09eed7549',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 22:01:36 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-7998ebbd-7a14-4ebe-a22c-ad73bf5e5cb8 tempest-TestServerVolumeAttachScenarioOldVersion-962422284 None] Creating volume b56f47df-f201-408d-8c2f-013b6969d37d {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 22:01:36 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-7998ebbd-7a14-4ebe-a22c-ad73bf5e5cb8 tempest-TestServerVolumeAttachScenarioOldVersion-962422284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:01:36 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-7998ebbd-7a14-4ebe-a22c-ad73bf5e5cb8 tempest-TestServerVolumeAttachScenarioOldVersion-962422284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:01:36 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-7998ebbd-7a14-4ebe-a22c-ad73bf5e5cb8 tempest-TestServerVolumeAttachScenarioOldVersion-962422284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:01:36 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-7998ebbd-7a14-4ebe-a22c-ad73bf5e5cb8 tempest-TestServerVolumeAttachScenarioOldVersion-962422284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:01:36 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-7998ebbd-7a14-4ebe-a22c-ad73bf5e5cb8 tempest-TestServerVolumeAttachScenarioOldVersion-962422284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:01:36 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-7998ebbd-7a14-4ebe-a22c-ad73bf5e5cb8 tempest-TestServerVolumeAttachScenarioOldVersion-962422284 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 22:01:36 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-7998ebbd-7a14-4ebe-a22c-ad73bf5e5cb8 tempest-TestServerVolumeAttachScenarioOldVersion-962422284 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 22:01:36 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-7998ebbd-7a14-4ebe-a22c-ad73bf5e5cb8 tempest-TestServerVolumeAttachScenarioOldVersion-962422284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b56f47df-f201-408d-8c2f-013b6969d37d 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:01:36 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-0710aa0b-f2a5-40d3-82db-b2ebe2d32ad7 tempest-VolumesGetTest-1858470535 None] Created volume successfully. Sep 17 22:01:36 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-7834a542-1e8a-41bc-81ad-220ad7ee8520 tempest-VolumesListAdminTestJSON-1251321820 None] Acquiring lock "cinder-quobyte-0b57804c-692c-4ff4-a5b3-56d84f74379d" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:01:36 devstack sudo[97171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b56f47df-f201-408d-8c2f-013b6969d37d 1073741824 Sep 17 22:01:36 devstack sudo[97171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:01:36 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-7834a542-1e8a-41bc-81ad-220ad7ee8520 tempest-VolumesListAdminTestJSON-1251321820 None] Lock "cinder-quobyte-0b57804c-692c-4ff4-a5b3-56d84f74379d" acquired by "delete_volume" :: waited 0.033s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:01:36 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[94f4672c-0ea0-46ad-b09a-920919f221ff]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:01:36 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-7834a542-1e8a-41bc-81ad-220ad7ee8520 tempest-VolumesListAdminTestJSON-1251321820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0b57804c-692c-4ff4-a5b3-56d84f74379d {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:01:36 devstack sudo[97165]: pam_unix(sudo:session): session closed for user root Sep 17 22:01:36 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-204691ac-f62f-4e18-98be-3368683063b1 tempest-VolumesListAdminTestJSON-575169026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-60b78020-feef-49a1-b034-9c5ff6fb6e9d" returned: 0 in 0.591s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:01:36 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-204691ac-f62f-4e18-98be-3368683063b1 tempest-VolumesListAdminTestJSON-575169026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-60b78020-feef-49a1-b034-9c5ff6fb6e9d {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:01:36 devstack sudo[97176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0b57804c-692c-4ff4-a5b3-56d84f74379d Sep 17 22:01:36 devstack sudo[97176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:01:36 devstack sudo[97184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-60b78020-feef-49a1-b034-9c5ff6fb6e9d Sep 17 22:01:36 devstack sudo[97184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:01:37 devstack sudo[97184]: pam_unix(sudo:session): session closed for user root Sep 17 22:01:37 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-204691ac-f62f-4e18-98be-3368683063b1 tempest-VolumesListAdminTestJSON-575169026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-60b78020-feef-49a1-b034-9c5ff6fb6e9d" returned: 0 in 0.460s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:01:37 devstack sudo[97176]: pam_unix(sudo:session): session closed for user root Sep 17 22:01:37 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-7834a542-1e8a-41bc-81ad-220ad7ee8520 tempest-VolumesListAdminTestJSON-1251321820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0b57804c-692c-4ff4-a5b3-56d84f74379d" returned: 0 in 0.670s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:01:37 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-7834a542-1e8a-41bc-81ad-220ad7ee8520 tempest-VolumesListAdminTestJSON-1251321820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0b57804c-692c-4ff4-a5b3-56d84f74379d {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:01:37 devstack sudo[97171]: pam_unix(sudo:session): session closed for user root Sep 17 22:01:37 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-204691ac-f62f-4e18-98be-3368683063b1 tempest-VolumesListAdminTestJSON-575169026 None] Lock "cinder-quobyte-60b78020-feef-49a1-b034-9c5ff6fb6e9d" released by "delete_volume" :: held 1.194s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:01:37 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-7998ebbd-7a14-4ebe-a22c-ad73bf5e5cb8 tempest-TestServerVolumeAttachScenarioOldVersion-962422284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b56f47df-f201-408d-8c2f-013b6969d37d 1073741824" returned: 0 in 0.830s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:01:37 devstack sudo[97194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0b57804c-692c-4ff4-a5b3-56d84f74379d Sep 17 22:01:37 devstack sudo[97194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:01:37 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-7998ebbd-7a14-4ebe-a22c-ad73bf5e5cb8 tempest-TestServerVolumeAttachScenarioOldVersion-962422284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b56f47df-f201-408d-8c2f-013b6969d37d {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:01:37 devstack sudo[97196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b56f47df-f201-408d-8c2f-013b6969d37d Sep 17 22:01:37 devstack sudo[97196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:01:37 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-204691ac-f62f-4e18-98be-3368683063b1 tempest-VolumesListAdminTestJSON-575169026 None] Created reservations ['9a98e035-4a33-47f7-ad1d-b240f6ca76c4', 'bc87153d-6102-43a6-81eb-613fd1c8dc13', 'aabe057d-829b-4106-84e7-6ac8c88e8f09', '630fcb06-9b9e-4dda-a352-2c7ea6bbbd68'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:01:37 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-204691ac-f62f-4e18-98be-3368683063b1 tempest-VolumesListAdminTestJSON-575169026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:01:37 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-204691ac-f62f-4e18-98be-3368683063b1 tempest-VolumesListAdminTestJSON-575169026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:01:37 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-204691ac-f62f-4e18-98be-3368683063b1 tempest-VolumesListAdminTestJSON-575169026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:01:37 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-204691ac-f62f-4e18-98be-3368683063b1 tempest-VolumesListAdminTestJSON-575169026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:01:37 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-204691ac-f62f-4e18-98be-3368683063b1 tempest-VolumesListAdminTestJSON-575169026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:01:37 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-204691ac-f62f-4e18-98be-3368683063b1 tempest-VolumesListAdminTestJSON-575169026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:01:37 devstack sudo[97199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:01:37 devstack sudo[97199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:01:37 devstack sudo[97194]: pam_unix(sudo:session): session closed for user root Sep 17 22:01:37 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-7834a542-1e8a-41bc-81ad-220ad7ee8520 tempest-VolumesListAdminTestJSON-1251321820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0b57804c-692c-4ff4-a5b3-56d84f74379d" returned: 0 in 0.403s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:01:37 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-7834a542-1e8a-41bc-81ad-220ad7ee8520 tempest-VolumesListAdminTestJSON-1251321820 None] Lock "cinder-quobyte-0b57804c-692c-4ff4-a5b3-56d84f74379d" released by "delete_volume" :: held 1.147s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:01:37 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-7834a542-1e8a-41bc-81ad-220ad7ee8520 tempest-VolumesListAdminTestJSON-1251321820 None] Created reservations ['0c9a5b46-bdc6-49dd-b633-dbd5969cf29c', '61474482-97d7-4bd6-b690-be323efb1df6', '7a4e43ab-f7e2-4bac-9d4f-05480c55410e', 'ead3d959-a8e8-4190-b4fb-0b5d6ce46749'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:01:37 devstack sudo[97196]: pam_unix(sudo:session): session closed for user root Sep 17 22:01:37 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-7998ebbd-7a14-4ebe-a22c-ad73bf5e5cb8 tempest-TestServerVolumeAttachScenarioOldVersion-962422284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b56f47df-f201-408d-8c2f-013b6969d37d" returned: 0 in 0.522s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:01:37 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-7998ebbd-7a14-4ebe-a22c-ad73bf5e5cb8 tempest-TestServerVolumeAttachScenarioOldVersion-962422284 None] <== create_volume: return (1429ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 22:01:37 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-7998ebbd-7a14-4ebe-a22c-ad73bf5e5cb8 tempest-TestServerVolumeAttachScenarioOldVersion-962422284 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.433s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:01:37 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-7998ebbd-7a14-4ebe-a22c-ad73bf5e5cb8 tempest-TestServerVolumeAttachScenarioOldVersion-962422284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8acaf499-1ee0-4609-8bf9-b955a496bb32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b56f47df-f201-408d-8c2f-013b6969d37d', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:01:37 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-7998ebbd-7a14-4ebe-a22c-ad73bf5e5cb8 tempest-TestServerVolumeAttachScenarioOldVersion-962422284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (409a58af-92b8-4acf-8919-4a728ea403f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:01:37 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-7834a542-1e8a-41bc-81ad-220ad7ee8520 tempest-VolumesListAdminTestJSON-1251321820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:01:37 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-7834a542-1e8a-41bc-81ad-220ad7ee8520 tempest-VolumesListAdminTestJSON-1251321820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:01:37 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-7834a542-1e8a-41bc-81ad-220ad7ee8520 tempest-VolumesListAdminTestJSON-1251321820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:01:37 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-7834a542-1e8a-41bc-81ad-220ad7ee8520 tempest-VolumesListAdminTestJSON-1251321820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:01:37 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-7834a542-1e8a-41bc-81ad-220ad7ee8520 tempest-VolumesListAdminTestJSON-1251321820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:01:37 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-7834a542-1e8a-41bc-81ad-220ad7ee8520 tempest-VolumesListAdminTestJSON-1251321820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:01:37 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-7998ebbd-7a14-4ebe-a22c-ad73bf5e5cb8 tempest-TestServerVolumeAttachScenarioOldVersion-962422284 None] Volume volume-b56f47df-f201-408d-8c2f-013b6969d37d (b56f47df-f201-408d-8c2f-013b6969d37d): created successfully Sep 17 22:01:37 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-7998ebbd-7a14-4ebe-a22c-ad73bf5e5cb8 tempest-TestServerVolumeAttachScenarioOldVersion-962422284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (409a58af-92b8-4acf-8919-4a728ea403f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:01:37 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-7998ebbd-7a14-4ebe-a22c-ad73bf5e5cb8 tempest-TestServerVolumeAttachScenarioOldVersion-962422284 None] Flow 'volume_create_manager' (4429bebc-d47c-4fd0-8622-686622439c5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:01:37 devstack sudo[97204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:01:37 devstack sudo[97204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:01:37 devstack sudo[97199]: pam_unix(sudo:session): session closed for user root Sep 17 22:01:37 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-204691ac-f62f-4e18-98be-3368683063b1 tempest-VolumesListAdminTestJSON-575169026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.410s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:01:37 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-204691ac-f62f-4e18-98be-3368683063b1 tempest-VolumesListAdminTestJSON-575169026 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:01:37 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-7998ebbd-7a14-4ebe-a22c-ad73bf5e5cb8 tempest-TestServerVolumeAttachScenarioOldVersion-962422284 None] Created volume successfully. Sep 17 22:01:37 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-204691ac-f62f-4e18-98be-3368683063b1 tempest-VolumesListAdminTestJSON-575169026 None] Deleted volume successfully. Sep 17 22:01:37 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-204691ac-f62f-4e18-98be-3368683063b1 tempest-VolumesListAdminTestJSON-575169026 None] Lock "cinder-60b78020-feef-49a1-b034-9c5ff6fb6e9d-delete_volume" released by "delete_volume" :: held 2.024s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:01:38 devstack sudo[97204]: pam_unix(sudo:session): session closed for user root Sep 17 22:01:38 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-7834a542-1e8a-41bc-81ad-220ad7ee8520 tempest-VolumesListAdminTestJSON-1251321820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.343s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:01:38 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-7834a542-1e8a-41bc-81ad-220ad7ee8520 tempest-VolumesListAdminTestJSON-1251321820 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:01:38 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-7834a542-1e8a-41bc-81ad-220ad7ee8520 tempest-VolumesListAdminTestJSON-1251321820 None] Deleted volume successfully. Sep 17 22:01:38 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-7834a542-1e8a-41bc-81ad-220ad7ee8520 tempest-VolumesListAdminTestJSON-1251321820 None] Lock "cinder-0b57804c-692c-4ff4-a5b3-56d84f74379d-delete_volume" released by "delete_volume" :: held 2.019s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:01:38 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-9faef5c6-6857-4f8e-8030-1008d69bb129 tempest-VolumesGetTest-1858470535 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 22:01:38 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-9faef5c6-6857-4f8e-8030-1008d69bb129 tempest-VolumesGetTest-1858470535 None] Flow 'volume_create_manager' (e96e610c-e542-47a1-beb9-3499f8c3c158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:01:38 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-9faef5c6-6857-4f8e-8030-1008d69bb129 tempest-VolumesGetTest-1858470535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f54cd666-e9f8-46f2-97dd-97944e39394f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:01:38 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-9faef5c6-6857-4f8e-8030-1008d69bb129 tempest-VolumesGetTest-1858470535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f54cd666-e9f8-46f2-97dd-97944e39394f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:01:38Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-198647536',display_name='tempest-VolumesGetTest-Volume-38087418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b280458f-df37-48b5-b12c-1843c67ed643,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfeba540fd8a4d37b58b43b2b38ce1e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:01:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:01:38Z,use_quota=True,user_id='5c1a5bbe85894370877379762b25947b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:01:38 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-9faef5c6-6857-4f8e-8030-1008d69bb129 tempest-VolumesGetTest-1858470535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd600512-f621-4e61-8d4c-347b86e4110e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:01:38 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-9faef5c6-6857-4f8e-8030-1008d69bb129 tempest-VolumesGetTest-1858470535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd600512-f621-4e61-8d4c-347b86e4110e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:01:38 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-9faef5c6-6857-4f8e-8030-1008d69bb129 tempest-VolumesGetTest-1858470535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c981876-6c64-42fb-967b-acc633c766a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:01:38 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-9faef5c6-6857-4f8e-8030-1008d69bb129 tempest-VolumesGetTest-1858470535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c981876-6c64-42fb-967b-acc633c766a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b280458f-df37-48b5-b12c-1843c67ed643', 'volume_name': 'volume-b280458f-df37-48b5-b12c-1843c67ed643', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:01:38 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-9faef5c6-6857-4f8e-8030-1008d69bb129 tempest-VolumesGetTest-1858470535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (feca7f32-7314-435d-a8fa-1bd413ceec97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:01:38 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-9faef5c6-6857-4f8e-8030-1008d69bb129 tempest-VolumesGetTest-1858470535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (feca7f32-7314-435d-a8fa-1bd413ceec97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:01:38 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-9faef5c6-6857-4f8e-8030-1008d69bb129 tempest-VolumesGetTest-1858470535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff627b48-afeb-43bf-a04e-0591972c106e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:01:38 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-9faef5c6-6857-4f8e-8030-1008d69bb129 tempest-VolumesGetTest-1858470535 None] Volume b280458f-df37-48b5-b12c-1843c67ed643: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b280458f-df37-48b5-b12c-1843c67ed643', 'volume_size': 1} Sep 17 22:01:38 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-9faef5c6-6857-4f8e-8030-1008d69bb129 tempest-VolumesGetTest-1858470535 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:01:38 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-9faef5c6-6857-4f8e-8030-1008d69bb129 tempest-VolumesGetTest-1858470535 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:01:38 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-9faef5c6-6857-4f8e-8030-1008d69bb129 tempest-VolumesGetTest-1858470535 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:01:38Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-198647536',display_name='tempest-VolumesGetTest-Volume-38087418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b280458f-df37-48b5-b12c-1843c67ed643,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfeba540fd8a4d37b58b43b2b38ce1e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:01:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:01:38Z,use_quota=True,user_id='5c1a5bbe85894370877379762b25947b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 22:01:38 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-9faef5c6-6857-4f8e-8030-1008d69bb129 tempest-VolumesGetTest-1858470535 None] Creating volume b280458f-df37-48b5-b12c-1843c67ed643 {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 22:01:38 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-9faef5c6-6857-4f8e-8030-1008d69bb129 tempest-VolumesGetTest-1858470535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:01:38 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-9faef5c6-6857-4f8e-8030-1008d69bb129 tempest-VolumesGetTest-1858470535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:01:38 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-9faef5c6-6857-4f8e-8030-1008d69bb129 tempest-VolumesGetTest-1858470535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:01:38 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-9faef5c6-6857-4f8e-8030-1008d69bb129 tempest-VolumesGetTest-1858470535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:01:38 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-9faef5c6-6857-4f8e-8030-1008d69bb129 tempest-VolumesGetTest-1858470535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:01:38 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-9faef5c6-6857-4f8e-8030-1008d69bb129 tempest-VolumesGetTest-1858470535 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 22:01:38 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-9faef5c6-6857-4f8e-8030-1008d69bb129 tempest-VolumesGetTest-1858470535 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 22:01:38 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-9faef5c6-6857-4f8e-8030-1008d69bb129 tempest-VolumesGetTest-1858470535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b280458f-df37-48b5-b12c-1843c67ed643 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:01:38 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-190b9301-c0b3-48e0-bc84-6ddb35d54089 tempest-VolumesListAdminTestJSON-1251321820 None] Acquiring lock "cinder-61c82f6a-d8ec-4ab3-ac7e-89dc923a8909-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:01:38 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-190b9301-c0b3-48e0-bc84-6ddb35d54089 tempest-VolumesListAdminTestJSON-1251321820 None] Lock "cinder-61c82f6a-d8ec-4ab3-ac7e-89dc923a8909-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:01:38 devstack sudo[97210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b280458f-df37-48b5-b12c-1843c67ed643 1073741824 Sep 17 22:01:38 devstack sudo[97210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:01:38 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-190b9301-c0b3-48e0-bc84-6ddb35d54089 tempest-VolumesListAdminTestJSON-1251321820 None] Acquiring lock "cinder-quobyte-61c82f6a-d8ec-4ab3-ac7e-89dc923a8909" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:01:38 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-190b9301-c0b3-48e0-bc84-6ddb35d54089 tempest-VolumesListAdminTestJSON-1251321820 None] Lock "cinder-quobyte-61c82f6a-d8ec-4ab3-ac7e-89dc923a8909" acquired by "delete_volume" :: waited 0.022s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:01:38 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2f11de7-c9cf-4d48-9f08-9165e209321c]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:01:38 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-190b9301-c0b3-48e0-bc84-6ddb35d54089 tempest-VolumesListAdminTestJSON-1251321820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-61c82f6a-d8ec-4ab3-ac7e-89dc923a8909 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:01:38 devstack sudo[97212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-61c82f6a-d8ec-4ab3-ac7e-89dc923a8909 Sep 17 22:01:38 devstack sudo[97212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:01:39 devstack sudo[97212]: pam_unix(sudo:session): session closed for user root Sep 17 22:01:39 devstack sudo[97210]: pam_unix(sudo:session): session closed for user root Sep 17 22:01:39 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-190b9301-c0b3-48e0-bc84-6ddb35d54089 tempest-VolumesListAdminTestJSON-1251321820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-61c82f6a-d8ec-4ab3-ac7e-89dc923a8909" returned: 0 in 0.489s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:01:39 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-190b9301-c0b3-48e0-bc84-6ddb35d54089 tempest-VolumesListAdminTestJSON-1251321820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-61c82f6a-d8ec-4ab3-ac7e-89dc923a8909 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:01:39 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-9faef5c6-6857-4f8e-8030-1008d69bb129 tempest-VolumesGetTest-1858470535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b280458f-df37-48b5-b12c-1843c67ed643 1073741824" returned: 0 in 0.646s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:01:39 devstack sudo[97223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-61c82f6a-d8ec-4ab3-ac7e-89dc923a8909 Sep 17 22:01:39 devstack sudo[97223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:01:39 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-9faef5c6-6857-4f8e-8030-1008d69bb129 tempest-VolumesGetTest-1858470535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b280458f-df37-48b5-b12c-1843c67ed643 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:01:39 devstack sudo[97225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b280458f-df37-48b5-b12c-1843c67ed643 Sep 17 22:01:39 devstack sudo[97225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:01:39 devstack sudo[97223]: pam_unix(sudo:session): session closed for user root Sep 17 22:01:39 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-190b9301-c0b3-48e0-bc84-6ddb35d54089 tempest-VolumesListAdminTestJSON-1251321820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-61c82f6a-d8ec-4ab3-ac7e-89dc923a8909" returned: 0 in 0.367s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:01:39 devstack sudo[97225]: pam_unix(sudo:session): session closed for user root Sep 17 22:01:39 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-190b9301-c0b3-48e0-bc84-6ddb35d54089 tempest-VolumesListAdminTestJSON-1251321820 None] Lock "cinder-quobyte-61c82f6a-d8ec-4ab3-ac7e-89dc923a8909" released by "delete_volume" :: held 0.914s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:01:39 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-9faef5c6-6857-4f8e-8030-1008d69bb129 tempest-VolumesGetTest-1858470535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b280458f-df37-48b5-b12c-1843c67ed643" returned: 0 in 0.334s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:01:39 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-9faef5c6-6857-4f8e-8030-1008d69bb129 tempest-VolumesGetTest-1858470535 None] <== create_volume: return (1042ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 22:01:39 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-9faef5c6-6857-4f8e-8030-1008d69bb129 tempest-VolumesGetTest-1858470535 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.045s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:01:39 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-9faef5c6-6857-4f8e-8030-1008d69bb129 tempest-VolumesGetTest-1858470535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff627b48-afeb-43bf-a04e-0591972c106e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b280458f-df37-48b5-b12c-1843c67ed643', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:01:39 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-9faef5c6-6857-4f8e-8030-1008d69bb129 tempest-VolumesGetTest-1858470535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52ae02cc-ce58-4a90-945a-170f43b3667b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:01:39 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-9faef5c6-6857-4f8e-8030-1008d69bb129 tempest-VolumesGetTest-1858470535 None] Volume volume-b280458f-df37-48b5-b12c-1843c67ed643 (b280458f-df37-48b5-b12c-1843c67ed643): created successfully Sep 17 22:01:39 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-9faef5c6-6857-4f8e-8030-1008d69bb129 tempest-VolumesGetTest-1858470535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52ae02cc-ce58-4a90-945a-170f43b3667b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:01:39 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-9faef5c6-6857-4f8e-8030-1008d69bb129 tempest-VolumesGetTest-1858470535 None] Flow 'volume_create_manager' (e96e610c-e542-47a1-beb9-3499f8c3c158) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:01:39 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-9faef5c6-6857-4f8e-8030-1008d69bb129 tempest-VolumesGetTest-1858470535 None] Created volume successfully. Sep 17 22:01:39 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-190b9301-c0b3-48e0-bc84-6ddb35d54089 tempest-VolumesListAdminTestJSON-1251321820 None] Created reservations ['ee9321c7-105a-436f-b155-17cce6bb758e', 'c187237a-bd72-43dd-a68d-0592d6ec2363', '353fa097-e1b5-486c-a88c-54691653ae0a', '1ba65602-be97-42d8-a192-1bac198335bf'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:01:39 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-190b9301-c0b3-48e0-bc84-6ddb35d54089 tempest-VolumesListAdminTestJSON-1251321820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:01:39 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-190b9301-c0b3-48e0-bc84-6ddb35d54089 tempest-VolumesListAdminTestJSON-1251321820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:01:39 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-190b9301-c0b3-48e0-bc84-6ddb35d54089 tempest-VolumesListAdminTestJSON-1251321820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:01:39 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-190b9301-c0b3-48e0-bc84-6ddb35d54089 tempest-VolumesListAdminTestJSON-1251321820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:01:39 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-190b9301-c0b3-48e0-bc84-6ddb35d54089 tempest-VolumesListAdminTestJSON-1251321820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:01:39 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-190b9301-c0b3-48e0-bc84-6ddb35d54089 tempest-VolumesListAdminTestJSON-1251321820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:01:39 devstack sudo[97237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:01:39 devstack sudo[97237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:01:39 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [req-1be180b0-4d10-4d84-8e4f-43927f2325ea req-8e60234d-e708-4bba-bbfc-9c5fe24c3280 tempest-TestServerVolumeAttachScenarioOldVersion-962422284 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:01:39 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [req-1be180b0-4d10-4d84-8e4f-43927f2325ea req-8e60234d-e708-4bba-bbfc-9c5fe24c3280 tempest-TestServerVolumeAttachScenarioOldVersion-962422284 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:01:39 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [req-1be180b0-4d10-4d84-8e4f-43927f2325ea req-8e60234d-e708-4bba-bbfc-9c5fe24c3280 tempest-TestServerVolumeAttachScenarioOldVersion-962422284 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:01:39 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [req-1be180b0-4d10-4d84-8e4f-43927f2325ea req-8e60234d-e708-4bba-bbfc-9c5fe24c3280 tempest-TestServerVolumeAttachScenarioOldVersion-962422284 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5', 'name': 'volume-b56f47df-f201-408d-8c2f-013b6969d37d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0e31d61d-bc13-47cb-9347-caa4a51ea708', 'enforce_multipath': True} {{(pid=85458) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 22:01:39 devstack cinder-volume[85458]: INFO cinder.volume.manager [req-1be180b0-4d10-4d84-8e4f-43927f2325ea req-8e60234d-e708-4bba-bbfc-9c5fe24c3280 tempest-TestServerVolumeAttachScenarioOldVersion-962422284 None] attachment_update completed successfully. Sep 17 22:01:40 devstack sudo[97237]: pam_unix(sudo:session): session closed for user root Sep 17 22:01:40 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-190b9301-c0b3-48e0-bc84-6ddb35d54089 tempest-VolumesListAdminTestJSON-1251321820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.315s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:01:40 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-190b9301-c0b3-48e0-bc84-6ddb35d54089 tempest-VolumesListAdminTestJSON-1251321820 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:01:40 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-190b9301-c0b3-48e0-bc84-6ddb35d54089 tempest-VolumesListAdminTestJSON-1251321820 None] Deleted volume successfully. Sep 17 22:01:40 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-77233634-248c-41ff-8790-a567e892e634 tempest-AbsoluteLimitsTests-799297672 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 22:01:40 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-77233634-248c-41ff-8790-a567e892e634 tempest-AbsoluteLimitsTests-799297672 None] Flow 'volume_create_manager' (92ed31ca-52e3-4a5e-ad91-dce03f9260d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:01:40 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-77233634-248c-41ff-8790-a567e892e634 tempest-AbsoluteLimitsTests-799297672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76c32128-672a-4ded-8929-63ebf146897e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:01:40 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-77233634-248c-41ff-8790-a567e892e634 tempest-AbsoluteLimitsTests-799297672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76c32128-672a-4ded-8929-63ebf146897e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:01:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-344384829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5fbe92e-1dac-43f1-8dc3-70a5143510e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9beafb5a62a04fc09da84807080347c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:01:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:01:40Z,use_quota=True,user_id='4c916072c63a4031af77a75690ba4ac1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:01:40 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-77233634-248c-41ff-8790-a567e892e634 tempest-AbsoluteLimitsTests-799297672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3e11863-3661-405e-8d41-3bc26cada6f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:01:40 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-77233634-248c-41ff-8790-a567e892e634 tempest-AbsoluteLimitsTests-799297672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3e11863-3661-405e-8d41-3bc26cada6f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:01:40 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-77233634-248c-41ff-8790-a567e892e634 tempest-AbsoluteLimitsTests-799297672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5ae122a-f282-4380-aa19-b32b4589fdc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:01:40 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-77233634-248c-41ff-8790-a567e892e634 tempest-AbsoluteLimitsTests-799297672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5ae122a-f282-4380-aa19-b32b4589fdc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5fbe92e-1dac-43f1-8dc3-70a5143510e7', 'volume_name': 'volume-a5fbe92e-1dac-43f1-8dc3-70a5143510e7', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:01:40 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-77233634-248c-41ff-8790-a567e892e634 tempest-AbsoluteLimitsTests-799297672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11544be7-bfa9-49e0-a932-e9ec8893d701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:01:40 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-77233634-248c-41ff-8790-a567e892e634 tempest-AbsoluteLimitsTests-799297672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11544be7-bfa9-49e0-a932-e9ec8893d701) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:01:40 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-77233634-248c-41ff-8790-a567e892e634 tempest-AbsoluteLimitsTests-799297672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21150419-56de-4047-93f1-bbfd578f0f01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:01:40 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-77233634-248c-41ff-8790-a567e892e634 tempest-AbsoluteLimitsTests-799297672 None] Volume a5fbe92e-1dac-43f1-8dc3-70a5143510e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5fbe92e-1dac-43f1-8dc3-70a5143510e7', 'volume_size': 1} Sep 17 22:01:40 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-77233634-248c-41ff-8790-a567e892e634 tempest-AbsoluteLimitsTests-799297672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:01:40 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-77233634-248c-41ff-8790-a567e892e634 tempest-AbsoluteLimitsTests-799297672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:01:40 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-77233634-248c-41ff-8790-a567e892e634 tempest-AbsoluteLimitsTests-799297672 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:01:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-344384829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5fbe92e-1dac-43f1-8dc3-70a5143510e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9beafb5a62a04fc09da84807080347c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:01:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:01:40Z,use_quota=True,user_id='4c916072c63a4031af77a75690ba4ac1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 22:01:40 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-77233634-248c-41ff-8790-a567e892e634 tempest-AbsoluteLimitsTests-799297672 None] Creating volume a5fbe92e-1dac-43f1-8dc3-70a5143510e7 {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 22:01:40 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-77233634-248c-41ff-8790-a567e892e634 tempest-AbsoluteLimitsTests-799297672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:01:40 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-77233634-248c-41ff-8790-a567e892e634 tempest-AbsoluteLimitsTests-799297672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:01:40 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-77233634-248c-41ff-8790-a567e892e634 tempest-AbsoluteLimitsTests-799297672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:01:40 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-77233634-248c-41ff-8790-a567e892e634 tempest-AbsoluteLimitsTests-799297672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:01:40 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-77233634-248c-41ff-8790-a567e892e634 tempest-AbsoluteLimitsTests-799297672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:01:40 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-77233634-248c-41ff-8790-a567e892e634 tempest-AbsoluteLimitsTests-799297672 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 22:01:40 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-77233634-248c-41ff-8790-a567e892e634 tempest-AbsoluteLimitsTests-799297672 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 22:01:40 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-77233634-248c-41ff-8790-a567e892e634 tempest-AbsoluteLimitsTests-799297672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a5fbe92e-1dac-43f1-8dc3-70a5143510e7 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:01:40 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-190b9301-c0b3-48e0-bc84-6ddb35d54089 tempest-VolumesListAdminTestJSON-1251321820 None] Lock "cinder-61c82f6a-d8ec-4ab3-ac7e-89dc923a8909-delete_volume" released by "delete_volume" :: held 1.658s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:01:40 devstack sudo[97337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a5fbe92e-1dac-43f1-8dc3-70a5143510e7 1073741824 Sep 17 22:01:40 devstack sudo[97337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:01:40 devstack sudo[97337]: pam_unix(sudo:session): session closed for user root Sep 17 22:01:40 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-77233634-248c-41ff-8790-a567e892e634 tempest-AbsoluteLimitsTests-799297672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a5fbe92e-1dac-43f1-8dc3-70a5143510e7 1073741824" returned: 0 in 0.632s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:01:40 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-77233634-248c-41ff-8790-a567e892e634 tempest-AbsoluteLimitsTests-799297672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a5fbe92e-1dac-43f1-8dc3-70a5143510e7 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:01:40 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-ed657303-4c84-4c4a-8c0f-4595f4af5686 tempest-VolumesGetTest-1858470535 None] Acquiring lock "cinder-b280458f-df37-48b5-b12c-1843c67ed643-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:01:40 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-7904b335-3a77-4bfc-b0d1-7c7a4e406fd7 tempest-VolumesListAdminTestJSON-1251321820 None] Acquiring lock "cinder-08413218-0cb1-4135-bd69-5e08630e659c-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:01:40 devstack sudo[97659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a5fbe92e-1dac-43f1-8dc3-70a5143510e7 Sep 17 22:01:40 devstack sudo[97659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:01:40 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-ed657303-4c84-4c4a-8c0f-4595f4af5686 tempest-VolumesGetTest-1858470535 None] Lock "cinder-b280458f-df37-48b5-b12c-1843c67ed643-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:01:41 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-7904b335-3a77-4bfc-b0d1-7c7a4e406fd7 tempest-VolumesListAdminTestJSON-1251321820 None] Lock "cinder-08413218-0cb1-4135-bd69-5e08630e659c-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:01:41 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-ed657303-4c84-4c4a-8c0f-4595f4af5686 tempest-VolumesGetTest-1858470535 None] Acquiring lock "cinder-quobyte-b280458f-df37-48b5-b12c-1843c67ed643" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:01:41 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-7904b335-3a77-4bfc-b0d1-7c7a4e406fd7 tempest-VolumesListAdminTestJSON-1251321820 None] Acquiring lock "cinder-quobyte-08413218-0cb1-4135-bd69-5e08630e659c" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:01:41 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-ed657303-4c84-4c4a-8c0f-4595f4af5686 tempest-VolumesGetTest-1858470535 None] Lock "cinder-quobyte-b280458f-df37-48b5-b12c-1843c67ed643" acquired by "delete_volume" :: waited 0.018s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:01:41 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-7904b335-3a77-4bfc-b0d1-7c7a4e406fd7 tempest-VolumesListAdminTestJSON-1251321820 None] Lock "cinder-quobyte-08413218-0cb1-4135-bd69-5e08630e659c" acquired by "delete_volume" :: waited 0.030s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:01:41 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[50de0ada-b5f6-4a26-81ed-a72fa46e3ffb]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:01:41 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-ed657303-4c84-4c4a-8c0f-4595f4af5686 tempest-VolumesGetTest-1858470535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b280458f-df37-48b5-b12c-1843c67ed643 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:01:41 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7e03896-5bbf-412d-a639-bc6c1d26bfe2]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:01:41 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-7904b335-3a77-4bfc-b0d1-7c7a4e406fd7 tempest-VolumesListAdminTestJSON-1251321820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-08413218-0cb1-4135-bd69-5e08630e659c {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:01:41 devstack sudo[97659]: pam_unix(sudo:session): session closed for user root Sep 17 22:01:41 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-77233634-248c-41ff-8790-a567e892e634 tempest-AbsoluteLimitsTests-799297672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a5fbe92e-1dac-43f1-8dc3-70a5143510e7" returned: 0 in 0.327s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:01:41 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-77233634-248c-41ff-8790-a567e892e634 tempest-AbsoluteLimitsTests-799297672 None] <== create_volume: return (1016ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 22:01:41 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-77233634-248c-41ff-8790-a567e892e634 tempest-AbsoluteLimitsTests-799297672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.019s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:01:41 devstack sudo[97662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-08413218-0cb1-4135-bd69-5e08630e659c Sep 17 22:01:41 devstack sudo[97661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b280458f-df37-48b5-b12c-1843c67ed643 Sep 17 22:01:41 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-77233634-248c-41ff-8790-a567e892e634 tempest-AbsoluteLimitsTests-799297672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21150419-56de-4047-93f1-bbfd578f0f01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5fbe92e-1dac-43f1-8dc3-70a5143510e7', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:01:41 devstack sudo[97662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:01:41 devstack sudo[97661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:01:41 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-77233634-248c-41ff-8790-a567e892e634 tempest-AbsoluteLimitsTests-799297672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09681105-3602-460a-b695-fcd33385192f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:01:41 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-77233634-248c-41ff-8790-a567e892e634 tempest-AbsoluteLimitsTests-799297672 None] Volume volume-a5fbe92e-1dac-43f1-8dc3-70a5143510e7 (a5fbe92e-1dac-43f1-8dc3-70a5143510e7): created successfully Sep 17 22:01:41 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-77233634-248c-41ff-8790-a567e892e634 tempest-AbsoluteLimitsTests-799297672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09681105-3602-460a-b695-fcd33385192f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:01:41 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-77233634-248c-41ff-8790-a567e892e634 tempest-AbsoluteLimitsTests-799297672 None] Flow 'volume_create_manager' (92ed31ca-52e3-4a5e-ad91-dce03f9260d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:01:41 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-77233634-248c-41ff-8790-a567e892e634 tempest-AbsoluteLimitsTests-799297672 None] Created volume successfully. Sep 17 22:01:41 devstack sudo[97662]: pam_unix(sudo:session): session closed for user root Sep 17 22:01:41 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-7904b335-3a77-4bfc-b0d1-7c7a4e406fd7 tempest-VolumesListAdminTestJSON-1251321820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-08413218-0cb1-4135-bd69-5e08630e659c" returned: 0 in 0.418s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:01:41 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-7904b335-3a77-4bfc-b0d1-7c7a4e406fd7 tempest-VolumesListAdminTestJSON-1251321820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-08413218-0cb1-4135-bd69-5e08630e659c {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:01:41 devstack sudo[97661]: pam_unix(sudo:session): session closed for user root Sep 17 22:01:41 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-ed657303-4c84-4c4a-8c0f-4595f4af5686 tempest-VolumesGetTest-1858470535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b280458f-df37-48b5-b12c-1843c67ed643" returned: 0 in 0.444s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:01:41 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-ed657303-4c84-4c4a-8c0f-4595f4af5686 tempest-VolumesGetTest-1858470535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b280458f-df37-48b5-b12c-1843c67ed643 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:01:41 devstack sudo[97672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-08413218-0cb1-4135-bd69-5e08630e659c Sep 17 22:01:41 devstack sudo[97672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:01:41 devstack sudo[97673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b280458f-df37-48b5-b12c-1843c67ed643 Sep 17 22:01:41 devstack sudo[97673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:01:41 devstack sudo[97672]: pam_unix(sudo:session): session closed for user root Sep 17 22:01:41 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-7904b335-3a77-4bfc-b0d1-7c7a4e406fd7 tempest-VolumesListAdminTestJSON-1251321820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-08413218-0cb1-4135-bd69-5e08630e659c" returned: 0 in 0.258s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:01:41 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-7904b335-3a77-4bfc-b0d1-7c7a4e406fd7 tempest-VolumesListAdminTestJSON-1251321820 None] Lock "cinder-quobyte-08413218-0cb1-4135-bd69-5e08630e659c" released by "delete_volume" :: held 0.724s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:01:41 devstack sudo[97673]: pam_unix(sudo:session): session closed for user root Sep 17 22:01:41 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-ed657303-4c84-4c4a-8c0f-4595f4af5686 tempest-VolumesGetTest-1858470535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b280458f-df37-48b5-b12c-1843c67ed643" returned: 0 in 0.280s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:01:41 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-ed657303-4c84-4c4a-8c0f-4595f4af5686 tempest-VolumesGetTest-1858470535 None] Lock "cinder-quobyte-b280458f-df37-48b5-b12c-1843c67ed643" released by "delete_volume" :: held 0.781s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:01:41 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-7904b335-3a77-4bfc-b0d1-7c7a4e406fd7 tempest-VolumesListAdminTestJSON-1251321820 None] Created reservations ['775c9f3e-5edd-48dd-8170-3d3bf25f8846', '8b4bff0b-7687-4341-84e6-8cb3d8188975', '9e243b5d-a22d-4810-954d-b1baf27d49b3', '27279ec0-76e9-40a2-9431-60cd755df47c'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:01:41 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-ed657303-4c84-4c4a-8c0f-4595f4af5686 tempest-VolumesGetTest-1858470535 None] Created reservations ['995cb4a6-55fb-4cc7-8068-0505fe63eaaa', 'e81c8a30-96f0-493f-b818-9ff179e5a9fc', '728bb14f-78bb-4bf2-8528-520af3d886f1', 'f641afee-e132-468d-b665-9a4bf39c577c'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:01:42 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-7904b335-3a77-4bfc-b0d1-7c7a4e406fd7 tempest-VolumesListAdminTestJSON-1251321820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:01:42 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-7904b335-3a77-4bfc-b0d1-7c7a4e406fd7 tempest-VolumesListAdminTestJSON-1251321820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:01:42 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-7904b335-3a77-4bfc-b0d1-7c7a4e406fd7 tempest-VolumesListAdminTestJSON-1251321820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:01:42 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-7904b335-3a77-4bfc-b0d1-7c7a4e406fd7 tempest-VolumesListAdminTestJSON-1251321820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:01:42 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-7904b335-3a77-4bfc-b0d1-7c7a4e406fd7 tempest-VolumesListAdminTestJSON-1251321820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:01:42 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-7904b335-3a77-4bfc-b0d1-7c7a4e406fd7 tempest-VolumesListAdminTestJSON-1251321820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:01:42 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-ed657303-4c84-4c4a-8c0f-4595f4af5686 tempest-VolumesGetTest-1858470535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:01:42 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-ed657303-4c84-4c4a-8c0f-4595f4af5686 tempest-VolumesGetTest-1858470535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:01:42 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-ed657303-4c84-4c4a-8c0f-4595f4af5686 tempest-VolumesGetTest-1858470535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:01:42 devstack sudo[97678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:01:42 devstack sudo[97678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:01:42 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-ed657303-4c84-4c4a-8c0f-4595f4af5686 tempest-VolumesGetTest-1858470535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:01:42 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-ed657303-4c84-4c4a-8c0f-4595f4af5686 tempest-VolumesGetTest-1858470535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:01:42 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-ed657303-4c84-4c4a-8c0f-4595f4af5686 tempest-VolumesGetTest-1858470535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:01:42 devstack sudo[97680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:01:42 devstack sudo[97680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:01:42 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-5d70fab1-bdfd-404f-9dad-7dab99d140ec tempest-VolumesGetTest-1858470535 None] Acquiring lock "cinder-336f56bd-8c20-4f02-a7b3-dd06237677ee-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:01:42 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-5d70fab1-bdfd-404f-9dad-7dab99d140ec tempest-VolumesGetTest-1858470535 None] Lock "cinder-336f56bd-8c20-4f02-a7b3-dd06237677ee-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:01:42 devstack sudo[97678]: pam_unix(sudo:session): session closed for user root Sep 17 22:01:42 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-7904b335-3a77-4bfc-b0d1-7c7a4e406fd7 tempest-VolumesListAdminTestJSON-1251321820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.359s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:01:42 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-7904b335-3a77-4bfc-b0d1-7c7a4e406fd7 tempest-VolumesListAdminTestJSON-1251321820 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:01:42 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-7904b335-3a77-4bfc-b0d1-7c7a4e406fd7 tempest-VolumesListAdminTestJSON-1251321820 None] Deleted volume successfully. Sep 17 22:01:42 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-5d70fab1-bdfd-404f-9dad-7dab99d140ec tempest-VolumesGetTest-1858470535 None] Acquiring lock "cinder-quobyte-336f56bd-8c20-4f02-a7b3-dd06237677ee" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:01:42 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-7904b335-3a77-4bfc-b0d1-7c7a4e406fd7 tempest-VolumesListAdminTestJSON-1251321820 None] Lock "cinder-08413218-0cb1-4135-bd69-5e08630e659c-delete_volume" released by "delete_volume" :: held 1.501s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:01:42 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-5d70fab1-bdfd-404f-9dad-7dab99d140ec tempest-VolumesGetTest-1858470535 None] Lock "cinder-quobyte-336f56bd-8c20-4f02-a7b3-dd06237677ee" acquired by "delete_volume" :: waited 0.038s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:01:42 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb7925da-82b7-49af-b20f-7532fbff0a17]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:01:42 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-5d70fab1-bdfd-404f-9dad-7dab99d140ec tempest-VolumesGetTest-1858470535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-336f56bd-8c20-4f02-a7b3-dd06237677ee {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:01:42 devstack sudo[97680]: pam_unix(sudo:session): session closed for user root Sep 17 22:01:42 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-ed657303-4c84-4c4a-8c0f-4595f4af5686 tempest-VolumesGetTest-1858470535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.446s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:01:42 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-ed657303-4c84-4c4a-8c0f-4595f4af5686 tempest-VolumesGetTest-1858470535 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:01:42 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-ed657303-4c84-4c4a-8c0f-4595f4af5686 tempest-VolumesGetTest-1858470535 None] Deleted volume successfully. Sep 17 22:01:42 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-ed657303-4c84-4c4a-8c0f-4595f4af5686 tempest-VolumesGetTest-1858470535 None] Lock "cinder-b280458f-df37-48b5-b12c-1843c67ed643-delete_volume" released by "delete_volume" :: held 1.659s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:01:42 devstack sudo[97684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-336f56bd-8c20-4f02-a7b3-dd06237677ee Sep 17 22:01:42 devstack sudo[97684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:01:42 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-f669a4e0-0f00-4b9f-9dcc-99e09dc886fb tempest-AbsoluteLimitsTests-799297672 None] Acquiring lock "cinder-a5fbe92e-1dac-43f1-8dc3-70a5143510e7-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:01:42 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-f669a4e0-0f00-4b9f-9dcc-99e09dc886fb tempest-AbsoluteLimitsTests-799297672 None] Lock "cinder-a5fbe92e-1dac-43f1-8dc3-70a5143510e7-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:01:42 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-f669a4e0-0f00-4b9f-9dcc-99e09dc886fb tempest-AbsoluteLimitsTests-799297672 None] Acquiring lock "cinder-quobyte-a5fbe92e-1dac-43f1-8dc3-70a5143510e7" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:01:43 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-f669a4e0-0f00-4b9f-9dcc-99e09dc886fb tempest-AbsoluteLimitsTests-799297672 None] Lock "cinder-quobyte-a5fbe92e-1dac-43f1-8dc3-70a5143510e7" acquired by "delete_volume" :: waited 0.032s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:01:43 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9714d61-d80c-4c81-89d4-3ad45681b0b5]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:01:43 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-f669a4e0-0f00-4b9f-9dcc-99e09dc886fb tempest-AbsoluteLimitsTests-799297672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a5fbe92e-1dac-43f1-8dc3-70a5143510e7 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:01:43 devstack sudo[97684]: pam_unix(sudo:session): session closed for user root Sep 17 22:01:43 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-5d70fab1-bdfd-404f-9dad-7dab99d140ec tempest-VolumesGetTest-1858470535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-336f56bd-8c20-4f02-a7b3-dd06237677ee" returned: 0 in 0.553s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:01:43 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-5d70fab1-bdfd-404f-9dad-7dab99d140ec tempest-VolumesGetTest-1858470535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-336f56bd-8c20-4f02-a7b3-dd06237677ee {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:01:43 devstack sudo[97717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-336f56bd-8c20-4f02-a7b3-dd06237677ee Sep 17 22:01:43 devstack sudo[97717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:01:43 devstack cinder-volume[85458]: INFO cinder.volume.manager [req-6eeb02a5-fdf7-4b45-aa50-5228c600e93d req-f2d83008-8c31-46b6-962a-df9729cd3b17 tempest-TestServerVolumeAttachScenarioOldVersion-962422284 None] Terminate volume connection completed successfully. Sep 17 22:01:43 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [req-6eeb02a5-fdf7-4b45-aa50-5228c600e93d req-f2d83008-8c31-46b6-962a-df9729cd3b17 tempest-TestServerVolumeAttachScenarioOldVersion-962422284 None] Deleting attachment 0e31d61d-bc13-47cb-9347-caa4a51ea708. {{(pid=85458) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 22:01:43 devstack sudo[97691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a5fbe92e-1dac-43f1-8dc3-70a5143510e7 Sep 17 22:01:43 devstack sudo[97691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:01:43 devstack sudo[97717]: pam_unix(sudo:session): session closed for user root Sep 17 22:01:43 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-5d70fab1-bdfd-404f-9dad-7dab99d140ec tempest-VolumesGetTest-1858470535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-336f56bd-8c20-4f02-a7b3-dd06237677ee" returned: 0 in 0.351s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:01:43 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-5d70fab1-bdfd-404f-9dad-7dab99d140ec tempest-VolumesGetTest-1858470535 None] Lock "cinder-quobyte-336f56bd-8c20-4f02-a7b3-dd06237677ee" released by "delete_volume" :: held 0.973s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:01:43 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-5d70fab1-bdfd-404f-9dad-7dab99d140ec tempest-VolumesGetTest-1858470535 None] Created reservations ['5e7ec799-3dc5-43d6-8a52-9fea3d87e7f0', '14c5ad9c-2404-4b29-bee1-ae265f76b4dd', '9f88308e-4f61-4f55-b0e5-6ff308cd726a', 'eceba00f-8af7-43ac-b001-7ab9cb07d021'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:01:43 devstack sudo[97691]: pam_unix(sudo:session): session closed for user root Sep 17 22:01:43 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-f669a4e0-0f00-4b9f-9dcc-99e09dc886fb tempest-AbsoluteLimitsTests-799297672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a5fbe92e-1dac-43f1-8dc3-70a5143510e7" returned: 0 in 0.568s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:01:43 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-f669a4e0-0f00-4b9f-9dcc-99e09dc886fb tempest-AbsoluteLimitsTests-799297672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a5fbe92e-1dac-43f1-8dc3-70a5143510e7 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:01:43 devstack sudo[97725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a5fbe92e-1dac-43f1-8dc3-70a5143510e7 Sep 17 22:01:43 devstack sudo[97725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:01:43 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-5d70fab1-bdfd-404f-9dad-7dab99d140ec tempest-VolumesGetTest-1858470535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:01:43 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-5d70fab1-bdfd-404f-9dad-7dab99d140ec tempest-VolumesGetTest-1858470535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:01:43 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-5d70fab1-bdfd-404f-9dad-7dab99d140ec tempest-VolumesGetTest-1858470535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:01:43 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-5d70fab1-bdfd-404f-9dad-7dab99d140ec tempest-VolumesGetTest-1858470535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:01:43 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-5d70fab1-bdfd-404f-9dad-7dab99d140ec tempest-VolumesGetTest-1858470535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:01:43 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-5d70fab1-bdfd-404f-9dad-7dab99d140ec tempest-VolumesGetTest-1858470535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:01:43 devstack sudo[97727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:01:43 devstack sudo[97727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:01:43 devstack sudo[97725]: pam_unix(sudo:session): session closed for user root Sep 17 22:01:43 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-f669a4e0-0f00-4b9f-9dcc-99e09dc886fb tempest-AbsoluteLimitsTests-799297672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a5fbe92e-1dac-43f1-8dc3-70a5143510e7" returned: 0 in 0.297s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:01:43 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-f669a4e0-0f00-4b9f-9dcc-99e09dc886fb tempest-AbsoluteLimitsTests-799297672 None] Lock "cinder-quobyte-a5fbe92e-1dac-43f1-8dc3-70a5143510e7" released by "delete_volume" :: held 0.925s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:01:43 devstack sudo[97727]: pam_unix(sudo:session): session closed for user root Sep 17 22:01:44 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-5d70fab1-bdfd-404f-9dad-7dab99d140ec tempest-VolumesGetTest-1858470535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.340s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:01:44 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-5d70fab1-bdfd-404f-9dad-7dab99d140ec tempest-VolumesGetTest-1858470535 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:01:44 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-5d70fab1-bdfd-404f-9dad-7dab99d140ec tempest-VolumesGetTest-1858470535 None] Deleted volume successfully. Sep 17 22:01:44 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-f669a4e0-0f00-4b9f-9dcc-99e09dc886fb tempest-AbsoluteLimitsTests-799297672 None] Created reservations ['cd283435-7ef3-4240-8770-8882e822eb3a', 'e5469f8f-9400-44a8-a68f-c873cc6b4e54', 'c9fda4de-29d1-41a1-8b60-a82cb2a7e5fe', 'b00235e7-38fe-4228-adf9-9afadf060275'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:01:44 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-5d70fab1-bdfd-404f-9dad-7dab99d140ec tempest-VolumesGetTest-1858470535 None] Lock "cinder-336f56bd-8c20-4f02-a7b3-dd06237677ee-delete_volume" released by "delete_volume" :: held 1.648s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:01:44 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-f669a4e0-0f00-4b9f-9dcc-99e09dc886fb tempest-AbsoluteLimitsTests-799297672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:01:44 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-f669a4e0-0f00-4b9f-9dcc-99e09dc886fb tempest-AbsoluteLimitsTests-799297672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:01:44 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-f669a4e0-0f00-4b9f-9dcc-99e09dc886fb tempest-AbsoluteLimitsTests-799297672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:01:44 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-f669a4e0-0f00-4b9f-9dcc-99e09dc886fb tempest-AbsoluteLimitsTests-799297672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:01:44 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-f669a4e0-0f00-4b9f-9dcc-99e09dc886fb tempest-AbsoluteLimitsTests-799297672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:01:44 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-f669a4e0-0f00-4b9f-9dcc-99e09dc886fb tempest-AbsoluteLimitsTests-799297672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:01:44 devstack sudo[97731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:01:44 devstack sudo[97731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:01:44 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-481f0830-adfa-4ce3-a3d4-e5bface2ca12 tempest-TestServerVolumeAttachScenarioOldVersion-962422284 None] Acquiring lock "cinder-b56f47df-f201-408d-8c2f-013b6969d37d-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:01:44 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-481f0830-adfa-4ce3-a3d4-e5bface2ca12 tempest-TestServerVolumeAttachScenarioOldVersion-962422284 None] Lock "cinder-b56f47df-f201-408d-8c2f-013b6969d37d-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:01:44 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-481f0830-adfa-4ce3-a3d4-e5bface2ca12 tempest-TestServerVolumeAttachScenarioOldVersion-962422284 None] Acquiring lock "cinder-quobyte-b56f47df-f201-408d-8c2f-013b6969d37d" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:01:44 devstack sudo[97731]: pam_unix(sudo:session): session closed for user root Sep 17 22:01:44 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-f669a4e0-0f00-4b9f-9dcc-99e09dc886fb tempest-AbsoluteLimitsTests-799297672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.319s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:01:44 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-f669a4e0-0f00-4b9f-9dcc-99e09dc886fb tempest-AbsoluteLimitsTests-799297672 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:01:44 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-f669a4e0-0f00-4b9f-9dcc-99e09dc886fb tempest-AbsoluteLimitsTests-799297672 None] Deleted volume successfully. Sep 17 22:01:44 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-481f0830-adfa-4ce3-a3d4-e5bface2ca12 tempest-TestServerVolumeAttachScenarioOldVersion-962422284 None] Lock "cinder-quobyte-b56f47df-f201-408d-8c2f-013b6969d37d" acquired by "delete_volume" :: waited 0.032s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:01:44 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-f669a4e0-0f00-4b9f-9dcc-99e09dc886fb tempest-AbsoluteLimitsTests-799297672 None] Lock "cinder-a5fbe92e-1dac-43f1-8dc3-70a5143510e7-delete_volume" released by "delete_volume" :: held 1.637s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:01:44 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[d135103e-7bb3-40f3-aa6a-e8ccb318cec4]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:01:44 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-481f0830-adfa-4ce3-a3d4-e5bface2ca12 tempest-TestServerVolumeAttachScenarioOldVersion-962422284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b56f47df-f201-408d-8c2f-013b6969d37d {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:01:44 devstack sudo[97734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b56f47df-f201-408d-8c2f-013b6969d37d Sep 17 22:01:44 devstack sudo[97734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:01:44 devstack sudo[97734]: pam_unix(sudo:session): session closed for user root Sep 17 22:01:44 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-481f0830-adfa-4ce3-a3d4-e5bface2ca12 tempest-TestServerVolumeAttachScenarioOldVersion-962422284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b56f47df-f201-408d-8c2f-013b6969d37d" returned: 0 in 0.433s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:01:44 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-481f0830-adfa-4ce3-a3d4-e5bface2ca12 tempest-TestServerVolumeAttachScenarioOldVersion-962422284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b56f47df-f201-408d-8c2f-013b6969d37d {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:01:45 devstack sudo[97740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b56f47df-f201-408d-8c2f-013b6969d37d Sep 17 22:01:45 devstack sudo[97740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:01:45 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-af0dd422-7a48-466d-8436-bf51ca5e080f tempest-VolumesGetTest-1858470535 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 22:01:45 devstack sudo[97740]: pam_unix(sudo:session): session closed for user root Sep 17 22:01:45 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-af0dd422-7a48-466d-8436-bf51ca5e080f tempest-VolumesGetTest-1858470535 None] Flow 'volume_create_manager' (b6c00050-3e5a-4ea1-b3d3-c5e9b309854c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:01:45 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-af0dd422-7a48-466d-8436-bf51ca5e080f tempest-VolumesGetTest-1858470535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02ead355-5dd3-4eb8-b3ef-e600ad1a5fc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:01:45 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-481f0830-adfa-4ce3-a3d4-e5bface2ca12 tempest-TestServerVolumeAttachScenarioOldVersion-962422284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b56f47df-f201-408d-8c2f-013b6969d37d" returned: 0 in 0.340s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:01:45 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-af0dd422-7a48-466d-8436-bf51ca5e080f tempest-VolumesGetTest-1858470535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02ead355-5dd3-4eb8-b3ef-e600ad1a5fc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:01:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-19937264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f116420a-73e8-4ee2-bb70-973b583e10e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfeba540fd8a4d37b58b43b2b38ce1e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:01:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:01:45Z,use_quota=True,user_id='5c1a5bbe85894370877379762b25947b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:01:45 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-af0dd422-7a48-466d-8436-bf51ca5e080f tempest-VolumesGetTest-1858470535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fc464e5-967b-462d-a121-e4f003dfe59a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:01:45 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-af0dd422-7a48-466d-8436-bf51ca5e080f tempest-VolumesGetTest-1858470535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fc464e5-967b-462d-a121-e4f003dfe59a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:01:45 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-af0dd422-7a48-466d-8436-bf51ca5e080f tempest-VolumesGetTest-1858470535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02d5d532-ec28-47fa-97b1-b7ea83332a60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:01:45 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-af0dd422-7a48-466d-8436-bf51ca5e080f tempest-VolumesGetTest-1858470535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02d5d532-ec28-47fa-97b1-b7ea83332a60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f116420a-73e8-4ee2-bb70-973b583e10e9', 'volume_name': 'volume-f116420a-73e8-4ee2-bb70-973b583e10e9', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:01:45 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-af0dd422-7a48-466d-8436-bf51ca5e080f tempest-VolumesGetTest-1858470535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd9baf47-f7c1-48a7-8f9d-e355dd100326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:01:45 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-af0dd422-7a48-466d-8436-bf51ca5e080f tempest-VolumesGetTest-1858470535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd9baf47-f7c1-48a7-8f9d-e355dd100326) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:01:45 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-af0dd422-7a48-466d-8436-bf51ca5e080f tempest-VolumesGetTest-1858470535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0fff981-9696-4b96-810e-4a96e5a4ac18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:01:45 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-af0dd422-7a48-466d-8436-bf51ca5e080f tempest-VolumesGetTest-1858470535 None] Volume f116420a-73e8-4ee2-bb70-973b583e10e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f116420a-73e8-4ee2-bb70-973b583e10e9', 'volume_size': 1} Sep 17 22:01:45 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-af0dd422-7a48-466d-8436-bf51ca5e080f tempest-VolumesGetTest-1858470535 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:01:45 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-af0dd422-7a48-466d-8436-bf51ca5e080f tempest-VolumesGetTest-1858470535 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:01:45 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-af0dd422-7a48-466d-8436-bf51ca5e080f tempest-VolumesGetTest-1858470535 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:01:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-19937264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f116420a-73e8-4ee2-bb70-973b583e10e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfeba540fd8a4d37b58b43b2b38ce1e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:01:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:01:45Z,use_quota=True,user_id='5c1a5bbe85894370877379762b25947b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 22:01:45 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-af0dd422-7a48-466d-8436-bf51ca5e080f tempest-VolumesGetTest-1858470535 None] Creating volume f116420a-73e8-4ee2-bb70-973b583e10e9 {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 22:01:45 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-af0dd422-7a48-466d-8436-bf51ca5e080f tempest-VolumesGetTest-1858470535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:01:45 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-af0dd422-7a48-466d-8436-bf51ca5e080f tempest-VolumesGetTest-1858470535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:01:45 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-af0dd422-7a48-466d-8436-bf51ca5e080f tempest-VolumesGetTest-1858470535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:01:45 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-af0dd422-7a48-466d-8436-bf51ca5e080f tempest-VolumesGetTest-1858470535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:01:45 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-af0dd422-7a48-466d-8436-bf51ca5e080f tempest-VolumesGetTest-1858470535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:01:45 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-af0dd422-7a48-466d-8436-bf51ca5e080f tempest-VolumesGetTest-1858470535 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 22:01:45 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-af0dd422-7a48-466d-8436-bf51ca5e080f tempest-VolumesGetTest-1858470535 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 22:01:45 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-af0dd422-7a48-466d-8436-bf51ca5e080f tempest-VolumesGetTest-1858470535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f116420a-73e8-4ee2-bb70-973b583e10e9 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:01:45 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-481f0830-adfa-4ce3-a3d4-e5bface2ca12 tempest-TestServerVolumeAttachScenarioOldVersion-962422284 None] Lock "cinder-quobyte-b56f47df-f201-408d-8c2f-013b6969d37d" released by "delete_volume" :: held 0.900s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:01:45 devstack sudo[97743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f116420a-73e8-4ee2-bb70-973b583e10e9 1073741824 Sep 17 22:01:45 devstack sudo[97743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:01:45 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-481f0830-adfa-4ce3-a3d4-e5bface2ca12 tempest-TestServerVolumeAttachScenarioOldVersion-962422284 None] Created reservations ['0d5e82ff-fb1a-4e06-9e73-708c7ec7da7a', '3c3d83d5-f971-497d-9fb8-aeb1269f4971', '79001d5d-b5cd-40a0-9e7c-126df1e8cb8a', '82922d67-95ed-4f19-ab50-8c84c5dae76e'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:01:45 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-481f0830-adfa-4ce3-a3d4-e5bface2ca12 tempest-TestServerVolumeAttachScenarioOldVersion-962422284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:01:45 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-481f0830-adfa-4ce3-a3d4-e5bface2ca12 tempest-TestServerVolumeAttachScenarioOldVersion-962422284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:01:45 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-481f0830-adfa-4ce3-a3d4-e5bface2ca12 tempest-TestServerVolumeAttachScenarioOldVersion-962422284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:01:45 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-481f0830-adfa-4ce3-a3d4-e5bface2ca12 tempest-TestServerVolumeAttachScenarioOldVersion-962422284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:01:45 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-481f0830-adfa-4ce3-a3d4-e5bface2ca12 tempest-TestServerVolumeAttachScenarioOldVersion-962422284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:01:45 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-481f0830-adfa-4ce3-a3d4-e5bface2ca12 tempest-TestServerVolumeAttachScenarioOldVersion-962422284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:01:45 devstack sudo[97748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:01:45 devstack sudo[97748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:01:46 devstack sudo[97743]: pam_unix(sudo:session): session closed for user root Sep 17 22:01:46 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-af0dd422-7a48-466d-8436-bf51ca5e080f tempest-VolumesGetTest-1858470535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f116420a-73e8-4ee2-bb70-973b583e10e9 1073741824" returned: 0 in 0.602s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:01:46 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-af0dd422-7a48-466d-8436-bf51ca5e080f tempest-VolumesGetTest-1858470535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f116420a-73e8-4ee2-bb70-973b583e10e9 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:01:46 devstack sudo[97748]: pam_unix(sudo:session): session closed for user root Sep 17 22:01:46 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-481f0830-adfa-4ce3-a3d4-e5bface2ca12 tempest-TestServerVolumeAttachScenarioOldVersion-962422284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.384s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:01:46 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-481f0830-adfa-4ce3-a3d4-e5bface2ca12 tempest-TestServerVolumeAttachScenarioOldVersion-962422284 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:01:46 devstack sudo[97752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f116420a-73e8-4ee2-bb70-973b583e10e9 Sep 17 22:01:46 devstack sudo[97752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:01:46 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-481f0830-adfa-4ce3-a3d4-e5bface2ca12 tempest-TestServerVolumeAttachScenarioOldVersion-962422284 None] Deleted volume successfully. Sep 17 22:01:46 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-481f0830-adfa-4ce3-a3d4-e5bface2ca12 tempest-TestServerVolumeAttachScenarioOldVersion-962422284 None] Lock "cinder-b56f47df-f201-408d-8c2f-013b6969d37d-delete_volume" released by "delete_volume" :: held 1.696s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:01:46 devstack sudo[97752]: pam_unix(sudo:session): session closed for user root Sep 17 22:01:46 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-af0dd422-7a48-466d-8436-bf51ca5e080f tempest-VolumesGetTest-1858470535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f116420a-73e8-4ee2-bb70-973b583e10e9" returned: 0 in 0.294s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:01:46 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-af0dd422-7a48-466d-8436-bf51ca5e080f tempest-VolumesGetTest-1858470535 None] <== create_volume: return (956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 22:01:46 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-af0dd422-7a48-466d-8436-bf51ca5e080f tempest-VolumesGetTest-1858470535 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.958s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:01:46 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-af0dd422-7a48-466d-8436-bf51ca5e080f tempest-VolumesGetTest-1858470535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0fff981-9696-4b96-810e-4a96e5a4ac18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f116420a-73e8-4ee2-bb70-973b583e10e9', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:01:46 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-af0dd422-7a48-466d-8436-bf51ca5e080f tempest-VolumesGetTest-1858470535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28d231d0-61b7-4d10-a16f-581edc737ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:01:46 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-af0dd422-7a48-466d-8436-bf51ca5e080f tempest-VolumesGetTest-1858470535 None] Volume volume-f116420a-73e8-4ee2-bb70-973b583e10e9 (f116420a-73e8-4ee2-bb70-973b583e10e9): created successfully Sep 17 22:01:46 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-af0dd422-7a48-466d-8436-bf51ca5e080f tempest-VolumesGetTest-1858470535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28d231d0-61b7-4d10-a16f-581edc737ce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:01:46 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-af0dd422-7a48-466d-8436-bf51ca5e080f tempest-VolumesGetTest-1858470535 None] Flow 'volume_create_manager' (b6c00050-3e5a-4ea1-b3d3-c5e9b309854c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:01:46 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-af0dd422-7a48-466d-8436-bf51ca5e080f tempest-VolumesGetTest-1858470535 None] Created volume successfully. Sep 17 22:01:48 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-f44b4130-e8f3-4725-ba1d-6941c93fccf0 tempest-VolumesGetTest-1858470535 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 22:01:48 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-f44b4130-e8f3-4725-ba1d-6941c93fccf0 tempest-VolumesGetTest-1858470535 None] Flow 'volume_create_manager' (ead5e70e-7a3f-4802-a9d7-95fbd7f6668f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:01:48 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-f44b4130-e8f3-4725-ba1d-6941c93fccf0 tempest-VolumesGetTest-1858470535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92b2ae0d-adcb-4b81-9bd4-81fa1dd0a997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:01:48 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-f44b4130-e8f3-4725-ba1d-6941c93fccf0 tempest-VolumesGetTest-1858470535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92b2ae0d-adcb-4b81-9bd4-81fa1dd0a997) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:01:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-207019656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed0f2895-2fea-4e4a-9b3d-271088178f81,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='cfeba540fd8a4d37b58b43b2b38ce1e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:01:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=f116420a-73e8-4ee2-bb70-973b583e10e9,status='creating',terminated_at=None,updated_at=2026-09-17T20:01:48Z,use_quota=True,user_id='5c1a5bbe85894370877379762b25947b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:01:48 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-f44b4130-e8f3-4725-ba1d-6941c93fccf0 tempest-VolumesGetTest-1858470535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11cc1304-696b-48f3-9093-155eb770b0f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:01:48 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-f44b4130-e8f3-4725-ba1d-6941c93fccf0 tempest-VolumesGetTest-1858470535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11cc1304-696b-48f3-9093-155eb770b0f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:01:48 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-f44b4130-e8f3-4725-ba1d-6941c93fccf0 tempest-VolumesGetTest-1858470535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16e32ca4-825f-4f15-bad5-faa9b56db6b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:01:48 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-f44b4130-e8f3-4725-ba1d-6941c93fccf0 tempest-VolumesGetTest-1858470535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16e32ca4-825f-4f15-bad5-faa9b56db6b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'ed0f2895-2fea-4e4a-9b3d-271088178f81', 'volume_name': 'volume-ed0f2895-2fea-4e4a-9b3d-271088178f81', 'volume_size': 1, 'source_volid': 'f116420a-73e8-4ee2-bb70-973b583e10e9', 'source_volstatus': 'available'}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:01:48 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-f44b4130-e8f3-4725-ba1d-6941c93fccf0 tempest-VolumesGetTest-1858470535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49e42030-1600-4f2d-b476-4b805cd9b779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:01:48 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-f44b4130-e8f3-4725-ba1d-6941c93fccf0 tempest-VolumesGetTest-1858470535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49e42030-1600-4f2d-b476-4b805cd9b779) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:01:48 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-f44b4130-e8f3-4725-ba1d-6941c93fccf0 tempest-VolumesGetTest-1858470535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42daba0d-a3f4-408c-a673-2f49d17f703c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:01:48 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-f44b4130-e8f3-4725-ba1d-6941c93fccf0 tempest-VolumesGetTest-1858470535 None] Volume ed0f2895-2fea-4e4a-9b3d-271088178f81: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-ed0f2895-2fea-4e4a-9b3d-271088178f81', 'volume_size': 1, 'source_volid': 'f116420a-73e8-4ee2-bb70-973b583e10e9', 'source_volstatus': 'available'} Sep 17 22:01:48 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-f44b4130-e8f3-4725-ba1d-6941c93fccf0 tempest-VolumesGetTest-1858470535 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:01:48 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-f44b4130-e8f3-4725-ba1d-6941c93fccf0 tempest-VolumesGetTest-1858470535 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:01:48 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-f44b4130-e8f3-4725-ba1d-6941c93fccf0 tempest-VolumesGetTest-1858470535 None] Cloning volume f116420a-73e8-4ee2-bb70-973b583e10e9 to volume ed0f2895-2fea-4e4a-9b3d-271088178f81 Sep 17 22:01:48 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-f44b4130-e8f3-4725-ba1d-6941c93fccf0 tempest-VolumesGetTest-1858470535 None] Creating offline snapshot c4a17d3a-5c83-4afd-97f9-37728f79236a of volume f116420a-73e8-4ee2-bb70-973b583e10e9 {{(pid=85458) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 22:01:48 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ea037e7-f3f7-4cdb-bbb9-bda2d9b67cda]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:01:48 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-f44b4130-e8f3-4725-ba1d-6941c93fccf0 tempest-VolumesGetTest-1858470535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f116420a-73e8-4ee2-bb70-973b583e10e9 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:01:48 devstack sudo[97777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f116420a-73e8-4ee2-bb70-973b583e10e9 Sep 17 22:01:48 devstack sudo[97777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:01:49 devstack sudo[97777]: pam_unix(sudo:session): session closed for user root Sep 17 22:01:49 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-f44b4130-e8f3-4725-ba1d-6941c93fccf0 tempest-VolumesGetTest-1858470535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f116420a-73e8-4ee2-bb70-973b583e10e9" returned: 0 in 0.557s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:01:49 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-f44b4130-e8f3-4725-ba1d-6941c93fccf0 tempest-VolumesGetTest-1858470535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f116420a-73e8-4ee2-bb70-973b583e10e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f116420a-73e8-4ee2-bb70-973b583e10e9.c4a17d3a-5c83-4afd-97f9-37728f79236a 1G {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:01:49 devstack sudo[97785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f116420a-73e8-4ee2-bb70-973b583e10e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f116420a-73e8-4ee2-bb70-973b583e10e9.c4a17d3a-5c83-4afd-97f9-37728f79236a 1G Sep 17 22:01:49 devstack sudo[97785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:01:49 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-219420e2-6edc-47ce-8ff7-3d3a005124e5 tempest-SnapshotMetadataTestJSON-1264006369 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 22:01:49 devstack sudo[97785]: pam_unix(sudo:session): session closed for user root Sep 17 22:01:49 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-219420e2-6edc-47ce-8ff7-3d3a005124e5 tempest-SnapshotMetadataTestJSON-1264006369 None] Flow 'volume_create_manager' (474abefd-9a49-42c0-90aa-26ed20e07dfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:01:49 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-219420e2-6edc-47ce-8ff7-3d3a005124e5 tempest-SnapshotMetadataTestJSON-1264006369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fba6c9fc-ac8a-4fcd-9c5b-b9ef5cc64f72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:01:49 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-f44b4130-e8f3-4725-ba1d-6941c93fccf0 tempest-VolumesGetTest-1858470535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f116420a-73e8-4ee2-bb70-973b583e10e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f116420a-73e8-4ee2-bb70-973b583e10e9.c4a17d3a-5c83-4afd-97f9-37728f79236a 1G" returned: 0 in 0.663s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:01:49 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-f44b4130-e8f3-4725-ba1d-6941c93fccf0 tempest-VolumesGetTest-1858470535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f116420a-73e8-4ee2-bb70-973b583e10e9 -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f116420a-73e8-4ee2-bb70-973b583e10e9.c4a17d3a-5c83-4afd-97f9-37728f79236a {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:01:49 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-219420e2-6edc-47ce-8ff7-3d3a005124e5 tempest-SnapshotMetadataTestJSON-1264006369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fba6c9fc-ac8a-4fcd-9c5b-b9ef5cc64f72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:01:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1975394505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc7c3f93-799a-4265-a573-e5b97a67ee23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7453a7bd48ad4ba0be6a0e0c185cf1d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:01:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:01:50Z,use_quota=True,user_id='5c009c5fb15e4e5390892606aa067934',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:01:49 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-219420e2-6edc-47ce-8ff7-3d3a005124e5 tempest-SnapshotMetadataTestJSON-1264006369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cb639de-eb18-4f5c-bdd9-151f3fe740ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:01:49 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-219420e2-6edc-47ce-8ff7-3d3a005124e5 tempest-SnapshotMetadataTestJSON-1264006369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cb639de-eb18-4f5c-bdd9-151f3fe740ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:01:49 devstack sudo[97792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f116420a-73e8-4ee2-bb70-973b583e10e9 -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f116420a-73e8-4ee2-bb70-973b583e10e9.c4a17d3a-5c83-4afd-97f9-37728f79236a Sep 17 22:01:49 devstack sudo[97792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:01:49 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-219420e2-6edc-47ce-8ff7-3d3a005124e5 tempest-SnapshotMetadataTestJSON-1264006369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bd884fd-482c-4de6-8c7d-5787cd9ee364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:01:49 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-219420e2-6edc-47ce-8ff7-3d3a005124e5 tempest-SnapshotMetadataTestJSON-1264006369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bd884fd-482c-4de6-8c7d-5787cd9ee364) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc7c3f93-799a-4265-a573-e5b97a67ee23', 'volume_name': 'volume-dc7c3f93-799a-4265-a573-e5b97a67ee23', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:01:49 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-219420e2-6edc-47ce-8ff7-3d3a005124e5 tempest-SnapshotMetadataTestJSON-1264006369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96a82915-92f2-4cd0-9f6a-5e217b9b5352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:01:49 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-219420e2-6edc-47ce-8ff7-3d3a005124e5 tempest-SnapshotMetadataTestJSON-1264006369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96a82915-92f2-4cd0-9f6a-5e217b9b5352) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:01:49 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-219420e2-6edc-47ce-8ff7-3d3a005124e5 tempest-SnapshotMetadataTestJSON-1264006369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6a9dbc2-02b1-4333-9e6d-50b3f9971ed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:01:49 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-219420e2-6edc-47ce-8ff7-3d3a005124e5 tempest-SnapshotMetadataTestJSON-1264006369 None] Volume dc7c3f93-799a-4265-a573-e5b97a67ee23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc7c3f93-799a-4265-a573-e5b97a67ee23', 'volume_size': 1} Sep 17 22:01:49 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-219420e2-6edc-47ce-8ff7-3d3a005124e5 tempest-SnapshotMetadataTestJSON-1264006369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:01:50 devstack sudo[97792]: pam_unix(sudo:session): session closed for user root Sep 17 22:01:50 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-f44b4130-e8f3-4725-ba1d-6941c93fccf0 tempest-VolumesGetTest-1858470535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f116420a-73e8-4ee2-bb70-973b583e10e9 -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f116420a-73e8-4ee2-bb70-973b583e10e9.c4a17d3a-5c83-4afd-97f9-37728f79236a" returned: 0 in 0.391s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:01:50 devstack cinder-volume[85458]: WARNING cinder.volume.drivers.remotefs [None req-f44b4130-e8f3-4725-ba1d-6941c93fccf0 tempest-VolumesGetTest-1858470535 None] /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f116420a-73e8-4ee2-bb70-973b583e10e9.c4a17d3a-5c83-4afd-97f9-37728f79236a is being set with open permissions: ugo+rw Sep 17 22:01:50 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-f44b4130-e8f3-4725-ba1d-6941c93fccf0 tempest-VolumesGetTest-1858470535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f116420a-73e8-4ee2-bb70-973b583e10e9.c4a17d3a-5c83-4afd-97f9-37728f79236a {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:01:50 devstack sudo[97797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f116420a-73e8-4ee2-bb70-973b583e10e9.c4a17d3a-5c83-4afd-97f9-37728f79236a Sep 17 22:01:50 devstack sudo[97797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:01:50 devstack sudo[97797]: pam_unix(sudo:session): session closed for user root Sep 17 22:01:50 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-f44b4130-e8f3-4725-ba1d-6941c93fccf0 tempest-VolumesGetTest-1858470535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f116420a-73e8-4ee2-bb70-973b583e10e9.c4a17d3a-5c83-4afd-97f9-37728f79236a" returned: 0 in 0.297s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:01:50 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-f44b4130-e8f3-4725-ba1d-6941c93fccf0 tempest-VolumesGetTest-1858470535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f116420a-73e8-4ee2-bb70-973b583e10e9.info {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:01:50 devstack sudo[97800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f116420a-73e8-4ee2-bb70-973b583e10e9.info Sep 17 22:01:50 devstack sudo[97800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:01:50 devstack sudo[97800]: pam_unix(sudo:session): session closed for user root Sep 17 22:01:50 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-f44b4130-e8f3-4725-ba1d-6941c93fccf0 tempest-VolumesGetTest-1858470535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f116420a-73e8-4ee2-bb70-973b583e10e9.info" returned: 0 in 0.310s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:01:50 devstack cinder-volume[85458]: WARNING cinder.volume.drivers.remotefs [None req-f44b4130-e8f3-4725-ba1d-6941c93fccf0 tempest-VolumesGetTest-1858470535 None] /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f116420a-73e8-4ee2-bb70-973b583e10e9.info is being set with open permissions: ugo+rw Sep 17 22:01:50 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-f44b4130-e8f3-4725-ba1d-6941c93fccf0 tempest-VolumesGetTest-1858470535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f116420a-73e8-4ee2-bb70-973b583e10e9.info {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:01:50 devstack sudo[97803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f116420a-73e8-4ee2-bb70-973b583e10e9.info Sep 17 22:01:50 devstack sudo[97803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:01:51 devstack sudo[97803]: pam_unix(sudo:session): session closed for user root Sep 17 22:01:51 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-f44b4130-e8f3-4725-ba1d-6941c93fccf0 tempest-VolumesGetTest-1858470535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f116420a-73e8-4ee2-bb70-973b583e10e9.info" returned: 0 in 0.299s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:01:51 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-f44b4130-e8f3-4725-ba1d-6941c93fccf0 tempest-VolumesGetTest-1858470535 None] Acquiring lock "cinder-quobyte-ed0f2895-2fea-4e4a-9b3d-271088178f81" by "_copy_volume_from_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:01:51 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-f44b4130-e8f3-4725-ba1d-6941c93fccf0 tempest-VolumesGetTest-1858470535 None] Lock "cinder-quobyte-ed0f2895-2fea-4e4a-9b3d-271088178f81" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:01:51 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-f44b4130-e8f3-4725-ba1d-6941c93fccf0 tempest-VolumesGetTest-1858470535 None] snapshot: c4a17d3a-5c83-4afd-97f9-37728f79236a, volume: ed0f2895-2fea-4e4a-9b3d-271088178f81, {{(pid=85458) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 17 22:01:51 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-f44b4130-e8f3-4725-ba1d-6941c93fccf0 tempest-VolumesGetTest-1858470535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:01:51 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-f44b4130-e8f3-4725-ba1d-6941c93fccf0 tempest-VolumesGetTest-1858470535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:01:51 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-f44b4130-e8f3-4725-ba1d-6941c93fccf0 tempest-VolumesGetTest-1858470535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:01:51 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-f44b4130-e8f3-4725-ba1d-6941c93fccf0 tempest-VolumesGetTest-1858470535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:01:51 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-f44b4130-e8f3-4725-ba1d-6941c93fccf0 tempest-VolumesGetTest-1858470535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:01:51 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc3555fb-da25-4f6d-a214-c2d0655b75af]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:01:51 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-f44b4130-e8f3-4725-ba1d-6941c93fccf0 tempest-VolumesGetTest-1858470535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f116420a-73e8-4ee2-bb70-973b583e10e9.c4a17d3a-5c83-4afd-97f9-37728f79236a {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:01:51 devstack sudo[97806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f116420a-73e8-4ee2-bb70-973b583e10e9.c4a17d3a-5c83-4afd-97f9-37728f79236a Sep 17 22:01:51 devstack sudo[97806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:01:51 devstack sudo[97806]: pam_unix(sudo:session): session closed for user root Sep 17 22:01:51 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-f44b4130-e8f3-4725-ba1d-6941c93fccf0 tempest-VolumesGetTest-1858470535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f116420a-73e8-4ee2-bb70-973b583e10e9.c4a17d3a-5c83-4afd-97f9-37728f79236a" returned: 0 in 0.441s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:01:51 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-f44b4130-e8f3-4725-ba1d-6941c93fccf0 tempest-VolumesGetTest-1858470535 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f116420a-73e8-4ee2-bb70-973b583e10e9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85458) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 22:01:51 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcedb525-8264-487f-b86a-c38c5c74d88a]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:01:51 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-f44b4130-e8f3-4725-ba1d-6941c93fccf0 tempest-VolumesGetTest-1858470535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f116420a-73e8-4ee2-bb70-973b583e10e9 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:01:51 devstack sudo[97812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f116420a-73e8-4ee2-bb70-973b583e10e9 Sep 17 22:01:51 devstack sudo[97812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:01:52 devstack sudo[97812]: pam_unix(sudo:session): session closed for user root Sep 17 22:01:52 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-f44b4130-e8f3-4725-ba1d-6941c93fccf0 tempest-VolumesGetTest-1858470535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f116420a-73e8-4ee2-bb70-973b583e10e9" returned: 0 in 0.442s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:01:52 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-f44b4130-e8f3-4725-ba1d-6941c93fccf0 tempest-VolumesGetTest-1858470535 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f116420a-73e8-4ee2-bb70-973b583e10e9 {{(pid=85458) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 17 22:01:52 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-f44b4130-e8f3-4725-ba1d-6941c93fccf0 tempest-VolumesGetTest-1858470535 None] Creating direct copy from snapshot {{(pid=85458) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 17 22:01:52 devstack cinder-volume[85458]: DEBUG cinder.utils [None req-f44b4130-e8f3-4725-ba1d-6941c93fccf0 tempest-VolumesGetTest-1858470535 None] Path /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ed0f2895-2fea-4e4a-9b3d-271088178f81 not found in is_blk_device check {{(pid=85458) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 17 22:01:52 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-f44b4130-e8f3-4725-ba1d-6941c93fccf0 tempest-VolumesGetTest-1858470535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f116420a-73e8-4ee2-bb70-973b583e10e9 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ed0f2895-2fea-4e4a-9b3d-271088178f81 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:01:52 devstack sudo[97817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f116420a-73e8-4ee2-bb70-973b583e10e9 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ed0f2895-2fea-4e4a-9b3d-271088178f81 Sep 17 22:01:52 devstack sudo[97817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:01:52 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-bcb0a25c-f274-4453-962d-a851171f6660 tempest-VolumesExtendTest-227742800 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 22:01:52 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-bcb0a25c-f274-4453-962d-a851171f6660 tempest-VolumesExtendTest-227742800 None] Flow 'volume_create_manager' (f06e1f77-997c-457f-91e7-60879c15729e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:01:52 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-bcb0a25c-f274-4453-962d-a851171f6660 tempest-VolumesExtendTest-227742800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (534a957c-e329-47fd-9365-5f8311e1b6b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:01:52 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-bcb0a25c-f274-4453-962d-a851171f6660 tempest-VolumesExtendTest-227742800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (534a957c-e329-47fd-9365-5f8311e1b6b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:01:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1853710249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db490653-3977-4f10-87d3-2338ef24e2e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de5752c44a8c4ee991addc1069fd83af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:01:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:01:52Z,use_quota=True,user_id='be93a371e3b340cc808ec3cd80081ab5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:01:52 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-bcb0a25c-f274-4453-962d-a851171f6660 tempest-VolumesExtendTest-227742800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12cdbb79-98f0-4f01-b845-c5227c897205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:01:52 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-bcb0a25c-f274-4453-962d-a851171f6660 tempest-VolumesExtendTest-227742800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12cdbb79-98f0-4f01-b845-c5227c897205) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:01:52 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-bcb0a25c-f274-4453-962d-a851171f6660 tempest-VolumesExtendTest-227742800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20b7bcff-015d-45cd-a829-545fdac1c570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:01:52 devstack cinder-volume[85458]: DEBUG cinder.image.glance [None req-bcb0a25c-f274-4453-962d-a851171f6660 tempest-VolumesExtendTest-227742800 None] Creating Keystone auth plugin from conf {{(pid=85458) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 17 22:01:52 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-bcb0a25c-f274-4453-962d-a851171f6660 tempest-VolumesExtendTest-227742800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20b7bcff-015d-45cd-a829-545fdac1c570) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'db490653-3977-4f10-87d3-2338ef24e2e6', 'volume_name': 'volume-db490653-3977-4f10-87d3-2338ef24e2e6', 'volume_size': 1, 'image_id': '764e44ff-49f7-469a-925c-23f254888b59', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/764e44ff-49f7-469a-925c-23f254888b59', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '530062d71c924da39eff46373302dc71', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '764e44ff-49f7-469a-925c-23f254888b59', 'created_at': datetime.datetime(2026, 9, 17, 19, 45, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 19, 45, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/764e44ff-49f7-469a-925c-23f254888b59/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:01:52 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-bcb0a25c-f274-4453-962d-a851171f6660 tempest-VolumesExtendTest-227742800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14174c89-d606-4032-88b9-ce991980db7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:01:52 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-bcb0a25c-f274-4453-962d-a851171f6660 tempest-VolumesExtendTest-227742800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14174c89-d606-4032-88b9-ce991980db7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:01:52 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-bcb0a25c-f274-4453-962d-a851171f6660 tempest-VolumesExtendTest-227742800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12da681a-3f7e-469c-86ed-a6f2bd641be5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:01:52 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-bcb0a25c-f274-4453-962d-a851171f6660 tempest-VolumesExtendTest-227742800 None] Volume db490653-3977-4f10-87d3-2338ef24e2e6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-db490653-3977-4f10-87d3-2338ef24e2e6', 'volume_size': 1, 'image_id': '764e44ff-49f7-469a-925c-23f254888b59', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/764e44ff-49f7-469a-925c-23f254888b59', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '530062d71c924da39eff46373302dc71', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '764e44ff-49f7-469a-925c-23f254888b59', 'created_at': datetime.datetime(2026, 9, 17, 19, 45, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 19, 45, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/764e44ff-49f7-469a-925c-23f254888b59/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 17 22:01:52 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-bcb0a25c-f274-4453-962d-a851171f6660 tempest-VolumesExtendTest-227742800 None] Trying to clone db490653-3977-4f10-87d3-2338ef24e2e6 from image 764e44ff-49f7-469a-925c-23f254888b59 at location (None, [{'url': 'file:///opt/stack/data/glance/images/764e44ff-49f7-469a-925c-23f254888b59', 'metadata': {}}]). {{(pid=85458) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 17 22:01:53 devstack cinder-volume[85458]: DEBUG cinder.image.image_utils [None req-bcb0a25c-f274-4453-962d-a851171f6660 tempest-VolumesExtendTest-227742800 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_764e44ff-49f7-469a-925c-23f254888b59_bghrygaldevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=85458) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 17 22:01:53 devstack cinder-volume[85458]: INFO cinder.image.image_utils [None req-bcb0a25c-f274-4453-962d-a851171f6660 tempest-VolumesExtendTest-227742800 None] Image download 20.69 MB at 20.69 MB/s Sep 17 22:01:53 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa18084b-1fa5-407f-8123-842a8c7c5da4]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:01:53 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-bcb0a25c-f274-4453-962d-a851171f6660 tempest-VolumesExtendTest-227742800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_764e44ff-49f7-469a-925c-23f254888b59_bghrygaldevstack@QuobyteHD {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:01:53 devstack sudo[97831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_764e44ff-49f7-469a-925c-23f254888b59_bghrygaldevstack@QuobyteHD Sep 17 22:01:53 devstack sudo[97831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:01:54 devstack sudo[97831]: pam_unix(sudo:session): session closed for user root Sep 17 22:01:54 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-bcb0a25c-f274-4453-962d-a851171f6660 tempest-VolumesExtendTest-227742800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_764e44ff-49f7-469a-925c-23f254888b59_bghrygaldevstack@QuobyteHD" returned: 0 in 0.687s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:01:54 devstack cinder-volume[85458]: DEBUG cinder.image.image_utils [None req-bcb0a25c-f274-4453-962d-a851171f6660 tempest-VolumesExtendTest-227742800 None] Temporary image 764e44ff-49f7-469a-925c-23f254888b59 is fetched for user be93a371e3b340cc808ec3cd80081ab5. {{(pid=85458) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 17 22:01:54 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[89856a0e-614d-4e04-bc47-cf37960eb39d]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:01:54 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-bcb0a25c-f274-4453-962d-a851171f6660 tempest-VolumesExtendTest-227742800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_764e44ff-49f7-469a-925c-23f254888b59_bghrygaldevstack@QuobyteHD {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:01:54 devstack sudo[97838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_764e44ff-49f7-469a-925c-23f254888b59_bghrygaldevstack@QuobyteHD Sep 17 22:01:54 devstack sudo[97838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:01:54 devstack sudo[97838]: pam_unix(sudo:session): session closed for user root Sep 17 22:01:54 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-bcb0a25c-f274-4453-962d-a851171f6660 tempest-VolumesExtendTest-227742800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_764e44ff-49f7-469a-925c-23f254888b59_bghrygaldevstack@QuobyteHD" returned: 0 in 0.480s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:01:54 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-bcb0a25c-f274-4453-962d-a851171f6660 tempest-VolumesExtendTest-227742800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:01:59 devstack sudo[97817]: pam_unix(sudo:session): session closed for user root Sep 17 22:01:59 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-f44b4130-e8f3-4725-ba1d-6941c93fccf0 tempest-VolumesGetTest-1858470535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f116420a-73e8-4ee2-bb70-973b583e10e9 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ed0f2895-2fea-4e4a-9b3d-271088178f81" returned: 0 in 7.168s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:01:59 devstack cinder-volume[85458]: DEBUG cinder.image.image_utils [None req-f44b4130-e8f3-4725-ba1d-6941c93fccf0 tempest-VolumesGetTest-1858470535 None] Image conversion details: src /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f116420a-73e8-4ee2-bb70-973b583e10e9, size 1024.00 MB, duration 7.17 sec, destination /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ed0f2895-2fea-4e4a-9b3d-271088178f81 {{(pid=85458) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 17 22:01:59 devstack cinder-volume[85458]: INFO cinder.image.image_utils [None req-f44b4130-e8f3-4725-ba1d-6941c93fccf0 tempest-VolumesGetTest-1858470535 None] Converted 1024.00 MB image at 142.82 MB/s Sep 17 22:01:59 devstack cinder-volume[85458]: WARNING cinder.volume.drivers.remotefs [None req-f44b4130-e8f3-4725-ba1d-6941c93fccf0 tempest-VolumesGetTest-1858470535 None] /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ed0f2895-2fea-4e4a-9b3d-271088178f81 is being set with open permissions: ugo+rw Sep 17 22:01:59 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-f44b4130-e8f3-4725-ba1d-6941c93fccf0 tempest-VolumesGetTest-1858470535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ed0f2895-2fea-4e4a-9b3d-271088178f81 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:01:59 devstack sudo[97847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ed0f2895-2fea-4e4a-9b3d-271088178f81 Sep 17 22:01:59 devstack sudo[97847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:01:59 devstack sudo[97847]: pam_unix(sudo:session): session closed for user root Sep 17 22:01:59 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-f44b4130-e8f3-4725-ba1d-6941c93fccf0 tempest-VolumesGetTest-1858470535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ed0f2895-2fea-4e4a-9b3d-271088178f81" returned: 0 in 0.241s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:01:59 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-f44b4130-e8f3-4725-ba1d-6941c93fccf0 tempest-VolumesGetTest-1858470535 None] Lock "cinder-quobyte-ed0f2895-2fea-4e4a-9b3d-271088178f81" released by "_copy_volume_from_snapshot" :: held 8.393s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:01:59 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-f44b4130-e8f3-4725-ba1d-6941c93fccf0 tempest-VolumesGetTest-1858470535 None] Acquiring lock "cinder-quobyte-c4a17d3a-5c83-4afd-97f9-37728f79236a" by "_delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:01:59 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-f44b4130-e8f3-4725-ba1d-6941c93fccf0 tempest-VolumesGetTest-1858470535 None] Lock "cinder-quobyte-c4a17d3a-5c83-4afd-97f9-37728f79236a" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:01:59 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-f44b4130-e8f3-4725-ba1d-6941c93fccf0 tempest-VolumesGetTest-1858470535 None] Deleting offline snapshot c4a17d3a-5c83-4afd-97f9-37728f79236a of volume f116420a-73e8-4ee2-bb70-973b583e10e9 {{(pid=85458) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 22:01:59 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-f44b4130-e8f3-4725-ba1d-6941c93fccf0 tempest-VolumesGetTest-1858470535 None] snapshot_file for this snap is: volume-f116420a-73e8-4ee2-bb70-973b583e10e9.c4a17d3a-5c83-4afd-97f9-37728f79236a {{(pid=85458) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 22:01:59 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ac9c98c-4a1d-43e5-8cd9-312a684bc5a4]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:01:59 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-f44b4130-e8f3-4725-ba1d-6941c93fccf0 tempest-VolumesGetTest-1858470535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f116420a-73e8-4ee2-bb70-973b583e10e9.c4a17d3a-5c83-4afd-97f9-37728f79236a {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:01:59 devstack sudo[97850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f116420a-73e8-4ee2-bb70-973b583e10e9.c4a17d3a-5c83-4afd-97f9-37728f79236a Sep 17 22:01:59 devstack sudo[97850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:02:00 devstack sudo[97850]: pam_unix(sudo:session): session closed for user root Sep 17 22:02:00 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-f44b4130-e8f3-4725-ba1d-6941c93fccf0 tempest-VolumesGetTest-1858470535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f116420a-73e8-4ee2-bb70-973b583e10e9.c4a17d3a-5c83-4afd-97f9-37728f79236a" returned: 0 in 0.372s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:02:00 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-f44b4130-e8f3-4725-ba1d-6941c93fccf0 tempest-VolumesGetTest-1858470535 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f116420a-73e8-4ee2-bb70-973b583e10e9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85458) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 22:02:00 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae2e82ca-b00e-4624-8a96-7199a7a991f0]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:02:00 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-f44b4130-e8f3-4725-ba1d-6941c93fccf0 tempest-VolumesGetTest-1858470535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f116420a-73e8-4ee2-bb70-973b583e10e9 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:02:00 devstack sudo[97855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f116420a-73e8-4ee2-bb70-973b583e10e9 Sep 17 22:02:00 devstack sudo[97855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:02:00 devstack sudo[97855]: pam_unix(sudo:session): session closed for user root Sep 17 22:02:00 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-f44b4130-e8f3-4725-ba1d-6941c93fccf0 tempest-VolumesGetTest-1858470535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f116420a-73e8-4ee2-bb70-973b583e10e9" returned: 0 in 0.566s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:02:00 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-f44b4130-e8f3-4725-ba1d-6941c93fccf0 tempest-VolumesGetTest-1858470535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f116420a-73e8-4ee2-bb70-973b583e10e9.c4a17d3a-5c83-4afd-97f9-37728f79236a {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:02:00 devstack sudo[97861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f116420a-73e8-4ee2-bb70-973b583e10e9.c4a17d3a-5c83-4afd-97f9-37728f79236a Sep 17 22:02:00 devstack sudo[97861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:02:00 devstack sudo[97861]: pam_unix(sudo:session): session closed for user root Sep 17 22:02:00 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-f44b4130-e8f3-4725-ba1d-6941c93fccf0 tempest-VolumesGetTest-1858470535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f116420a-73e8-4ee2-bb70-973b583e10e9.c4a17d3a-5c83-4afd-97f9-37728f79236a" returned: 0 in 0.341s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:02:00 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-f44b4130-e8f3-4725-ba1d-6941c93fccf0 tempest-VolumesGetTest-1858470535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f116420a-73e8-4ee2-bb70-973b583e10e9.c4a17d3a-5c83-4afd-97f9-37728f79236a {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:02:00 devstack sudo[97866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f116420a-73e8-4ee2-bb70-973b583e10e9.c4a17d3a-5c83-4afd-97f9-37728f79236a Sep 17 22:02:00 devstack sudo[97866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:02:01 devstack sudo[97866]: pam_unix(sudo:session): session closed for user root Sep 17 22:02:01 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-f44b4130-e8f3-4725-ba1d-6941c93fccf0 tempest-VolumesGetTest-1858470535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f116420a-73e8-4ee2-bb70-973b583e10e9.c4a17d3a-5c83-4afd-97f9-37728f79236a" returned: 0 in 0.245s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:02:01 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-f44b4130-e8f3-4725-ba1d-6941c93fccf0 tempest-VolumesGetTest-1858470535 None] Lock "cinder-quobyte-c4a17d3a-5c83-4afd-97f9-37728f79236a" released by "_delete_snapshot" :: held 1.631s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:02:01 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-f44b4130-e8f3-4725-ba1d-6941c93fccf0 tempest-VolumesGetTest-1858470535 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.802s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:02:01 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-219420e2-6edc-47ce-8ff7-3d3a005124e5 tempest-SnapshotMetadataTestJSON-1264006369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.420s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:02:01 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-219420e2-6edc-47ce-8ff7-3d3a005124e5 tempest-SnapshotMetadataTestJSON-1264006369 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:01:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1975394505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc7c3f93-799a-4265-a573-e5b97a67ee23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7453a7bd48ad4ba0be6a0e0c185cf1d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:01:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:01:50Z,use_quota=True,user_id='5c009c5fb15e4e5390892606aa067934',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 22:02:01 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-219420e2-6edc-47ce-8ff7-3d3a005124e5 tempest-SnapshotMetadataTestJSON-1264006369 None] Creating volume dc7c3f93-799a-4265-a573-e5b97a67ee23 {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 22:02:01 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-219420e2-6edc-47ce-8ff7-3d3a005124e5 tempest-SnapshotMetadataTestJSON-1264006369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:02:01 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-219420e2-6edc-47ce-8ff7-3d3a005124e5 tempest-SnapshotMetadataTestJSON-1264006369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:02:01 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-219420e2-6edc-47ce-8ff7-3d3a005124e5 tempest-SnapshotMetadataTestJSON-1264006369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:02:01 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-219420e2-6edc-47ce-8ff7-3d3a005124e5 tempest-SnapshotMetadataTestJSON-1264006369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:02:01 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-219420e2-6edc-47ce-8ff7-3d3a005124e5 tempest-SnapshotMetadataTestJSON-1264006369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:02:01 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-219420e2-6edc-47ce-8ff7-3d3a005124e5 tempest-SnapshotMetadataTestJSON-1264006369 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 22:02:01 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-219420e2-6edc-47ce-8ff7-3d3a005124e5 tempest-SnapshotMetadataTestJSON-1264006369 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 22:02:01 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-219420e2-6edc-47ce-8ff7-3d3a005124e5 tempest-SnapshotMetadataTestJSON-1264006369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-dc7c3f93-799a-4265-a573-e5b97a67ee23 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:02:01 devstack sudo[97869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-dc7c3f93-799a-4265-a573-e5b97a67ee23 1073741824 Sep 17 22:02:01 devstack sudo[97869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:02:01 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-f44b4130-e8f3-4725-ba1d-6941c93fccf0 tempest-VolumesGetTest-1858470535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42daba0d-a3f4-408c-a673-2f49d17f703c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed0f2895-2fea-4e4a-9b3d-271088178f81', 'volume_size': 1, 'source_volid': 'f116420a-73e8-4ee2-bb70-973b583e10e9', 'source_volstatus': 'available'}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:02:01 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-f44b4130-e8f3-4725-ba1d-6941c93fccf0 tempest-VolumesGetTest-1858470535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d44e987-06b0-4aa3-93b7-fdca4b8821c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:02:01 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-f44b4130-e8f3-4725-ba1d-6941c93fccf0 tempest-VolumesGetTest-1858470535 None] Volume volume-ed0f2895-2fea-4e4a-9b3d-271088178f81 (ed0f2895-2fea-4e4a-9b3d-271088178f81): created successfully Sep 17 22:02:01 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-f44b4130-e8f3-4725-ba1d-6941c93fccf0 tempest-VolumesGetTest-1858470535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d44e987-06b0-4aa3-93b7-fdca4b8821c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:02:01 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-f44b4130-e8f3-4725-ba1d-6941c93fccf0 tempest-VolumesGetTest-1858470535 None] Flow 'volume_create_manager' (ead5e70e-7a3f-4802-a9d7-95fbd7f6668f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:02:01 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-f44b4130-e8f3-4725-ba1d-6941c93fccf0 tempest-VolumesGetTest-1858470535 None] Created volume successfully. Sep 17 22:02:01 devstack sudo[97869]: pam_unix(sudo:session): session closed for user root Sep 17 22:02:01 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-219420e2-6edc-47ce-8ff7-3d3a005124e5 tempest-SnapshotMetadataTestJSON-1264006369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-dc7c3f93-799a-4265-a573-e5b97a67ee23 1073741824" returned: 0 in 0.544s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:02:01 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-219420e2-6edc-47ce-8ff7-3d3a005124e5 tempest-SnapshotMetadataTestJSON-1264006369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-dc7c3f93-799a-4265-a573-e5b97a67ee23 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:02:01 devstack sudo[97875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-dc7c3f93-799a-4265-a573-e5b97a67ee23 Sep 17 22:02:01 devstack sudo[97875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:02:02 devstack sudo[97875]: pam_unix(sudo:session): session closed for user root Sep 17 22:02:02 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-219420e2-6edc-47ce-8ff7-3d3a005124e5 tempest-SnapshotMetadataTestJSON-1264006369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-dc7c3f93-799a-4265-a573-e5b97a67ee23" returned: 0 in 0.249s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:02:02 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-219420e2-6edc-47ce-8ff7-3d3a005124e5 tempest-SnapshotMetadataTestJSON-1264006369 None] <== create_volume: return (840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 22:02:02 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-219420e2-6edc-47ce-8ff7-3d3a005124e5 tempest-SnapshotMetadataTestJSON-1264006369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.844s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:02:02 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-bcb0a25c-f274-4453-962d-a851171f6660 tempest-VolumesExtendTest-227742800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.172s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:02:02 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-bcb0a25c-f274-4453-962d-a851171f6660 tempest-VolumesExtendTest-227742800 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:01:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1853710249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db490653-3977-4f10-87d3-2338ef24e2e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de5752c44a8c4ee991addc1069fd83af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:01:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:01:52Z,use_quota=True,user_id='be93a371e3b340cc808ec3cd80081ab5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 22:02:02 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-bcb0a25c-f274-4453-962d-a851171f6660 tempest-VolumesExtendTest-227742800 None] Creating volume db490653-3977-4f10-87d3-2338ef24e2e6 {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 22:02:02 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-bcb0a25c-f274-4453-962d-a851171f6660 tempest-VolumesExtendTest-227742800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:02:02 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-bcb0a25c-f274-4453-962d-a851171f6660 tempest-VolumesExtendTest-227742800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:02:02 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-bcb0a25c-f274-4453-962d-a851171f6660 tempest-VolumesExtendTest-227742800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:02:02 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-bcb0a25c-f274-4453-962d-a851171f6660 tempest-VolumesExtendTest-227742800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:02:02 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-bcb0a25c-f274-4453-962d-a851171f6660 tempest-VolumesExtendTest-227742800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:02:02 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-bcb0a25c-f274-4453-962d-a851171f6660 tempest-VolumesExtendTest-227742800 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 22:02:02 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-bcb0a25c-f274-4453-962d-a851171f6660 tempest-VolumesExtendTest-227742800 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 22:02:02 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-bcb0a25c-f274-4453-962d-a851171f6660 tempest-VolumesExtendTest-227742800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-db490653-3977-4f10-87d3-2338ef24e2e6 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:02:02 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-219420e2-6edc-47ce-8ff7-3d3a005124e5 tempest-SnapshotMetadataTestJSON-1264006369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6a9dbc2-02b1-4333-9e6d-50b3f9971ed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc7c3f93-799a-4265-a573-e5b97a67ee23', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:02:02 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-219420e2-6edc-47ce-8ff7-3d3a005124e5 tempest-SnapshotMetadataTestJSON-1264006369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (654f3b75-2465-491a-bdfd-b01815574755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:02:02 devstack sudo[97878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-db490653-3977-4f10-87d3-2338ef24e2e6 1073741824 Sep 17 22:02:02 devstack sudo[97878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:02:02 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-219420e2-6edc-47ce-8ff7-3d3a005124e5 tempest-SnapshotMetadataTestJSON-1264006369 None] Volume volume-dc7c3f93-799a-4265-a573-e5b97a67ee23 (dc7c3f93-799a-4265-a573-e5b97a67ee23): created successfully Sep 17 22:02:02 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-219420e2-6edc-47ce-8ff7-3d3a005124e5 tempest-SnapshotMetadataTestJSON-1264006369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (654f3b75-2465-491a-bdfd-b01815574755) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:02:02 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-219420e2-6edc-47ce-8ff7-3d3a005124e5 tempest-SnapshotMetadataTestJSON-1264006369 None] Flow 'volume_create_manager' (474abefd-9a49-42c0-90aa-26ed20e07dfe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:02:02 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-219420e2-6edc-47ce-8ff7-3d3a005124e5 tempest-SnapshotMetadataTestJSON-1264006369 None] Created volume successfully. Sep 17 22:02:02 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e84e418-6c3c-4ee0-aa4c-a159ff2a275a tempest-VolumesGetTest-1858470535 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 22:02:02 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-7e84e418-6c3c-4ee0-aa4c-a159ff2a275a tempest-VolumesGetTest-1858470535 None] Flow 'volume_create_manager' (8f4a6c0a-8e4e-4b07-a735-d7dd44abc35a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:02:02 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-7e84e418-6c3c-4ee0-aa4c-a159ff2a275a tempest-VolumesGetTest-1858470535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4e290db-9f31-4f3a-999d-922e681ca876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:02:02 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-7e84e418-6c3c-4ee0-aa4c-a159ff2a275a tempest-VolumesGetTest-1858470535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4e290db-9f31-4f3a-999d-922e681ca876) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:02:02Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2109901139',display_name='tempest-VolumesGetTest-Volume-255520239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02218406-48f7-4504-90af-6fda6a66b946,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfeba540fd8a4d37b58b43b2b38ce1e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:02:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:02:02Z,use_quota=True,user_id='5c1a5bbe85894370877379762b25947b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:02:02 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-7e84e418-6c3c-4ee0-aa4c-a159ff2a275a tempest-VolumesGetTest-1858470535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (333c3feb-33db-4aee-91a0-d3f1f27467bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:02:02 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-7e84e418-6c3c-4ee0-aa4c-a159ff2a275a tempest-VolumesGetTest-1858470535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (333c3feb-33db-4aee-91a0-d3f1f27467bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:02:02 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-7e84e418-6c3c-4ee0-aa4c-a159ff2a275a tempest-VolumesGetTest-1858470535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4237130a-a93f-43ca-b60e-05d6697d7ed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:02:02 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-7e84e418-6c3c-4ee0-aa4c-a159ff2a275a tempest-VolumesGetTest-1858470535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4237130a-a93f-43ca-b60e-05d6697d7ed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02218406-48f7-4504-90af-6fda6a66b946', 'volume_name': 'volume-02218406-48f7-4504-90af-6fda6a66b946', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:02:02 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-7e84e418-6c3c-4ee0-aa4c-a159ff2a275a tempest-VolumesGetTest-1858470535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c26411d0-b9e5-4bfd-8e8e-aeea715c291c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:02:02 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-7e84e418-6c3c-4ee0-aa4c-a159ff2a275a tempest-VolumesGetTest-1858470535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c26411d0-b9e5-4bfd-8e8e-aeea715c291c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:02:02 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-7e84e418-6c3c-4ee0-aa4c-a159ff2a275a tempest-VolumesGetTest-1858470535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d48c773-41bf-45c3-b82e-7df3d31ab275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:02:02 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-7e84e418-6c3c-4ee0-aa4c-a159ff2a275a tempest-VolumesGetTest-1858470535 None] Volume 02218406-48f7-4504-90af-6fda6a66b946: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02218406-48f7-4504-90af-6fda6a66b946', 'volume_size': 1} Sep 17 22:02:02 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-7e84e418-6c3c-4ee0-aa4c-a159ff2a275a tempest-VolumesGetTest-1858470535 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:02:02 devstack sudo[97878]: pam_unix(sudo:session): session closed for user root Sep 17 22:02:02 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-bcb0a25c-f274-4453-962d-a851171f6660 tempest-VolumesExtendTest-227742800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-db490653-3977-4f10-87d3-2338ef24e2e6 1073741824" returned: 0 in 0.503s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:02:02 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-bcb0a25c-f274-4453-962d-a851171f6660 tempest-VolumesExtendTest-227742800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-db490653-3977-4f10-87d3-2338ef24e2e6 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:02:02 devstack sudo[97884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-db490653-3977-4f10-87d3-2338ef24e2e6 Sep 17 22:02:02 devstack sudo[97884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:02:02 devstack sudo[97884]: pam_unix(sudo:session): session closed for user root Sep 17 22:02:02 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-bcb0a25c-f274-4453-962d-a851171f6660 tempest-VolumesExtendTest-227742800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-db490653-3977-4f10-87d3-2338ef24e2e6" returned: 0 in 0.295s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:02:02 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-bcb0a25c-f274-4453-962d-a851171f6660 tempest-VolumesExtendTest-227742800 None] <== create_volume: return (858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 22:02:02 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-bcb0a25c-f274-4453-962d-a851171f6660 tempest-VolumesExtendTest-227742800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.862s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:02:02 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-7e84e418-6c3c-4ee0-aa4c-a159ff2a275a tempest-VolumesGetTest-1858470535 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.516s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:02:02 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-7e84e418-6c3c-4ee0-aa4c-a159ff2a275a tempest-VolumesGetTest-1858470535 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:02:02Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2109901139',display_name='tempest-VolumesGetTest-Volume-255520239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02218406-48f7-4504-90af-6fda6a66b946,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfeba540fd8a4d37b58b43b2b38ce1e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:02:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:02:02Z,use_quota=True,user_id='5c1a5bbe85894370877379762b25947b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 22:02:02 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-7e84e418-6c3c-4ee0-aa4c-a159ff2a275a tempest-VolumesGetTest-1858470535 None] Creating volume 02218406-48f7-4504-90af-6fda6a66b946 {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 22:02:02 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-7e84e418-6c3c-4ee0-aa4c-a159ff2a275a tempest-VolumesGetTest-1858470535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:02:02 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-7e84e418-6c3c-4ee0-aa4c-a159ff2a275a tempest-VolumesGetTest-1858470535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:02:03 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-7e84e418-6c3c-4ee0-aa4c-a159ff2a275a tempest-VolumesGetTest-1858470535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:02:03 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-7e84e418-6c3c-4ee0-aa4c-a159ff2a275a tempest-VolumesGetTest-1858470535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:02:03 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-7e84e418-6c3c-4ee0-aa4c-a159ff2a275a tempest-VolumesGetTest-1858470535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:02:03 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-7e84e418-6c3c-4ee0-aa4c-a159ff2a275a tempest-VolumesGetTest-1858470535 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 22:02:03 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-7e84e418-6c3c-4ee0-aa4c-a159ff2a275a tempest-VolumesGetTest-1858470535 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 22:02:03 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-7e84e418-6c3c-4ee0-aa4c-a159ff2a275a tempest-VolumesGetTest-1858470535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-02218406-48f7-4504-90af-6fda6a66b946 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:02:03 devstack sudo[97887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-02218406-48f7-4504-90af-6fda6a66b946 1073741824 Sep 17 22:02:03 devstack sudo[97887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:02:03 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-5fb5e7e7-2914-4035-a80f-3c11e44ca06c tempest-SnapshotMetadataTestJSON-1264006369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:02:03 devstack cinder-volume[85458]: DEBUG cinder.volume.volume_utils [None req-bcb0a25c-f274-4453-962d-a851171f6660 tempest-VolumesExtendTest-227742800 None] Attempting download of 764e44ff-49f7-469a-925c-23f254888b59 ((None, [{'url': 'file:///opt/stack/data/glance/images/764e44ff-49f7-469a-925c-23f254888b59', 'metadata': {}}])) to volume db490653-3977-4f10-87d3-2338ef24e2e6. {{(pid=85458) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 17 22:02:03 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[25b1e7a1-f259-4c2a-a82f-a48fa01ce057]: (4, 'raw') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:02:03 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-bcb0a25c-f274-4453-962d-a851171f6660 tempest-VolumesExtendTest-227742800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_764e44ff-49f7-469a-925c-23f254888b59_gf59bxv7 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:02:03 devstack sudo[97889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_764e44ff-49f7-469a-925c-23f254888b59_gf59bxv7 Sep 17 22:02:03 devstack sudo[97889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:02:03 devstack sudo[97889]: pam_unix(sudo:session): session closed for user root Sep 17 22:02:03 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-bcb0a25c-f274-4453-962d-a851171f6660 tempest-VolumesExtendTest-227742800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_764e44ff-49f7-469a-925c-23f254888b59_gf59bxv7" returned: 0 in 0.397s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:02:03 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-bcb0a25c-f274-4453-962d-a851171f6660 tempest-VolumesExtendTest-227742800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_764e44ff-49f7-469a-925c-23f254888b59_gf59bxv7 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:02:03 devstack sudo[97887]: pam_unix(sudo:session): session closed for user root Sep 17 22:02:03 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-7e84e418-6c3c-4ee0-aa4c-a159ff2a275a tempest-VolumesGetTest-1858470535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-02218406-48f7-4504-90af-6fda6a66b946 1073741824" returned: 0 in 0.567s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:02:03 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-7e84e418-6c3c-4ee0-aa4c-a159ff2a275a tempest-VolumesGetTest-1858470535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-02218406-48f7-4504-90af-6fda6a66b946 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:02:03 devstack sudo[97898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_764e44ff-49f7-469a-925c-23f254888b59_gf59bxv7 Sep 17 22:02:03 devstack sudo[97898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:02:03 devstack sudo[97900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-02218406-48f7-4504-90af-6fda6a66b946 Sep 17 22:02:03 devstack sudo[97900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:02:03 devstack sudo[97898]: pam_unix(sudo:session): session closed for user root Sep 17 22:02:03 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-bcb0a25c-f274-4453-962d-a851171f6660 tempest-VolumesExtendTest-227742800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_764e44ff-49f7-469a-925c-23f254888b59_gf59bxv7" returned: 1 in 0.379s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:02:03 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-bcb0a25c-f274-4453-962d-a851171f6660 tempest-VolumesExtendTest-227742800 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_764e44ff-49f7-469a-925c-23f254888b59_gf59bxv7' failed. Not Retrying. {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 22:02:03 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aef467d-4ddb-4553-8766-c88bd2fd6cc7]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:02:03 devstack sudo[97900]: pam_unix(sudo:session): session closed for user root Sep 17 22:02:03 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-bcb0a25c-f274-4453-962d-a851171f6660 tempest-VolumesExtendTest-227742800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_764e44ff-49f7-469a-925c-23f254888b59_bghrygaldevstack@QuobyteHD {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:02:03 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-7e84e418-6c3c-4ee0-aa4c-a159ff2a275a tempest-VolumesGetTest-1858470535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-02218406-48f7-4504-90af-6fda6a66b946" returned: 0 in 0.265s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:02:03 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-7e84e418-6c3c-4ee0-aa4c-a159ff2a275a tempest-VolumesGetTest-1858470535 None] <== create_volume: return (933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 22:02:03 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-7e84e418-6c3c-4ee0-aa4c-a159ff2a275a tempest-VolumesGetTest-1858470535 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:02:03 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-5fb5e7e7-2914-4035-a80f-3c11e44ca06c tempest-SnapshotMetadataTestJSON-1264006369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.857s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:02:03 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-7e84e418-6c3c-4ee0-aa4c-a159ff2a275a tempest-VolumesGetTest-1858470535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d48c773-41bf-45c3-b82e-7df3d31ab275) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02218406-48f7-4504-90af-6fda6a66b946', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:02:03 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-7e84e418-6c3c-4ee0-aa4c-a159ff2a275a tempest-VolumesGetTest-1858470535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c24666a-4d27-466f-b794-2b582bcbc561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:02:03 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-5fb5e7e7-2914-4035-a80f-3c11e44ca06c tempest-SnapshotMetadataTestJSON-1264006369 None] Creating offline snapshot 417b8600-cd87-4760-b467-d016d56c64ed of volume dc7c3f93-799a-4265-a573-e5b97a67ee23 {{(pid=85458) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 22:02:03 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-7e84e418-6c3c-4ee0-aa4c-a159ff2a275a tempest-VolumesGetTest-1858470535 None] Volume volume-02218406-48f7-4504-90af-6fda6a66b946 (02218406-48f7-4504-90af-6fda6a66b946): created successfully Sep 17 22:02:04 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-7e84e418-6c3c-4ee0-aa4c-a159ff2a275a tempest-VolumesGetTest-1858470535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c24666a-4d27-466f-b794-2b582bcbc561) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:02:04 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-7e84e418-6c3c-4ee0-aa4c-a159ff2a275a tempest-VolumesGetTest-1858470535 None] Flow 'volume_create_manager' (8f4a6c0a-8e4e-4b07-a735-d7dd44abc35a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:02:04 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7d2ae6e-623b-40ab-a3e2-c4138b9e6e17]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:02:04 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-5fb5e7e7-2914-4035-a80f-3c11e44ca06c tempest-SnapshotMetadataTestJSON-1264006369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-dc7c3f93-799a-4265-a573-e5b97a67ee23 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:02:04 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-7e84e418-6c3c-4ee0-aa4c-a159ff2a275a tempest-VolumesGetTest-1858470535 None] Created volume successfully. Sep 17 22:02:04 devstack sudo[97905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_764e44ff-49f7-469a-925c-23f254888b59_bghrygaldevstack@QuobyteHD Sep 17 22:02:04 devstack sudo[97905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:02:04 devstack sudo[97906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-dc7c3f93-799a-4265-a573-e5b97a67ee23 Sep 17 22:02:04 devstack sudo[97906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:02:04 devstack sudo[97905]: pam_unix(sudo:session): session closed for user root Sep 17 22:02:04 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-bcb0a25c-f274-4453-962d-a851171f6660 tempest-VolumesExtendTest-227742800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_764e44ff-49f7-469a-925c-23f254888b59_bghrygaldevstack@QuobyteHD" returned: 0 in 0.405s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:02:04 devstack cinder-volume[85458]: DEBUG cinder.image.image_utils [None req-bcb0a25c-f274-4453-962d-a851171f6660 tempest-VolumesExtendTest-227742800 None] 764e44ff-49f7-469a-925c-23f254888b59 was qcow2, converting to qcow2 {{(pid=85458) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 17 22:02:04 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-bcb0a25c-f274-4453-962d-a851171f6660 tempest-VolumesExtendTest-227742800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_764e44ff-49f7-469a-925c-23f254888b59_bghrygaldevstack@QuobyteHD /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-db490653-3977-4f10-87d3-2338ef24e2e6 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:02:04 devstack sudo[97912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_764e44ff-49f7-469a-925c-23f254888b59_bghrygaldevstack@QuobyteHD /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-db490653-3977-4f10-87d3-2338ef24e2e6 Sep 17 22:02:04 devstack sudo[97912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:02:04 devstack sudo[97906]: pam_unix(sudo:session): session closed for user root Sep 17 22:02:04 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-5fb5e7e7-2914-4035-a80f-3c11e44ca06c tempest-SnapshotMetadataTestJSON-1264006369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-dc7c3f93-799a-4265-a573-e5b97a67ee23" returned: 0 in 0.450s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:02:04 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-5fb5e7e7-2914-4035-a80f-3c11e44ca06c tempest-SnapshotMetadataTestJSON-1264006369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-dc7c3f93-799a-4265-a573-e5b97a67ee23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-dc7c3f93-799a-4265-a573-e5b97a67ee23.417b8600-cd87-4760-b467-d016d56c64ed 1G {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:02:04 devstack sudo[97917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-dc7c3f93-799a-4265-a573-e5b97a67ee23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-dc7c3f93-799a-4265-a573-e5b97a67ee23.417b8600-cd87-4760-b467-d016d56c64ed 1G Sep 17 22:02:04 devstack sudo[97917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:02:04 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-c1fb0b01-3712-48bf-8c9c-ab1a3db76b90 tempest-VolumesGetTest-1858470535 None] Acquiring lock "cinder-02218406-48f7-4504-90af-6fda6a66b946-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:02:04 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-c1fb0b01-3712-48bf-8c9c-ab1a3db76b90 tempest-VolumesGetTest-1858470535 None] Lock "cinder-02218406-48f7-4504-90af-6fda6a66b946-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:02:04 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-c1fb0b01-3712-48bf-8c9c-ab1a3db76b90 tempest-VolumesGetTest-1858470535 None] Acquiring lock "cinder-quobyte-02218406-48f7-4504-90af-6fda6a66b946" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:02:04 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-c1fb0b01-3712-48bf-8c9c-ab1a3db76b90 tempest-VolumesGetTest-1858470535 None] Lock "cinder-quobyte-02218406-48f7-4504-90af-6fda6a66b946" acquired by "delete_volume" :: waited 0.034s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:02:04 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[c48a679f-91d6-48a5-a6db-a0cb90c5fe95]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:02:04 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-c1fb0b01-3712-48bf-8c9c-ab1a3db76b90 tempest-VolumesGetTest-1858470535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-02218406-48f7-4504-90af-6fda6a66b946 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:02:04 devstack sudo[97924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-02218406-48f7-4504-90af-6fda6a66b946 Sep 17 22:02:04 devstack sudo[97924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:02:04 devstack sudo[97917]: pam_unix(sudo:session): session closed for user root Sep 17 22:02:04 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-5fb5e7e7-2914-4035-a80f-3c11e44ca06c tempest-SnapshotMetadataTestJSON-1264006369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-dc7c3f93-799a-4265-a573-e5b97a67ee23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-dc7c3f93-799a-4265-a573-e5b97a67ee23.417b8600-cd87-4760-b467-d016d56c64ed 1G" returned: 0 in 0.525s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:02:04 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-5fb5e7e7-2914-4035-a80f-3c11e44ca06c tempest-SnapshotMetadataTestJSON-1264006369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc7c3f93-799a-4265-a573-e5b97a67ee23 -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-dc7c3f93-799a-4265-a573-e5b97a67ee23.417b8600-cd87-4760-b467-d016d56c64ed {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:02:05 devstack sudo[97930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc7c3f93-799a-4265-a573-e5b97a67ee23 -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-dc7c3f93-799a-4265-a573-e5b97a67ee23.417b8600-cd87-4760-b467-d016d56c64ed Sep 17 22:02:05 devstack sudo[97930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:02:05 devstack sudo[97924]: pam_unix(sudo:session): session closed for user root Sep 17 22:02:05 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-c1fb0b01-3712-48bf-8c9c-ab1a3db76b90 tempest-VolumesGetTest-1858470535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-02218406-48f7-4504-90af-6fda6a66b946" returned: 0 in 0.462s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:02:05 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-c1fb0b01-3712-48bf-8c9c-ab1a3db76b90 tempest-VolumesGetTest-1858470535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-02218406-48f7-4504-90af-6fda6a66b946 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:02:05 devstack sudo[97935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-02218406-48f7-4504-90af-6fda6a66b946 Sep 17 22:02:05 devstack sudo[97935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:02:05 devstack sudo[97930]: pam_unix(sudo:session): session closed for user root Sep 17 22:02:05 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-5fb5e7e7-2914-4035-a80f-3c11e44ca06c tempest-SnapshotMetadataTestJSON-1264006369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc7c3f93-799a-4265-a573-e5b97a67ee23 -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-dc7c3f93-799a-4265-a573-e5b97a67ee23.417b8600-cd87-4760-b467-d016d56c64ed" returned: 0 in 0.340s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:02:05 devstack cinder-volume[85458]: WARNING cinder.volume.drivers.remotefs [None req-5fb5e7e7-2914-4035-a80f-3c11e44ca06c tempest-SnapshotMetadataTestJSON-1264006369 None] /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-dc7c3f93-799a-4265-a573-e5b97a67ee23.417b8600-cd87-4760-b467-d016d56c64ed is being set with open permissions: ugo+rw Sep 17 22:02:05 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-5fb5e7e7-2914-4035-a80f-3c11e44ca06c tempest-SnapshotMetadataTestJSON-1264006369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-dc7c3f93-799a-4265-a573-e5b97a67ee23.417b8600-cd87-4760-b467-d016d56c64ed {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:02:05 devstack sudo[97940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-dc7c3f93-799a-4265-a573-e5b97a67ee23.417b8600-cd87-4760-b467-d016d56c64ed Sep 17 22:02:05 devstack sudo[97940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:02:05 devstack sudo[97935]: pam_unix(sudo:session): session closed for user root Sep 17 22:02:05 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-c1fb0b01-3712-48bf-8c9c-ab1a3db76b90 tempest-VolumesGetTest-1858470535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-02218406-48f7-4504-90af-6fda6a66b946" returned: 0 in 0.312s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:02:05 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-c1fb0b01-3712-48bf-8c9c-ab1a3db76b90 tempest-VolumesGetTest-1858470535 None] Lock "cinder-quobyte-02218406-48f7-4504-90af-6fda6a66b946" released by "delete_volume" :: held 0.829s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:02:05 devstack sudo[97940]: pam_unix(sudo:session): session closed for user root Sep 17 22:02:05 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-5fb5e7e7-2914-4035-a80f-3c11e44ca06c tempest-SnapshotMetadataTestJSON-1264006369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-dc7c3f93-799a-4265-a573-e5b97a67ee23.417b8600-cd87-4760-b467-d016d56c64ed" returned: 0 in 0.294s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:02:05 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-c1fb0b01-3712-48bf-8c9c-ab1a3db76b90 tempest-VolumesGetTest-1858470535 None] Created reservations ['ebd8294f-4048-4533-810c-bb1b73fea280', '328de510-65e0-4edd-bc62-f641ba82940d', '0caf6409-4cf6-43ad-af62-7dc32718faa1', '653e0fcf-3a21-4abf-a96e-fcb58da89b93'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:02:05 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-5fb5e7e7-2914-4035-a80f-3c11e44ca06c tempest-SnapshotMetadataTestJSON-1264006369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-dc7c3f93-799a-4265-a573-e5b97a67ee23.info {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:02:05 devstack sudo[97944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-dc7c3f93-799a-4265-a573-e5b97a67ee23.info Sep 17 22:02:05 devstack sudo[97944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:02:05 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-c1fb0b01-3712-48bf-8c9c-ab1a3db76b90 tempest-VolumesGetTest-1858470535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:02:05 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-c1fb0b01-3712-48bf-8c9c-ab1a3db76b90 tempest-VolumesGetTest-1858470535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:02:05 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-c1fb0b01-3712-48bf-8c9c-ab1a3db76b90 tempest-VolumesGetTest-1858470535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:02:05 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-c1fb0b01-3712-48bf-8c9c-ab1a3db76b90 tempest-VolumesGetTest-1858470535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:02:05 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-c1fb0b01-3712-48bf-8c9c-ab1a3db76b90 tempest-VolumesGetTest-1858470535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:02:05 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-c1fb0b01-3712-48bf-8c9c-ab1a3db76b90 tempest-VolumesGetTest-1858470535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:02:05 devstack sudo[97946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:02:05 devstack sudo[97946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:02:06 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-aa14a268-6a91-4cb0-8d5f-91b3dc068f6b tempest-VolumesGetTest-1858470535 None] Acquiring lock "cinder-ed0f2895-2fea-4e4a-9b3d-271088178f81-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:02:06 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-aa14a268-6a91-4cb0-8d5f-91b3dc068f6b tempest-VolumesGetTest-1858470535 None] Lock "cinder-ed0f2895-2fea-4e4a-9b3d-271088178f81-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:02:06 devstack sudo[97944]: pam_unix(sudo:session): session closed for user root Sep 17 22:02:06 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-5fb5e7e7-2914-4035-a80f-3c11e44ca06c tempest-SnapshotMetadataTestJSON-1264006369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-dc7c3f93-799a-4265-a573-e5b97a67ee23.info" returned: 0 in 0.346s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:02:06 devstack cinder-volume[85458]: WARNING cinder.volume.drivers.remotefs [None req-5fb5e7e7-2914-4035-a80f-3c11e44ca06c tempest-SnapshotMetadataTestJSON-1264006369 None] /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-dc7c3f93-799a-4265-a573-e5b97a67ee23.info is being set with open permissions: ugo+rw Sep 17 22:02:06 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-5fb5e7e7-2914-4035-a80f-3c11e44ca06c tempest-SnapshotMetadataTestJSON-1264006369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-dc7c3f93-799a-4265-a573-e5b97a67ee23.info {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:02:06 devstack sudo[97949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-dc7c3f93-799a-4265-a573-e5b97a67ee23.info Sep 17 22:02:06 devstack sudo[97949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:02:06 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-aa14a268-6a91-4cb0-8d5f-91b3dc068f6b tempest-VolumesGetTest-1858470535 None] Acquiring lock "cinder-quobyte-ed0f2895-2fea-4e4a-9b3d-271088178f81" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:02:06 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-aa14a268-6a91-4cb0-8d5f-91b3dc068f6b tempest-VolumesGetTest-1858470535 None] Lock "cinder-quobyte-ed0f2895-2fea-4e4a-9b3d-271088178f81" acquired by "delete_volume" :: waited 0.029s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:02:06 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfb74cf8-b00b-4438-a114-c5d09e8c2e87]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:02:06 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-aa14a268-6a91-4cb0-8d5f-91b3dc068f6b tempest-VolumesGetTest-1858470535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ed0f2895-2fea-4e4a-9b3d-271088178f81 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:02:06 devstack sudo[97946]: pam_unix(sudo:session): session closed for user root Sep 17 22:02:06 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-c1fb0b01-3712-48bf-8c9c-ab1a3db76b90 tempest-VolumesGetTest-1858470535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.462s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:02:06 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-c1fb0b01-3712-48bf-8c9c-ab1a3db76b90 tempest-VolumesGetTest-1858470535 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:02:06 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-c1fb0b01-3712-48bf-8c9c-ab1a3db76b90 tempest-VolumesGetTest-1858470535 None] Deleted volume successfully. Sep 17 22:02:06 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-c1fb0b01-3712-48bf-8c9c-ab1a3db76b90 tempest-VolumesGetTest-1858470535 None] Lock "cinder-02218406-48f7-4504-90af-6fda6a66b946-delete_volume" released by "delete_volume" :: held 1.689s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:02:06 devstack sudo[97952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ed0f2895-2fea-4e4a-9b3d-271088178f81 Sep 17 22:02:06 devstack sudo[97952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:02:06 devstack sudo[97949]: pam_unix(sudo:session): session closed for user root Sep 17 22:02:06 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-5fb5e7e7-2914-4035-a80f-3c11e44ca06c tempest-SnapshotMetadataTestJSON-1264006369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-dc7c3f93-799a-4265-a573-e5b97a67ee23.info" returned: 0 in 0.348s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:02:06 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-5fb5e7e7-2914-4035-a80f-3c11e44ca06c tempest-SnapshotMetadataTestJSON-1264006369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.515s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:02:06 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-5fb5e7e7-2914-4035-a80f-3c11e44ca06c tempest-SnapshotMetadataTestJSON-1264006369 None] Create snapshot completed successfully Sep 17 22:02:06 devstack sudo[97952]: pam_unix(sudo:session): session closed for user root Sep 17 22:02:06 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-aa14a268-6a91-4cb0-8d5f-91b3dc068f6b tempest-VolumesGetTest-1858470535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ed0f2895-2fea-4e4a-9b3d-271088178f81" returned: 0 in 0.521s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:02:06 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-aa14a268-6a91-4cb0-8d5f-91b3dc068f6b tempest-VolumesGetTest-1858470535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ed0f2895-2fea-4e4a-9b3d-271088178f81 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:02:06 devstack sudo[97958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ed0f2895-2fea-4e4a-9b3d-271088178f81 Sep 17 22:02:06 devstack sudo[97958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:02:06 devstack sudo[97912]: pam_unix(sudo:session): session closed for user root Sep 17 22:02:06 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-bcb0a25c-f274-4453-962d-a851171f6660 tempest-VolumesExtendTest-227742800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_764e44ff-49f7-469a-925c-23f254888b59_bghrygaldevstack@QuobyteHD /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-db490653-3977-4f10-87d3-2338ef24e2e6" returned: 0 in 2.441s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:02:06 devstack cinder-volume[85458]: DEBUG cinder.image.image_utils [None req-bcb0a25c-f274-4453-962d-a851171f6660 tempest-VolumesExtendTest-227742800 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_764e44ff-49f7-469a-925c-23f254888b59_bghrygaldevstack@QuobyteHD, size 112.00 MB, duration 2.44 sec, destination /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-db490653-3977-4f10-87d3-2338ef24e2e6 {{(pid=85458) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 17 22:02:06 devstack cinder-volume[85458]: INFO cinder.image.image_utils [None req-bcb0a25c-f274-4453-962d-a851171f6660 tempest-VolumesExtendTest-227742800 None] Converted 112.00 MB image at 45.87 MB/s Sep 17 22:02:06 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-bcb0a25c-f274-4453-962d-a851171f6660 tempest-VolumesExtendTest-227742800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-db490653-3977-4f10-87d3-2338ef24e2e6 1G {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:02:06 devstack sudo[97960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-db490653-3977-4f10-87d3-2338ef24e2e6 1G Sep 17 22:02:06 devstack sudo[97960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:02:07 devstack sudo[97958]: pam_unix(sudo:session): session closed for user root Sep 17 22:02:07 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-aa14a268-6a91-4cb0-8d5f-91b3dc068f6b tempest-VolumesGetTest-1858470535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ed0f2895-2fea-4e4a-9b3d-271088178f81" returned: 0 in 0.305s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:02:07 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-aa14a268-6a91-4cb0-8d5f-91b3dc068f6b tempest-VolumesGetTest-1858470535 None] Lock "cinder-quobyte-ed0f2895-2fea-4e4a-9b3d-271088178f81" released by "delete_volume" :: held 0.883s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:02:07 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-aa14a268-6a91-4cb0-8d5f-91b3dc068f6b tempest-VolumesGetTest-1858470535 None] Created reservations ['3199454d-0ab1-4276-a738-a293add7b85c', 'a8bac95b-ecd1-4bb4-a4a6-ce349c6fb6f6', 'c2921b9e-8309-4b65-af00-78fe72b2467a', '49a572d4-fd7c-42fd-a61c-242df4d8d632'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:02:07 devstack sudo[97960]: pam_unix(sudo:session): session closed for user root Sep 17 22:02:07 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-bcb0a25c-f274-4453-962d-a851171f6660 tempest-VolumesExtendTest-227742800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-db490653-3977-4f10-87d3-2338ef24e2e6 1G" returned: 0 in 0.379s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:02:07 devstack cinder-volume[85458]: DEBUG cinder.volume.volume_utils [None req-bcb0a25c-f274-4453-962d-a851171f6660 tempest-VolumesExtendTest-227742800 None] Downloaded image 764e44ff-49f7-469a-925c-23f254888b59 ((None, [{'url': 'file:///opt/stack/data/glance/images/764e44ff-49f7-469a-925c-23f254888b59', 'metadata': {}}])) to volume db490653-3977-4f10-87d3-2338ef24e2e6 successfully. {{(pid=85458) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 17 22:02:07 devstack cinder-volume[85458]: DEBUG cinder.image.image_utils [None req-bcb0a25c-f274-4453-962d-a851171f6660 tempest-VolumesExtendTest-227742800 None] Temporary image 764e44ff-49f7-469a-925c-23f254888b59 for user be93a371e3b340cc808ec3cd80081ab5 is deleted. {{(pid=85458) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 17 22:02:07 devstack cinder-volume[85458]: DEBUG cinder.volume.volume_utils [None req-bcb0a25c-f274-4453-962d-a851171f6660 tempest-VolumesExtendTest-227742800 None] Marking volume db490653-3977-4f10-87d3-2338ef24e2e6 as bootable. {{(pid=85458) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 17 22:02:07 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-bcb0a25c-f274-4453-962d-a851171f6660 tempest-VolumesExtendTest-227742800 None] Copying metadata from image 764e44ff-49f7-469a-925c-23f254888b59 to db490653-3977-4f10-87d3-2338ef24e2e6. {{(pid=85458) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 17 22:02:07 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-bcb0a25c-f274-4453-962d-a851171f6660 tempest-VolumesExtendTest-227742800 None] Creating volume glance metadata for volume db490653-3977-4f10-87d3-2338ef24e2e6 backed by image 764e44ff-49f7-469a-925c-23f254888b59 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '764e44ff-49f7-469a-925c-23f254888b59', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=85458) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 17 22:02:07 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-aa14a268-6a91-4cb0-8d5f-91b3dc068f6b tempest-VolumesGetTest-1858470535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:02:07 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-aa14a268-6a91-4cb0-8d5f-91b3dc068f6b tempest-VolumesGetTest-1858470535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:02:07 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-aa14a268-6a91-4cb0-8d5f-91b3dc068f6b tempest-VolumesGetTest-1858470535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:02:07 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-aa14a268-6a91-4cb0-8d5f-91b3dc068f6b tempest-VolumesGetTest-1858470535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:02:07 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-aa14a268-6a91-4cb0-8d5f-91b3dc068f6b tempest-VolumesGetTest-1858470535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:02:07 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-aa14a268-6a91-4cb0-8d5f-91b3dc068f6b tempest-VolumesGetTest-1858470535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:02:07 devstack sudo[97967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:02:07 devstack sudo[97967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:02:07 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-bcb0a25c-f274-4453-962d-a851171f6660 tempest-VolumesExtendTest-227742800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12da681a-3f7e-469c-86ed-a6f2bd641be5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db490653-3977-4f10-87d3-2338ef24e2e6', 'volume_size': 1, 'image_id': '764e44ff-49f7-469a-925c-23f254888b59', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/764e44ff-49f7-469a-925c-23f254888b59', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '530062d71c924da39eff46373302dc71', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '764e44ff-49f7-469a-925c-23f254888b59', 'created_at': datetime.datetime(2026, 9, 17, 19, 45, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 19, 45, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/764e44ff-49f7-469a-925c-23f254888b59/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:02:07 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-bcb0a25c-f274-4453-962d-a851171f6660 tempest-VolumesExtendTest-227742800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afa28bc7-9be1-49eb-b99d-88a1980cb253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:02:07 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-bcb0a25c-f274-4453-962d-a851171f6660 tempest-VolumesExtendTest-227742800 None] Volume volume-db490653-3977-4f10-87d3-2338ef24e2e6 (db490653-3977-4f10-87d3-2338ef24e2e6): created successfully Sep 17 22:02:07 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-bcb0a25c-f274-4453-962d-a851171f6660 tempest-VolumesExtendTest-227742800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afa28bc7-9be1-49eb-b99d-88a1980cb253) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:02:07 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-bcb0a25c-f274-4453-962d-a851171f6660 tempest-VolumesExtendTest-227742800 None] Flow 'volume_create_manager' (f06e1f77-997c-457f-91e7-60879c15729e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:02:07 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-8a15d60a-830a-45b9-bc54-39734b573429 tempest-VolumesGetTest-1858470535 None] Acquiring lock "cinder-f116420a-73e8-4ee2-bb70-973b583e10e9-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:02:07 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-bcb0a25c-f274-4453-962d-a851171f6660 tempest-VolumesExtendTest-227742800 None] Created volume successfully. Sep 17 22:02:07 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-8a15d60a-830a-45b9-bc54-39734b573429 tempest-VolumesGetTest-1858470535 None] Lock "cinder-f116420a-73e8-4ee2-bb70-973b583e10e9-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:02:07 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-8a15d60a-830a-45b9-bc54-39734b573429 tempest-VolumesGetTest-1858470535 None] Acquiring lock "cinder-quobyte-f116420a-73e8-4ee2-bb70-973b583e10e9" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:02:07 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-8a15d60a-830a-45b9-bc54-39734b573429 tempest-VolumesGetTest-1858470535 None] Lock "cinder-quobyte-f116420a-73e8-4ee2-bb70-973b583e10e9" acquired by "delete_volume" :: waited 0.025s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:02:07 devstack sudo[97967]: pam_unix(sudo:session): session closed for user root Sep 17 22:02:07 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-aa14a268-6a91-4cb0-8d5f-91b3dc068f6b tempest-VolumesGetTest-1858470535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.324s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:02:07 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-aa14a268-6a91-4cb0-8d5f-91b3dc068f6b tempest-VolumesGetTest-1858470535 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:02:07 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[37e9fe81-938c-470a-97c0-065742b6eb1d]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:02:07 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-aa14a268-6a91-4cb0-8d5f-91b3dc068f6b tempest-VolumesGetTest-1858470535 None] Deleted volume successfully. Sep 17 22:02:07 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-8a15d60a-830a-45b9-bc54-39734b573429 tempest-VolumesGetTest-1858470535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f116420a-73e8-4ee2-bb70-973b583e10e9 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:02:07 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-aa14a268-6a91-4cb0-8d5f-91b3dc068f6b tempest-VolumesGetTest-1858470535 None] Lock "cinder-ed0f2895-2fea-4e4a-9b3d-271088178f81-delete_volume" released by "delete_volume" :: held 1.592s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:02:07 devstack sudo[97970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f116420a-73e8-4ee2-bb70-973b583e10e9 Sep 17 22:02:07 devstack sudo[97970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:02:08 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-da968001-db33-4628-a460-6a6ce8e89819 tempest-VolumesExtendTest-227742800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:02:08 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-da968001-db33-4628-a460-6a6ce8e89819 tempest-VolumesExtendTest-227742800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:02:08 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[67a44a61-5361-4ab8-8a97-6afb63e51d7d]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:02:08 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-da968001-db33-4628-a460-6a6ce8e89819 tempest-VolumesExtendTest-227742800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-db490653-3977-4f10-87d3-2338ef24e2e6 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:02:08 devstack sudo[97970]: pam_unix(sudo:session): session closed for user root Sep 17 22:02:08 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-8a15d60a-830a-45b9-bc54-39734b573429 tempest-VolumesGetTest-1858470535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f116420a-73e8-4ee2-bb70-973b583e10e9" returned: 0 in 0.525s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:02:08 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-8a15d60a-830a-45b9-bc54-39734b573429 tempest-VolumesGetTest-1858470535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f116420a-73e8-4ee2-bb70-973b583e10e9 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:02:08 devstack sudo[97976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f116420a-73e8-4ee2-bb70-973b583e10e9 Sep 17 22:02:08 devstack sudo[97976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:02:08 devstack sudo[97975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-db490653-3977-4f10-87d3-2338ef24e2e6 Sep 17 22:02:08 devstack sudo[97975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:02:08 devstack sudo[97976]: pam_unix(sudo:session): session closed for user root Sep 17 22:02:08 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-8a15d60a-830a-45b9-bc54-39734b573429 tempest-VolumesGetTest-1858470535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f116420a-73e8-4ee2-bb70-973b583e10e9" returned: 0 in 0.339s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:02:08 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-8a15d60a-830a-45b9-bc54-39734b573429 tempest-VolumesGetTest-1858470535 None] Lock "cinder-quobyte-f116420a-73e8-4ee2-bb70-973b583e10e9" released by "delete_volume" :: held 0.963s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:02:08 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-5fd22a2e-3c1d-4fad-a81f-9ad14153bf82 tempest-SnapshotMetadataTestJSON-1264006369 None] Acquiring lock "cinder-417b8600-cd87-4760-b467-d016d56c64ed-delete_snapshot" by "delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:02:08 devstack sudo[97975]: pam_unix(sudo:session): session closed for user root Sep 17 22:02:08 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-da968001-db33-4628-a460-6a6ce8e89819 tempest-VolumesExtendTest-227742800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-db490653-3977-4f10-87d3-2338ef24e2e6" returned: 0 in 0.532s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:02:08 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-da968001-db33-4628-a460-6a6ce8e89819 tempest-VolumesExtendTest-227742800 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-db490653-3977-4f10-87d3-2338ef24e2e6 2G {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:02:08 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-8a15d60a-830a-45b9-bc54-39734b573429 tempest-VolumesGetTest-1858470535 None] Created reservations ['f2486396-51eb-47cf-b8ca-042308ecf2d1', 'b6a8476c-db4a-468e-bb2b-206f83f5ddb3', 'ddeb70db-baa5-45ac-ac09-92209b518ea5', '254478f5-23ac-464e-bac9-03c00d41baa3'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:02:08 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-5fd22a2e-3c1d-4fad-a81f-9ad14153bf82 tempest-SnapshotMetadataTestJSON-1264006369 None] Lock "cinder-417b8600-cd87-4760-b467-d016d56c64ed-delete_snapshot" acquired by "delete_snapshot" :: waited 0.056s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:02:08 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-5fd22a2e-3c1d-4fad-a81f-9ad14153bf82 tempest-SnapshotMetadataTestJSON-1264006369 None] Acquiring lock "cinder-quobyte-dc7c3f93-799a-4265-a573-e5b97a67ee23" by "delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:02:08 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-5fd22a2e-3c1d-4fad-a81f-9ad14153bf82 tempest-SnapshotMetadataTestJSON-1264006369 None] Lock "cinder-quobyte-dc7c3f93-799a-4265-a573-e5b97a67ee23" acquired by "delete_snapshot" :: waited 0.037s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:02:08 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-5fd22a2e-3c1d-4fad-a81f-9ad14153bf82 tempest-SnapshotMetadataTestJSON-1264006369 None] Acquiring lock "cinder-quobyte-417b8600-cd87-4760-b467-d016d56c64ed" by "_delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:02:08 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-5fd22a2e-3c1d-4fad-a81f-9ad14153bf82 tempest-SnapshotMetadataTestJSON-1264006369 None] Lock "cinder-quobyte-417b8600-cd87-4760-b467-d016d56c64ed" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:02:08 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-5fd22a2e-3c1d-4fad-a81f-9ad14153bf82 tempest-SnapshotMetadataTestJSON-1264006369 None] Deleting offline snapshot 417b8600-cd87-4760-b467-d016d56c64ed of volume dc7c3f93-799a-4265-a573-e5b97a67ee23 {{(pid=85458) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 22:02:08 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-5fd22a2e-3c1d-4fad-a81f-9ad14153bf82 tempest-SnapshotMetadataTestJSON-1264006369 None] snapshot_file for this snap is: volume-dc7c3f93-799a-4265-a573-e5b97a67ee23.417b8600-cd87-4760-b467-d016d56c64ed {{(pid=85458) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 22:02:08 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-da968001-db33-4628-a460-6a6ce8e89819 tempest-VolumesExtendTest-227742800 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-db490653-3977-4f10-87d3-2338ef24e2e6 2G" returned: 0 in 0.145s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:02:08 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-da968001-db33-4628-a460-6a6ce8e89819 tempest-VolumesExtendTest-227742800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.716s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:02:08 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cdb8eda-ce09-4f4e-9cdc-99bfecd446c1]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:02:08 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-5fd22a2e-3c1d-4fad-a81f-9ad14153bf82 tempest-SnapshotMetadataTestJSON-1264006369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-dc7c3f93-799a-4265-a573-e5b97a67ee23.417b8600-cd87-4760-b467-d016d56c64ed {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:02:08 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-8a15d60a-830a-45b9-bc54-39734b573429 tempest-VolumesGetTest-1858470535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:02:08 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-8a15d60a-830a-45b9-bc54-39734b573429 tempest-VolumesGetTest-1858470535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:02:08 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-8a15d60a-830a-45b9-bc54-39734b573429 tempest-VolumesGetTest-1858470535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:02:08 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-8a15d60a-830a-45b9-bc54-39734b573429 tempest-VolumesGetTest-1858470535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:02:08 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-8a15d60a-830a-45b9-bc54-39734b573429 tempest-VolumesGetTest-1858470535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:02:08 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-8a15d60a-830a-45b9-bc54-39734b573429 tempest-VolumesGetTest-1858470535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:02:08 devstack sudo[97989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:02:08 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-da968001-db33-4628-a460-6a6ce8e89819 tempest-VolumesExtendTest-227742800 None] Extend volume completed successfully. Sep 17 22:02:08 devstack sudo[97989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:02:08 devstack sudo[97988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-dc7c3f93-799a-4265-a573-e5b97a67ee23.417b8600-cd87-4760-b467-d016d56c64ed Sep 17 22:02:08 devstack sudo[97988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:02:09 devstack sudo[97989]: pam_unix(sudo:session): session closed for user root Sep 17 22:02:09 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-8a15d60a-830a-45b9-bc54-39734b573429 tempest-VolumesGetTest-1858470535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.518s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:02:09 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-8a15d60a-830a-45b9-bc54-39734b573429 tempest-VolumesGetTest-1858470535 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:02:09 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-8a15d60a-830a-45b9-bc54-39734b573429 tempest-VolumesGetTest-1858470535 None] Deleted volume successfully. Sep 17 22:02:09 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-8a15d60a-830a-45b9-bc54-39734b573429 tempest-VolumesGetTest-1858470535 None] Lock "cinder-f116420a-73e8-4ee2-bb70-973b583e10e9-delete_volume" released by "delete_volume" :: held 1.959s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:02:09 devstack sudo[97988]: pam_unix(sudo:session): session closed for user root Sep 17 22:02:09 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-5fd22a2e-3c1d-4fad-a81f-9ad14153bf82 tempest-SnapshotMetadataTestJSON-1264006369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-dc7c3f93-799a-4265-a573-e5b97a67ee23.417b8600-cd87-4760-b467-d016d56c64ed" returned: 0 in 0.638s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:02:09 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-5fd22a2e-3c1d-4fad-a81f-9ad14153bf82 tempest-SnapshotMetadataTestJSON-1264006369 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dc7c3f93-799a-4265-a573-e5b97a67ee23(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85458) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 22:02:09 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[2af727d2-c95a-48fc-b10d-5dc37e440d08]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:02:09 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-5fd22a2e-3c1d-4fad-a81f-9ad14153bf82 tempest-SnapshotMetadataTestJSON-1264006369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-dc7c3f93-799a-4265-a573-e5b97a67ee23 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:02:09 devstack sudo[97997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-dc7c3f93-799a-4265-a573-e5b97a67ee23 Sep 17 22:02:09 devstack sudo[97997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:02:09 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-f0d77903-0aaa-408e-b130-45cd82dcadad tempest-VolumesExtendTest-227742800 None] Acquiring lock "cinder-db490653-3977-4f10-87d3-2338ef24e2e6-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:02:09 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-f0d77903-0aaa-408e-b130-45cd82dcadad tempest-VolumesExtendTest-227742800 None] Lock "cinder-db490653-3977-4f10-87d3-2338ef24e2e6-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:02:09 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-f0d77903-0aaa-408e-b130-45cd82dcadad tempest-VolumesExtendTest-227742800 None] Acquiring lock "cinder-quobyte-db490653-3977-4f10-87d3-2338ef24e2e6" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:02:09 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-f0d77903-0aaa-408e-b130-45cd82dcadad tempest-VolumesExtendTest-227742800 None] Lock "cinder-quobyte-db490653-3977-4f10-87d3-2338ef24e2e6" acquired by "delete_volume" :: waited 0.025s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:02:09 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fd40156-161e-4ac9-bdab-31f5ed0a4c44]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:02:09 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-f0d77903-0aaa-408e-b130-45cd82dcadad tempest-VolumesExtendTest-227742800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-db490653-3977-4f10-87d3-2338ef24e2e6 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:02:09 devstack sudo[97997]: pam_unix(sudo:session): session closed for user root Sep 17 22:02:10 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-5fd22a2e-3c1d-4fad-a81f-9ad14153bf82 tempest-SnapshotMetadataTestJSON-1264006369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-dc7c3f93-799a-4265-a573-e5b97a67ee23" returned: 0 in 0.539s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:02:10 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-5fd22a2e-3c1d-4fad-a81f-9ad14153bf82 tempest-SnapshotMetadataTestJSON-1264006369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-dc7c3f93-799a-4265-a573-e5b97a67ee23.417b8600-cd87-4760-b467-d016d56c64ed {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:02:10 devstack sudo[98004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-dc7c3f93-799a-4265-a573-e5b97a67ee23.417b8600-cd87-4760-b467-d016d56c64ed Sep 17 22:02:10 devstack sudo[98004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:02:10 devstack sudo[98003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-db490653-3977-4f10-87d3-2338ef24e2e6 Sep 17 22:02:10 devstack sudo[98003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:02:10 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b2ed6f5-9c3d-411e-b9c7-7f66a721d5b1 tempest-VolumesGetTest-1858470535 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 22:02:10 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-9b2ed6f5-9c3d-411e-b9c7-7f66a721d5b1 tempest-VolumesGetTest-1858470535 None] Flow 'volume_create_manager' (ea85fc90-caa2-4a1d-b4db-5a80e4cae505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:02:10 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-9b2ed6f5-9c3d-411e-b9c7-7f66a721d5b1 tempest-VolumesGetTest-1858470535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (947e5874-75c1-4706-9a06-fcf46c009e5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:02:10 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-9b2ed6f5-9c3d-411e-b9c7-7f66a721d5b1 tempest-VolumesGetTest-1858470535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (947e5874-75c1-4706-9a06-fcf46c009e5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:02:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1976460195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=522710a7-a8f9-4f77-a31a-e2444f8a2935,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='cfeba540fd8a4d37b58b43b2b38ce1e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:02:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:02:10Z,use_quota=True,user_id='5c1a5bbe85894370877379762b25947b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:02:10 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-9b2ed6f5-9c3d-411e-b9c7-7f66a721d5b1 tempest-VolumesGetTest-1858470535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3943daf0-5f9e-4610-968c-081c69932c6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:02:10 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-9b2ed6f5-9c3d-411e-b9c7-7f66a721d5b1 tempest-VolumesGetTest-1858470535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3943daf0-5f9e-4610-968c-081c69932c6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:02:10 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-9b2ed6f5-9c3d-411e-b9c7-7f66a721d5b1 tempest-VolumesGetTest-1858470535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b13763e1-6923-40a7-b99a-e9546ac61c5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:02:10 devstack cinder-volume[85458]: DEBUG cinder.image.glance [None req-9b2ed6f5-9c3d-411e-b9c7-7f66a721d5b1 tempest-VolumesGetTest-1858470535 None] Creating Keystone auth plugin from conf {{(pid=85458) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 17 22:02:10 devstack sudo[98004]: pam_unix(sudo:session): session closed for user root Sep 17 22:02:10 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-5fd22a2e-3c1d-4fad-a81f-9ad14153bf82 tempest-SnapshotMetadataTestJSON-1264006369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-dc7c3f93-799a-4265-a573-e5b97a67ee23.417b8600-cd87-4760-b467-d016d56c64ed" returned: 0 in 0.403s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:02:10 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-5fd22a2e-3c1d-4fad-a81f-9ad14153bf82 tempest-SnapshotMetadataTestJSON-1264006369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-dc7c3f93-799a-4265-a573-e5b97a67ee23.417b8600-cd87-4760-b467-d016d56c64ed {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:02:10 devstack sudo[98003]: pam_unix(sudo:session): session closed for user root Sep 17 22:02:10 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-f0d77903-0aaa-408e-b130-45cd82dcadad tempest-VolumesExtendTest-227742800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-db490653-3977-4f10-87d3-2338ef24e2e6" returned: 0 in 0.446s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:02:10 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-f0d77903-0aaa-408e-b130-45cd82dcadad tempest-VolumesExtendTest-227742800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-db490653-3977-4f10-87d3-2338ef24e2e6 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:02:10 devstack sudo[98013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-dc7c3f93-799a-4265-a573-e5b97a67ee23.417b8600-cd87-4760-b467-d016d56c64ed Sep 17 22:02:10 devstack sudo[98013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:02:10 devstack sudo[98014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-db490653-3977-4f10-87d3-2338ef24e2e6 Sep 17 22:02:10 devstack sudo[98014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:02:10 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-9b2ed6f5-9c3d-411e-b9c7-7f66a721d5b1 tempest-VolumesGetTest-1858470535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b13763e1-6923-40a7-b99a-e9546ac61c5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '522710a7-a8f9-4f77-a31a-e2444f8a2935', 'volume_name': 'volume-522710a7-a8f9-4f77-a31a-e2444f8a2935', 'volume_size': 1, 'image_id': '764e44ff-49f7-469a-925c-23f254888b59', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/764e44ff-49f7-469a-925c-23f254888b59', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '530062d71c924da39eff46373302dc71', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '764e44ff-49f7-469a-925c-23f254888b59', 'created_at': datetime.datetime(2026, 9, 17, 19, 45, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 19, 45, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/764e44ff-49f7-469a-925c-23f254888b59/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:02:10 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-9b2ed6f5-9c3d-411e-b9c7-7f66a721d5b1 tempest-VolumesGetTest-1858470535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6b4a1d8-58bb-4d71-9d1d-8d0860cf3b86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:02:10 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-9b2ed6f5-9c3d-411e-b9c7-7f66a721d5b1 tempest-VolumesGetTest-1858470535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6b4a1d8-58bb-4d71-9d1d-8d0860cf3b86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:02:10 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-9b2ed6f5-9c3d-411e-b9c7-7f66a721d5b1 tempest-VolumesGetTest-1858470535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bcf7813-61a4-4919-adac-ab52a2549a37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:02:10 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-9b2ed6f5-9c3d-411e-b9c7-7f66a721d5b1 tempest-VolumesGetTest-1858470535 None] Volume 522710a7-a8f9-4f77-a31a-e2444f8a2935: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-522710a7-a8f9-4f77-a31a-e2444f8a2935', 'volume_size': 1, 'image_id': '764e44ff-49f7-469a-925c-23f254888b59', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/764e44ff-49f7-469a-925c-23f254888b59', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '530062d71c924da39eff46373302dc71', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '764e44ff-49f7-469a-925c-23f254888b59', 'created_at': datetime.datetime(2026, 9, 17, 19, 45, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 19, 45, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/764e44ff-49f7-469a-925c-23f254888b59/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 17 22:02:10 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b2ed6f5-9c3d-411e-b9c7-7f66a721d5b1 tempest-VolumesGetTest-1858470535 None] Trying to clone 522710a7-a8f9-4f77-a31a-e2444f8a2935 from image 764e44ff-49f7-469a-925c-23f254888b59 at location (None, [{'url': 'file:///opt/stack/data/glance/images/764e44ff-49f7-469a-925c-23f254888b59', 'metadata': {}}]). {{(pid=85458) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 17 22:02:10 devstack sudo[98013]: pam_unix(sudo:session): session closed for user root Sep 17 22:02:10 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-5fd22a2e-3c1d-4fad-a81f-9ad14153bf82 tempest-SnapshotMetadataTestJSON-1264006369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-dc7c3f93-799a-4265-a573-e5b97a67ee23.417b8600-cd87-4760-b467-d016d56c64ed" returned: 0 in 0.338s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:02:10 devstack sudo[98014]: pam_unix(sudo:session): session closed for user root Sep 17 22:02:10 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-f0d77903-0aaa-408e-b130-45cd82dcadad tempest-VolumesExtendTest-227742800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-db490653-3977-4f10-87d3-2338ef24e2e6" returned: 0 in 0.386s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:02:10 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-5fd22a2e-3c1d-4fad-a81f-9ad14153bf82 tempest-SnapshotMetadataTestJSON-1264006369 None] Lock "cinder-quobyte-417b8600-cd87-4760-b467-d016d56c64ed" released by "_delete_snapshot" :: held 2.116s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:02:10 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-f0d77903-0aaa-408e-b130-45cd82dcadad tempest-VolumesExtendTest-227742800 None] Lock "cinder-quobyte-db490653-3977-4f10-87d3-2338ef24e2e6" released by "delete_volume" :: held 0.895s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:02:10 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-5fd22a2e-3c1d-4fad-a81f-9ad14153bf82 tempest-SnapshotMetadataTestJSON-1264006369 None] Lock "cinder-quobyte-dc7c3f93-799a-4265-a573-e5b97a67ee23" released by "delete_snapshot" :: held 2.164s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:02:11 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-f0d77903-0aaa-408e-b130-45cd82dcadad tempest-VolumesExtendTest-227742800 None] Created reservations ['25a5c8f5-e62d-43e6-8865-54087fa80071', 'f7a61cad-37f9-4615-a683-74b4377e69e5', '7c9eb4c3-3c43-404b-9d2b-3f5855e6a434', 'f7009468-040a-415b-952b-2ceff03983da'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:02:11 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-5fd22a2e-3c1d-4fad-a81f-9ad14153bf82 tempest-SnapshotMetadataTestJSON-1264006369 None] Created reservations ['13f9ea33-a676-432b-929b-0faa8e91182c', '0df7f4d4-19be-4156-8359-b707b08dba9f', '9860dac7-54d4-4395-8ffb-9e4564ce66b1', '7db98b84-d5b7-435a-9951-46646fa235d0'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:02:11 devstack cinder-volume[85458]: DEBUG cinder.image.image_utils [None req-9b2ed6f5-9c3d-411e-b9c7-7f66a721d5b1 tempest-VolumesGetTest-1858470535 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_764e44ff-49f7-469a-925c-23f254888b59_8n2f8efxdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=85458) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 17 22:02:11 devstack cinder-volume[85458]: INFO cinder.image.image_utils [None req-9b2ed6f5-9c3d-411e-b9c7-7f66a721d5b1 tempest-VolumesGetTest-1858470535 None] Image download 20.69 MB at 20.69 MB/s Sep 17 22:02:11 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-f0d77903-0aaa-408e-b130-45cd82dcadad tempest-VolumesExtendTest-227742800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:02:11 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-f0d77903-0aaa-408e-b130-45cd82dcadad tempest-VolumesExtendTest-227742800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:02:11 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-f0d77903-0aaa-408e-b130-45cd82dcadad tempest-VolumesExtendTest-227742800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:02:11 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-f0d77903-0aaa-408e-b130-45cd82dcadad tempest-VolumesExtendTest-227742800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:02:11 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-f0d77903-0aaa-408e-b130-45cd82dcadad tempest-VolumesExtendTest-227742800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:02:11 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-f0d77903-0aaa-408e-b130-45cd82dcadad tempest-VolumesExtendTest-227742800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:02:11 devstack sudo[98020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:02:11 devstack sudo[98020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:02:11 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ee927f8-ac33-431e-9550-4d6b1b2bf8fd]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:02:11 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-9b2ed6f5-9c3d-411e-b9c7-7f66a721d5b1 tempest-VolumesGetTest-1858470535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_764e44ff-49f7-469a-925c-23f254888b59_8n2f8efxdevstack@QuobyteHD {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:02:11 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-5fd22a2e-3c1d-4fad-a81f-9ad14153bf82 tempest-SnapshotMetadataTestJSON-1264006369 None] Delete snapshot completed successfully. Sep 17 22:02:11 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-5fd22a2e-3c1d-4fad-a81f-9ad14153bf82 tempest-SnapshotMetadataTestJSON-1264006369 None] Lock "cinder-417b8600-cd87-4760-b467-d016d56c64ed-delete_snapshot" released by "delete_snapshot" :: held 2.581s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:02:11 devstack sudo[98022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_764e44ff-49f7-469a-925c-23f254888b59_8n2f8efxdevstack@QuobyteHD Sep 17 22:02:11 devstack sudo[98022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:02:11 devstack sudo[98020]: pam_unix(sudo:session): session closed for user root Sep 17 22:02:11 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-f0d77903-0aaa-408e-b130-45cd82dcadad tempest-VolumesExtendTest-227742800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.265s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:02:11 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-f0d77903-0aaa-408e-b130-45cd82dcadad tempest-VolumesExtendTest-227742800 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:02:11 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-f0d77903-0aaa-408e-b130-45cd82dcadad tempest-VolumesExtendTest-227742800 None] Deleted volume successfully. Sep 17 22:02:11 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-f0d77903-0aaa-408e-b130-45cd82dcadad tempest-VolumesExtendTest-227742800 None] Lock "cinder-db490653-3977-4f10-87d3-2338ef24e2e6-delete_volume" released by "delete_volume" :: held 1.592s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:02:11 devstack sudo[98022]: pam_unix(sudo:session): session closed for user root Sep 17 22:02:11 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-9b2ed6f5-9c3d-411e-b9c7-7f66a721d5b1 tempest-VolumesGetTest-1858470535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_764e44ff-49f7-469a-925c-23f254888b59_8n2f8efxdevstack@QuobyteHD" returned: 0 in 0.338s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:02:11 devstack cinder-volume[85458]: DEBUG cinder.image.image_utils [None req-9b2ed6f5-9c3d-411e-b9c7-7f66a721d5b1 tempest-VolumesGetTest-1858470535 None] Temporary image 764e44ff-49f7-469a-925c-23f254888b59 is fetched for user 5c1a5bbe85894370877379762b25947b. {{(pid=85458) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 17 22:02:11 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[daeab7f3-8582-4e2b-8d6e-d3ed1030c4f2]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:02:11 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-9b2ed6f5-9c3d-411e-b9c7-7f66a721d5b1 tempest-VolumesGetTest-1858470535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_764e44ff-49f7-469a-925c-23f254888b59_8n2f8efxdevstack@QuobyteHD {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:02:11 devstack sudo[98028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_764e44ff-49f7-469a-925c-23f254888b59_8n2f8efxdevstack@QuobyteHD Sep 17 22:02:11 devstack sudo[98028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:02:11 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-1305f1c1-3c2e-4774-acd4-a88ae382581f tempest-SnapshotMetadataTestJSON-1264006369 None] Acquiring lock "cinder-dc7c3f93-799a-4265-a573-e5b97a67ee23-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:02:11 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-1305f1c1-3c2e-4774-acd4-a88ae382581f tempest-SnapshotMetadataTestJSON-1264006369 None] Lock "cinder-dc7c3f93-799a-4265-a573-e5b97a67ee23-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:02:12 devstack sudo[98028]: pam_unix(sudo:session): session closed for user root Sep 17 22:02:12 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-9b2ed6f5-9c3d-411e-b9c7-7f66a721d5b1 tempest-VolumesGetTest-1858470535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_764e44ff-49f7-469a-925c-23f254888b59_8n2f8efxdevstack@QuobyteHD" returned: 0 in 0.409s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:02:12 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-9b2ed6f5-9c3d-411e-b9c7-7f66a721d5b1 tempest-VolumesGetTest-1858470535 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:02:12 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-9b2ed6f5-9c3d-411e-b9c7-7f66a721d5b1 tempest-VolumesGetTest-1858470535 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:02:12 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-9b2ed6f5-9c3d-411e-b9c7-7f66a721d5b1 tempest-VolumesGetTest-1858470535 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:02:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1976460195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=522710a7-a8f9-4f77-a31a-e2444f8a2935,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='cfeba540fd8a4d37b58b43b2b38ce1e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:02:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:02:10Z,use_quota=True,user_id='5c1a5bbe85894370877379762b25947b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 22:02:12 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-9b2ed6f5-9c3d-411e-b9c7-7f66a721d5b1 tempest-VolumesGetTest-1858470535 None] Creating volume 522710a7-a8f9-4f77-a31a-e2444f8a2935 {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 22:02:12 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-9b2ed6f5-9c3d-411e-b9c7-7f66a721d5b1 tempest-VolumesGetTest-1858470535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:02:12 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-9b2ed6f5-9c3d-411e-b9c7-7f66a721d5b1 tempest-VolumesGetTest-1858470535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:02:12 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-9b2ed6f5-9c3d-411e-b9c7-7f66a721d5b1 tempest-VolumesGetTest-1858470535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:02:12 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-9b2ed6f5-9c3d-411e-b9c7-7f66a721d5b1 tempest-VolumesGetTest-1858470535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:02:12 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-9b2ed6f5-9c3d-411e-b9c7-7f66a721d5b1 tempest-VolumesGetTest-1858470535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:02:12 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-9b2ed6f5-9c3d-411e-b9c7-7f66a721d5b1 tempest-VolumesGetTest-1858470535 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 22:02:12 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-9b2ed6f5-9c3d-411e-b9c7-7f66a721d5b1 tempest-VolumesGetTest-1858470535 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 22:02:12 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-9b2ed6f5-9c3d-411e-b9c7-7f66a721d5b1 tempest-VolumesGetTest-1858470535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-522710a7-a8f9-4f77-a31a-e2444f8a2935 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:02:12 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-1305f1c1-3c2e-4774-acd4-a88ae382581f tempest-SnapshotMetadataTestJSON-1264006369 None] Acquiring lock "cinder-quobyte-dc7c3f93-799a-4265-a573-e5b97a67ee23" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:02:12 devstack sudo[98033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-522710a7-a8f9-4f77-a31a-e2444f8a2935 1073741824 Sep 17 22:02:12 devstack sudo[98033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:02:12 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-1305f1c1-3c2e-4774-acd4-a88ae382581f tempest-SnapshotMetadataTestJSON-1264006369 None] Lock "cinder-quobyte-dc7c3f93-799a-4265-a573-e5b97a67ee23" acquired by "delete_volume" :: waited 0.023s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:02:12 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b1fb266-3754-46a8-b162-e471a5cdc878]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:02:12 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-1305f1c1-3c2e-4774-acd4-a88ae382581f tempest-SnapshotMetadataTestJSON-1264006369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-dc7c3f93-799a-4265-a573-e5b97a67ee23 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:02:12 devstack sudo[98035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-dc7c3f93-799a-4265-a573-e5b97a67ee23 Sep 17 22:02:12 devstack sudo[98035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:02:12 devstack sudo[98035]: pam_unix(sudo:session): session closed for user root Sep 17 22:02:12 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-1305f1c1-3c2e-4774-acd4-a88ae382581f tempest-SnapshotMetadataTestJSON-1264006369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-dc7c3f93-799a-4265-a573-e5b97a67ee23" returned: 0 in 0.457s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:02:12 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-1305f1c1-3c2e-4774-acd4-a88ae382581f tempest-SnapshotMetadataTestJSON-1264006369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-dc7c3f93-799a-4265-a573-e5b97a67ee23 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:02:12 devstack sudo[98044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-dc7c3f93-799a-4265-a573-e5b97a67ee23 Sep 17 22:02:12 devstack sudo[98044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:02:12 devstack sudo[98033]: pam_unix(sudo:session): session closed for user root Sep 17 22:02:12 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-9b2ed6f5-9c3d-411e-b9c7-7f66a721d5b1 tempest-VolumesGetTest-1858470535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-522710a7-a8f9-4f77-a31a-e2444f8a2935 1073741824" returned: 0 in 0.617s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:02:12 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-44712bd6-5ed0-46a3-907b-b86eca670a44 tempest-VolumesExtendTest-227742800 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 22:02:12 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-44712bd6-5ed0-46a3-907b-b86eca670a44 tempest-VolumesExtendTest-227742800 None] Flow 'volume_create_manager' (6749bf2f-4e47-4d41-9de0-908ec15fb63f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:02:12 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-44712bd6-5ed0-46a3-907b-b86eca670a44 tempest-VolumesExtendTest-227742800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b49f506-19d5-4dc4-9b8a-27f5795fab21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:02:12 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-44712bd6-5ed0-46a3-907b-b86eca670a44 tempest-VolumesExtendTest-227742800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b49f506-19d5-4dc4-9b8a-27f5795fab21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:02:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-904936741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f00dd72-e6c7-4332-a871-f74d30a01a81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de5752c44a8c4ee991addc1069fd83af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:02:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:02:13Z,use_quota=True,user_id='be93a371e3b340cc808ec3cd80081ab5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:02:12 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-44712bd6-5ed0-46a3-907b-b86eca670a44 tempest-VolumesExtendTest-227742800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3022b31-fc38-41fb-bc36-3faa959a4a3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:02:12 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-44712bd6-5ed0-46a3-907b-b86eca670a44 tempest-VolumesExtendTest-227742800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3022b31-fc38-41fb-bc36-3faa959a4a3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:02:12 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-44712bd6-5ed0-46a3-907b-b86eca670a44 tempest-VolumesExtendTest-227742800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03e8ce8a-b709-4376-a61d-216a73562bb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:02:12 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-44712bd6-5ed0-46a3-907b-b86eca670a44 tempest-VolumesExtendTest-227742800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03e8ce8a-b709-4376-a61d-216a73562bb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f00dd72-e6c7-4332-a871-f74d30a01a81', 'volume_name': 'volume-3f00dd72-e6c7-4332-a871-f74d30a01a81', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:02:12 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-44712bd6-5ed0-46a3-907b-b86eca670a44 tempest-VolumesExtendTest-227742800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c47cf2b0-99dc-4e74-ae86-22a40b0444c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:02:12 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-44712bd6-5ed0-46a3-907b-b86eca670a44 tempest-VolumesExtendTest-227742800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c47cf2b0-99dc-4e74-ae86-22a40b0444c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:02:12 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-44712bd6-5ed0-46a3-907b-b86eca670a44 tempest-VolumesExtendTest-227742800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e854413-1be9-4f27-815a-a46deb6c2e06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:02:12 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-44712bd6-5ed0-46a3-907b-b86eca670a44 tempest-VolumesExtendTest-227742800 None] Volume 3f00dd72-e6c7-4332-a871-f74d30a01a81: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f00dd72-e6c7-4332-a871-f74d30a01a81', 'volume_size': 1} Sep 17 22:02:12 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-44712bd6-5ed0-46a3-907b-b86eca670a44 tempest-VolumesExtendTest-227742800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:02:12 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-9b2ed6f5-9c3d-411e-b9c7-7f66a721d5b1 tempest-VolumesGetTest-1858470535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-522710a7-a8f9-4f77-a31a-e2444f8a2935 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:02:12 devstack sudo[98046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-522710a7-a8f9-4f77-a31a-e2444f8a2935 Sep 17 22:02:12 devstack sudo[98046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:02:12 devstack sudo[98044]: pam_unix(sudo:session): session closed for user root Sep 17 22:02:12 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-1305f1c1-3c2e-4774-acd4-a88ae382581f tempest-SnapshotMetadataTestJSON-1264006369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-dc7c3f93-799a-4265-a573-e5b97a67ee23" returned: 0 in 0.272s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:02:12 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-1305f1c1-3c2e-4774-acd4-a88ae382581f tempest-SnapshotMetadataTestJSON-1264006369 None] Lock "cinder-quobyte-dc7c3f93-799a-4265-a573-e5b97a67ee23" released by "delete_volume" :: held 0.811s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:02:13 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-1305f1c1-3c2e-4774-acd4-a88ae382581f tempest-SnapshotMetadataTestJSON-1264006369 None] Created reservations ['97ca6c69-eefe-479b-a768-51ded073beb4', '24d5fa49-fd24-40d4-80e2-717882568639', 'c81a62b1-ed27-4c46-bce5-5cf53a960235', '0629a133-c230-4dfc-8ac5-c33237c9e2bb'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:02:13 devstack sudo[98046]: pam_unix(sudo:session): session closed for user root Sep 17 22:02:13 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-9b2ed6f5-9c3d-411e-b9c7-7f66a721d5b1 tempest-VolumesGetTest-1858470535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-522710a7-a8f9-4f77-a31a-e2444f8a2935" returned: 0 in 0.266s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:02:13 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-9b2ed6f5-9c3d-411e-b9c7-7f66a721d5b1 tempest-VolumesGetTest-1858470535 None] <== create_volume: return (1006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 22:02:13 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-9b2ed6f5-9c3d-411e-b9c7-7f66a721d5b1 tempest-VolumesGetTest-1858470535 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.017s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:02:13 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-44712bd6-5ed0-46a3-907b-b86eca670a44 tempest-VolumesExtendTest-227742800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.273s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:02:13 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-44712bd6-5ed0-46a3-907b-b86eca670a44 tempest-VolumesExtendTest-227742800 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:02:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-904936741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f00dd72-e6c7-4332-a871-f74d30a01a81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de5752c44a8c4ee991addc1069fd83af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:02:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:02:13Z,use_quota=True,user_id='be93a371e3b340cc808ec3cd80081ab5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 22:02:13 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-44712bd6-5ed0-46a3-907b-b86eca670a44 tempest-VolumesExtendTest-227742800 None] Creating volume 3f00dd72-e6c7-4332-a871-f74d30a01a81 {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 22:02:13 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-44712bd6-5ed0-46a3-907b-b86eca670a44 tempest-VolumesExtendTest-227742800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:02:13 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-44712bd6-5ed0-46a3-907b-b86eca670a44 tempest-VolumesExtendTest-227742800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:02:13 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-44712bd6-5ed0-46a3-907b-b86eca670a44 tempest-VolumesExtendTest-227742800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:02:13 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-44712bd6-5ed0-46a3-907b-b86eca670a44 tempest-VolumesExtendTest-227742800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:02:13 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-44712bd6-5ed0-46a3-907b-b86eca670a44 tempest-VolumesExtendTest-227742800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:02:13 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-44712bd6-5ed0-46a3-907b-b86eca670a44 tempest-VolumesExtendTest-227742800 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 22:02:13 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-44712bd6-5ed0-46a3-907b-b86eca670a44 tempest-VolumesExtendTest-227742800 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 22:02:13 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-44712bd6-5ed0-46a3-907b-b86eca670a44 tempest-VolumesExtendTest-227742800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-3f00dd72-e6c7-4332-a871-f74d30a01a81 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:02:13 devstack sudo[98050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-3f00dd72-e6c7-4332-a871-f74d30a01a81 1073741824 Sep 17 22:02:13 devstack sudo[98050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:02:13 devstack cinder-volume[85458]: DEBUG cinder.volume.volume_utils [None req-9b2ed6f5-9c3d-411e-b9c7-7f66a721d5b1 tempest-VolumesGetTest-1858470535 None] Attempting download of 764e44ff-49f7-469a-925c-23f254888b59 ((None, [{'url': 'file:///opt/stack/data/glance/images/764e44ff-49f7-469a-925c-23f254888b59', 'metadata': {}}])) to volume 522710a7-a8f9-4f77-a31a-e2444f8a2935. {{(pid=85458) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 17 22:02:13 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-1305f1c1-3c2e-4774-acd4-a88ae382581f tempest-SnapshotMetadataTestJSON-1264006369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:02:13 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-1305f1c1-3c2e-4774-acd4-a88ae382581f tempest-SnapshotMetadataTestJSON-1264006369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:02:13 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-1305f1c1-3c2e-4774-acd4-a88ae382581f tempest-SnapshotMetadataTestJSON-1264006369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:02:13 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-1305f1c1-3c2e-4774-acd4-a88ae382581f tempest-SnapshotMetadataTestJSON-1264006369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:02:13 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-1305f1c1-3c2e-4774-acd4-a88ae382581f tempest-SnapshotMetadataTestJSON-1264006369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:02:13 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-1305f1c1-3c2e-4774-acd4-a88ae382581f tempest-SnapshotMetadataTestJSON-1264006369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:02:13 devstack sudo[98052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:02:13 devstack sudo[98052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:02:13 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8d619e0-38d8-473d-920c-92e6e4b3378a]: (4, 'raw') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:02:13 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-9b2ed6f5-9c3d-411e-b9c7-7f66a721d5b1 tempest-VolumesGetTest-1858470535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_764e44ff-49f7-469a-925c-23f254888b59_ck7ebrwr {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:02:13 devstack sudo[98054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_764e44ff-49f7-469a-925c-23f254888b59_ck7ebrwr Sep 17 22:02:13 devstack sudo[98054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:02:13 devstack sudo[98052]: pam_unix(sudo:session): session closed for user root Sep 17 22:02:13 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-1305f1c1-3c2e-4774-acd4-a88ae382581f tempest-SnapshotMetadataTestJSON-1264006369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.347s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:02:13 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-1305f1c1-3c2e-4774-acd4-a88ae382581f tempest-SnapshotMetadataTestJSON-1264006369 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:02:13 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-1305f1c1-3c2e-4774-acd4-a88ae382581f tempest-SnapshotMetadataTestJSON-1264006369 None] Deleted volume successfully. Sep 17 22:02:13 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-1305f1c1-3c2e-4774-acd4-a88ae382581f tempest-SnapshotMetadataTestJSON-1264006369 None] Lock "cinder-dc7c3f93-799a-4265-a573-e5b97a67ee23-delete_volume" released by "delete_volume" :: held 1.659s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:02:13 devstack sudo[98050]: pam_unix(sudo:session): session closed for user root Sep 17 22:02:13 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-44712bd6-5ed0-46a3-907b-b86eca670a44 tempest-VolumesExtendTest-227742800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-3f00dd72-e6c7-4332-a871-f74d30a01a81 1073741824" returned: 0 in 0.697s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:02:13 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-44712bd6-5ed0-46a3-907b-b86eca670a44 tempest-VolumesExtendTest-227742800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-3f00dd72-e6c7-4332-a871-f74d30a01a81 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:02:13 devstack sudo[98061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-3f00dd72-e6c7-4332-a871-f74d30a01a81 Sep 17 22:02:13 devstack sudo[98061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:02:13 devstack sudo[98054]: pam_unix(sudo:session): session closed for user root Sep 17 22:02:13 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-9b2ed6f5-9c3d-411e-b9c7-7f66a721d5b1 tempest-VolumesGetTest-1858470535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_764e44ff-49f7-469a-925c-23f254888b59_ck7ebrwr" returned: 0 in 0.688s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:02:13 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-9b2ed6f5-9c3d-411e-b9c7-7f66a721d5b1 tempest-VolumesGetTest-1858470535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_764e44ff-49f7-469a-925c-23f254888b59_ck7ebrwr {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:02:14 devstack sudo[98065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_764e44ff-49f7-469a-925c-23f254888b59_ck7ebrwr Sep 17 22:02:14 devstack sudo[98065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:02:14 devstack sudo[98061]: pam_unix(sudo:session): session closed for user root Sep 17 22:02:14 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-44712bd6-5ed0-46a3-907b-b86eca670a44 tempest-VolumesExtendTest-227742800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-3f00dd72-e6c7-4332-a871-f74d30a01a81" returned: 0 in 0.320s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:02:14 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-44712bd6-5ed0-46a3-907b-b86eca670a44 tempest-VolumesExtendTest-227742800 None] <== create_volume: return (1088ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 22:02:14 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-44712bd6-5ed0-46a3-907b-b86eca670a44 tempest-VolumesExtendTest-227742800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.091s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:02:14 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-44712bd6-5ed0-46a3-907b-b86eca670a44 tempest-VolumesExtendTest-227742800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e854413-1be9-4f27-815a-a46deb6c2e06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f00dd72-e6c7-4332-a871-f74d30a01a81', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:02:14 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-44712bd6-5ed0-46a3-907b-b86eca670a44 tempest-VolumesExtendTest-227742800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21aa4efe-8692-40aa-9c48-606bb5068749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:02:14 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-44712bd6-5ed0-46a3-907b-b86eca670a44 tempest-VolumesExtendTest-227742800 None] Volume volume-3f00dd72-e6c7-4332-a871-f74d30a01a81 (3f00dd72-e6c7-4332-a871-f74d30a01a81): created successfully Sep 17 22:02:14 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-44712bd6-5ed0-46a3-907b-b86eca670a44 tempest-VolumesExtendTest-227742800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21aa4efe-8692-40aa-9c48-606bb5068749) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:02:14 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-44712bd6-5ed0-46a3-907b-b86eca670a44 tempest-VolumesExtendTest-227742800 None] Flow 'volume_create_manager' (6749bf2f-4e47-4d41-9de0-908ec15fb63f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:02:14 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-44712bd6-5ed0-46a3-907b-b86eca670a44 tempest-VolumesExtendTest-227742800 None] Created volume successfully. Sep 17 22:02:14 devstack sudo[98065]: pam_unix(sudo:session): session closed for user root Sep 17 22:02:14 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-9b2ed6f5-9c3d-411e-b9c7-7f66a721d5b1 tempest-VolumesGetTest-1858470535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_764e44ff-49f7-469a-925c-23f254888b59_ck7ebrwr" returned: 1 in 0.416s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:02:14 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-9b2ed6f5-9c3d-411e-b9c7-7f66a721d5b1 tempest-VolumesGetTest-1858470535 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_764e44ff-49f7-469a-925c-23f254888b59_ck7ebrwr' failed. Not Retrying. {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 22:02:14 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[b886a8eb-2d59-48bf-a5ac-4a9419e6ffce]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:02:14 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-9b2ed6f5-9c3d-411e-b9c7-7f66a721d5b1 tempest-VolumesGetTest-1858470535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_764e44ff-49f7-469a-925c-23f254888b59_8n2f8efxdevstack@QuobyteHD {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:02:14 devstack sudo[98070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_764e44ff-49f7-469a-925c-23f254888b59_8n2f8efxdevstack@QuobyteHD Sep 17 22:02:14 devstack sudo[98070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:02:14 devstack sudo[98070]: pam_unix(sudo:session): session closed for user root Sep 17 22:02:14 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-9b2ed6f5-9c3d-411e-b9c7-7f66a721d5b1 tempest-VolumesGetTest-1858470535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_764e44ff-49f7-469a-925c-23f254888b59_8n2f8efxdevstack@QuobyteHD" returned: 0 in 0.355s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:02:14 devstack cinder-volume[85458]: DEBUG cinder.image.image_utils [None req-9b2ed6f5-9c3d-411e-b9c7-7f66a721d5b1 tempest-VolumesGetTest-1858470535 None] 764e44ff-49f7-469a-925c-23f254888b59 was qcow2, converting to qcow2 {{(pid=85458) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 17 22:02:14 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-9b2ed6f5-9c3d-411e-b9c7-7f66a721d5b1 tempest-VolumesGetTest-1858470535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_764e44ff-49f7-469a-925c-23f254888b59_8n2f8efxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-522710a7-a8f9-4f77-a31a-e2444f8a2935 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:02:14 devstack sudo[98076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_764e44ff-49f7-469a-925c-23f254888b59_8n2f8efxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-522710a7-a8f9-4f77-a31a-e2444f8a2935 Sep 17 22:02:14 devstack sudo[98076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:02:15 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-6574417d-fc7c-409a-ba09-b2f79b711d02 tempest-VolumesExtendTest-227742800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:02:15 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-6574417d-fc7c-409a-ba09-b2f79b711d02 tempest-VolumesExtendTest-227742800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:02:15 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-6574417d-fc7c-409a-ba09-b2f79b711d02 tempest-VolumesExtendTest-227742800 None] Creating offline snapshot 11062d73-af29-4ac6-bf91-aa84bb02837f of volume 3f00dd72-e6c7-4332-a871-f74d30a01a81 {{(pid=85458) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 22:02:15 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d1d2cb0-73a9-4e5b-93eb-8734c92edf8a]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:02:15 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-6574417d-fc7c-409a-ba09-b2f79b711d02 tempest-VolumesExtendTest-227742800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-3f00dd72-e6c7-4332-a871-f74d30a01a81 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:02:15 devstack sudo[98081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-3f00dd72-e6c7-4332-a871-f74d30a01a81 Sep 17 22:02:15 devstack sudo[98081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:02:15 devstack sudo[98081]: pam_unix(sudo:session): session closed for user root Sep 17 22:02:15 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-6574417d-fc7c-409a-ba09-b2f79b711d02 tempest-VolumesExtendTest-227742800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-3f00dd72-e6c7-4332-a871-f74d30a01a81" returned: 0 in 0.488s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:02:15 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-6574417d-fc7c-409a-ba09-b2f79b711d02 tempest-VolumesExtendTest-227742800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-3f00dd72-e6c7-4332-a871-f74d30a01a81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-3f00dd72-e6c7-4332-a871-f74d30a01a81.11062d73-af29-4ac6-bf91-aa84bb02837f 1G {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:02:15 devstack sudo[98088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-3f00dd72-e6c7-4332-a871-f74d30a01a81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-3f00dd72-e6c7-4332-a871-f74d30a01a81.11062d73-af29-4ac6-bf91-aa84bb02837f 1G Sep 17 22:02:15 devstack sudo[98088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:02:16 devstack sudo[98088]: pam_unix(sudo:session): session closed for user root Sep 17 22:02:16 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-6574417d-fc7c-409a-ba09-b2f79b711d02 tempest-VolumesExtendTest-227742800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-3f00dd72-e6c7-4332-a871-f74d30a01a81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-3f00dd72-e6c7-4332-a871-f74d30a01a81.11062d73-af29-4ac6-bf91-aa84bb02837f 1G" returned: 0 in 0.691s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:02:16 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-6574417d-fc7c-409a-ba09-b2f79b711d02 tempest-VolumesExtendTest-227742800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f00dd72-e6c7-4332-a871-f74d30a01a81 -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-3f00dd72-e6c7-4332-a871-f74d30a01a81.11062d73-af29-4ac6-bf91-aa84bb02837f {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:02:16 devstack sudo[98093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f00dd72-e6c7-4332-a871-f74d30a01a81 -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-3f00dd72-e6c7-4332-a871-f74d30a01a81.11062d73-af29-4ac6-bf91-aa84bb02837f Sep 17 22:02:16 devstack sudo[98093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:02:16 devstack sudo[98093]: pam_unix(sudo:session): session closed for user root Sep 17 22:02:16 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-6574417d-fc7c-409a-ba09-b2f79b711d02 tempest-VolumesExtendTest-227742800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f00dd72-e6c7-4332-a871-f74d30a01a81 -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-3f00dd72-e6c7-4332-a871-f74d30a01a81.11062d73-af29-4ac6-bf91-aa84bb02837f" returned: 0 in 0.412s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:02:16 devstack cinder-volume[85458]: WARNING cinder.volume.drivers.remotefs [None req-6574417d-fc7c-409a-ba09-b2f79b711d02 tempest-VolumesExtendTest-227742800 None] /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-3f00dd72-e6c7-4332-a871-f74d30a01a81.11062d73-af29-4ac6-bf91-aa84bb02837f is being set with open permissions: ugo+rw Sep 17 22:02:16 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-6574417d-fc7c-409a-ba09-b2f79b711d02 tempest-VolumesExtendTest-227742800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-3f00dd72-e6c7-4332-a871-f74d30a01a81.11062d73-af29-4ac6-bf91-aa84bb02837f {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:02:16 devstack sudo[98098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-3f00dd72-e6c7-4332-a871-f74d30a01a81.11062d73-af29-4ac6-bf91-aa84bb02837f Sep 17 22:02:16 devstack sudo[98098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:02:17 devstack sudo[98098]: pam_unix(sudo:session): session closed for user root Sep 17 22:02:17 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-6574417d-fc7c-409a-ba09-b2f79b711d02 tempest-VolumesExtendTest-227742800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-3f00dd72-e6c7-4332-a871-f74d30a01a81.11062d73-af29-4ac6-bf91-aa84bb02837f" returned: 0 in 0.338s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:02:17 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-6574417d-fc7c-409a-ba09-b2f79b711d02 tempest-VolumesExtendTest-227742800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-3f00dd72-e6c7-4332-a871-f74d30a01a81.info {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:02:17 devstack sudo[98101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-3f00dd72-e6c7-4332-a871-f74d30a01a81.info Sep 17 22:02:17 devstack sudo[98101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:02:17 devstack sudo[98076]: pam_unix(sudo:session): session closed for user root Sep 17 22:02:17 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-9b2ed6f5-9c3d-411e-b9c7-7f66a721d5b1 tempest-VolumesGetTest-1858470535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_764e44ff-49f7-469a-925c-23f254888b59_8n2f8efxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-522710a7-a8f9-4f77-a31a-e2444f8a2935" returned: 0 in 2.699s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:02:17 devstack cinder-volume[85458]: DEBUG cinder.image.image_utils [None req-9b2ed6f5-9c3d-411e-b9c7-7f66a721d5b1 tempest-VolumesGetTest-1858470535 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_764e44ff-49f7-469a-925c-23f254888b59_8n2f8efxdevstack@QuobyteHD, size 112.00 MB, duration 2.70 sec, destination /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-522710a7-a8f9-4f77-a31a-e2444f8a2935 {{(pid=85458) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 17 22:02:17 devstack cinder-volume[85458]: INFO cinder.image.image_utils [None req-9b2ed6f5-9c3d-411e-b9c7-7f66a721d5b1 tempest-VolumesGetTest-1858470535 None] Converted 112.00 MB image at 41.43 MB/s Sep 17 22:02:17 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-9b2ed6f5-9c3d-411e-b9c7-7f66a721d5b1 tempest-VolumesGetTest-1858470535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-522710a7-a8f9-4f77-a31a-e2444f8a2935 1G {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:02:17 devstack sudo[98103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-522710a7-a8f9-4f77-a31a-e2444f8a2935 1G Sep 17 22:02:17 devstack sudo[98103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:02:17 devstack sudo[98101]: pam_unix(sudo:session): session closed for user root Sep 17 22:02:17 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-6574417d-fc7c-409a-ba09-b2f79b711d02 tempest-VolumesExtendTest-227742800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-3f00dd72-e6c7-4332-a871-f74d30a01a81.info" returned: 0 in 0.304s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:02:17 devstack cinder-volume[85458]: WARNING cinder.volume.drivers.remotefs [None req-6574417d-fc7c-409a-ba09-b2f79b711d02 tempest-VolumesExtendTest-227742800 None] /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-3f00dd72-e6c7-4332-a871-f74d30a01a81.info is being set with open permissions: ugo+rw Sep 17 22:02:17 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-6574417d-fc7c-409a-ba09-b2f79b711d02 tempest-VolumesExtendTest-227742800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-3f00dd72-e6c7-4332-a871-f74d30a01a81.info {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:02:17 devstack sudo[98106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-3f00dd72-e6c7-4332-a871-f74d30a01a81.info Sep 17 22:02:17 devstack sudo[98106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:02:17 devstack sudo[98103]: pam_unix(sudo:session): session closed for user root Sep 17 22:02:17 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-9b2ed6f5-9c3d-411e-b9c7-7f66a721d5b1 tempest-VolumesGetTest-1858470535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-522710a7-a8f9-4f77-a31a-e2444f8a2935 1G" returned: 0 in 0.460s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:02:17 devstack cinder-volume[85458]: DEBUG cinder.volume.volume_utils [None req-9b2ed6f5-9c3d-411e-b9c7-7f66a721d5b1 tempest-VolumesGetTest-1858470535 None] Downloaded image 764e44ff-49f7-469a-925c-23f254888b59 ((None, [{'url': 'file:///opt/stack/data/glance/images/764e44ff-49f7-469a-925c-23f254888b59', 'metadata': {}}])) to volume 522710a7-a8f9-4f77-a31a-e2444f8a2935 successfully. {{(pid=85458) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 17 22:02:17 devstack cinder-volume[85458]: DEBUG cinder.image.image_utils [None req-9b2ed6f5-9c3d-411e-b9c7-7f66a721d5b1 tempest-VolumesGetTest-1858470535 None] Temporary image 764e44ff-49f7-469a-925c-23f254888b59 for user 5c1a5bbe85894370877379762b25947b is deleted. {{(pid=85458) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 17 22:02:17 devstack cinder-volume[85458]: DEBUG cinder.volume.volume_utils [None req-9b2ed6f5-9c3d-411e-b9c7-7f66a721d5b1 tempest-VolumesGetTest-1858470535 None] Marking volume 522710a7-a8f9-4f77-a31a-e2444f8a2935 as bootable. {{(pid=85458) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 17 22:02:17 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b2ed6f5-9c3d-411e-b9c7-7f66a721d5b1 tempest-VolumesGetTest-1858470535 None] Copying metadata from image 764e44ff-49f7-469a-925c-23f254888b59 to 522710a7-a8f9-4f77-a31a-e2444f8a2935. {{(pid=85458) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 17 22:02:17 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b2ed6f5-9c3d-411e-b9c7-7f66a721d5b1 tempest-VolumesGetTest-1858470535 None] Creating volume glance metadata for volume 522710a7-a8f9-4f77-a31a-e2444f8a2935 backed by image 764e44ff-49f7-469a-925c-23f254888b59 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '764e44ff-49f7-469a-925c-23f254888b59', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=85458) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 17 22:02:17 devstack sudo[98106]: pam_unix(sudo:session): session closed for user root Sep 17 22:02:17 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-6574417d-fc7c-409a-ba09-b2f79b711d02 tempest-VolumesExtendTest-227742800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-3f00dd72-e6c7-4332-a871-f74d30a01a81.info" returned: 0 in 0.388s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:02:17 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-6574417d-fc7c-409a-ba09-b2f79b711d02 tempest-VolumesExtendTest-227742800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.761s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:02:18 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-6574417d-fc7c-409a-ba09-b2f79b711d02 tempest-VolumesExtendTest-227742800 None] Create snapshot completed successfully Sep 17 22:02:18 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-9b2ed6f5-9c3d-411e-b9c7-7f66a721d5b1 tempest-VolumesGetTest-1858470535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bcf7813-61a4-4919-adac-ab52a2549a37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-522710a7-a8f9-4f77-a31a-e2444f8a2935', 'volume_size': 1, 'image_id': '764e44ff-49f7-469a-925c-23f254888b59', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/764e44ff-49f7-469a-925c-23f254888b59', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '530062d71c924da39eff46373302dc71', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '764e44ff-49f7-469a-925c-23f254888b59', 'created_at': datetime.datetime(2026, 9, 17, 19, 45, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 19, 45, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/764e44ff-49f7-469a-925c-23f254888b59/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:02:18 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-9b2ed6f5-9c3d-411e-b9c7-7f66a721d5b1 tempest-VolumesGetTest-1858470535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b945eb04-e783-4f95-af83-cd358348e347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:02:18 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-9b2ed6f5-9c3d-411e-b9c7-7f66a721d5b1 tempest-VolumesGetTest-1858470535 None] Volume volume-522710a7-a8f9-4f77-a31a-e2444f8a2935 (522710a7-a8f9-4f77-a31a-e2444f8a2935): created successfully Sep 17 22:02:18 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-9b2ed6f5-9c3d-411e-b9c7-7f66a721d5b1 tempest-VolumesGetTest-1858470535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b945eb04-e783-4f95-af83-cd358348e347) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:02:18 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-9b2ed6f5-9c3d-411e-b9c7-7f66a721d5b1 tempest-VolumesGetTest-1858470535 None] Flow 'volume_create_manager' (ea85fc90-caa2-4a1d-b4db-5a80e4cae505) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:02:18 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-9b2ed6f5-9c3d-411e-b9c7-7f66a721d5b1 tempest-VolumesGetTest-1858470535 None] Created volume successfully. Sep 17 22:02:18 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-513b8723-07be-4f84-8f6b-66fa7539856f tempest-VolumesExtendTest-227742800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:02:18 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-513b8723-07be-4f84-8f6b-66fa7539856f tempest-VolumesExtendTest-227742800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.003s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:02:18 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[acd88d17-6fbb-423b-a162-cdddf23ac575]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:02:18 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-513b8723-07be-4f84-8f6b-66fa7539856f tempest-VolumesExtendTest-227742800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-3f00dd72-e6c7-4332-a871-f74d30a01a81 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:02:18 devstack sudo[98113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-3f00dd72-e6c7-4332-a871-f74d30a01a81 Sep 17 22:02:18 devstack sudo[98113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:02:19 devstack sudo[98113]: pam_unix(sudo:session): session closed for user root Sep 17 22:02:19 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-513b8723-07be-4f84-8f6b-66fa7539856f tempest-VolumesExtendTest-227742800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-3f00dd72-e6c7-4332-a871-f74d30a01a81" returned: 0 in 0.535s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:02:19 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-513b8723-07be-4f84-8f6b-66fa7539856f tempest-VolumesExtendTest-227742800 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-3f00dd72-e6c7-4332-a871-f74d30a01a81.11062d73-af29-4ac6-bf91-aa84bb02837f 2G {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:02:19 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-513b8723-07be-4f84-8f6b-66fa7539856f tempest-VolumesExtendTest-227742800 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-3f00dd72-e6c7-4332-a871-f74d30a01a81.11062d73-af29-4ac6-bf91-aa84bb02837f 2G" returned: 0 in 0.228s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:02:19 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-513b8723-07be-4f84-8f6b-66fa7539856f tempest-VolumesExtendTest-227742800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.817s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:02:19 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-513b8723-07be-4f84-8f6b-66fa7539856f tempest-VolumesExtendTest-227742800 None] Extend volume completed successfully. Sep 17 22:02:19 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-35322066-ce70-47b1-8c35-d030793dd8c4 tempest-VolumesGetTest-1858470535 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 22:02:19 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-35322066-ce70-47b1-8c35-d030793dd8c4 tempest-VolumesGetTest-1858470535 None] Flow 'volume_create_manager' (266be114-35cf-475a-934b-4eac071a85f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:02:19 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-35322066-ce70-47b1-8c35-d030793dd8c4 tempest-VolumesGetTest-1858470535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9f466e2-74d4-436e-b4ab-426b9c3f131b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:02:19 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-e7d40846-434d-472d-8912-f24c057dd3af tempest-VolumesExtendTest-227742800 None] Acquiring lock "cinder-11062d73-af29-4ac6-bf91-aa84bb02837f-delete_snapshot" by "delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:02:19 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-35322066-ce70-47b1-8c35-d030793dd8c4 tempest-VolumesGetTest-1858470535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9f466e2-74d4-436e-b4ab-426b9c3f131b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:02:19Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-283540354',display_name='tempest-VolumesGetTest-Volume-1052303716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8248acf0-418f-4246-a522-4ec83ef51ac6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfeba540fd8a4d37b58b43b2b38ce1e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:02:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:02:20Z,use_quota=True,user_id='5c1a5bbe85894370877379762b25947b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:02:19 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-35322066-ce70-47b1-8c35-d030793dd8c4 tempest-VolumesGetTest-1858470535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a185a070-61b0-48b8-bfaf-57626639a053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:02:19 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-35322066-ce70-47b1-8c35-d030793dd8c4 tempest-VolumesGetTest-1858470535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a185a070-61b0-48b8-bfaf-57626639a053) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:02:19 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-35322066-ce70-47b1-8c35-d030793dd8c4 tempest-VolumesGetTest-1858470535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26c85994-c449-4633-bb52-978c54df65b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:02:19 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-35322066-ce70-47b1-8c35-d030793dd8c4 tempest-VolumesGetTest-1858470535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26c85994-c449-4633-bb52-978c54df65b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8248acf0-418f-4246-a522-4ec83ef51ac6', 'volume_name': 'volume-8248acf0-418f-4246-a522-4ec83ef51ac6', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:02:19 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-35322066-ce70-47b1-8c35-d030793dd8c4 tempest-VolumesGetTest-1858470535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b06c2521-f6c3-433d-9f5b-7f6e449eab4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:02:19 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-35322066-ce70-47b1-8c35-d030793dd8c4 tempest-VolumesGetTest-1858470535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b06c2521-f6c3-433d-9f5b-7f6e449eab4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:02:19 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-35322066-ce70-47b1-8c35-d030793dd8c4 tempest-VolumesGetTest-1858470535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee6c0097-4d14-4ebc-8e1e-c859cf783f39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:02:19 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-35322066-ce70-47b1-8c35-d030793dd8c4 tempest-VolumesGetTest-1858470535 None] Volume 8248acf0-418f-4246-a522-4ec83ef51ac6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8248acf0-418f-4246-a522-4ec83ef51ac6', 'volume_size': 1} Sep 17 22:02:19 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-35322066-ce70-47b1-8c35-d030793dd8c4 tempest-VolumesGetTest-1858470535 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:02:19 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-35322066-ce70-47b1-8c35-d030793dd8c4 tempest-VolumesGetTest-1858470535 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:02:19 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-35322066-ce70-47b1-8c35-d030793dd8c4 tempest-VolumesGetTest-1858470535 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:02:19Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-283540354',display_name='tempest-VolumesGetTest-Volume-1052303716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8248acf0-418f-4246-a522-4ec83ef51ac6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfeba540fd8a4d37b58b43b2b38ce1e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:02:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:02:20Z,use_quota=True,user_id='5c1a5bbe85894370877379762b25947b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 22:02:19 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-35322066-ce70-47b1-8c35-d030793dd8c4 tempest-VolumesGetTest-1858470535 None] Creating volume 8248acf0-418f-4246-a522-4ec83ef51ac6 {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 22:02:19 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-35322066-ce70-47b1-8c35-d030793dd8c4 tempest-VolumesGetTest-1858470535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:02:19 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-35322066-ce70-47b1-8c35-d030793dd8c4 tempest-VolumesGetTest-1858470535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:02:19 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-35322066-ce70-47b1-8c35-d030793dd8c4 tempest-VolumesGetTest-1858470535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:02:19 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-35322066-ce70-47b1-8c35-d030793dd8c4 tempest-VolumesGetTest-1858470535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:02:19 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-35322066-ce70-47b1-8c35-d030793dd8c4 tempest-VolumesGetTest-1858470535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:02:19 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-35322066-ce70-47b1-8c35-d030793dd8c4 tempest-VolumesGetTest-1858470535 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 22:02:19 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-35322066-ce70-47b1-8c35-d030793dd8c4 tempest-VolumesGetTest-1858470535 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 22:02:19 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-35322066-ce70-47b1-8c35-d030793dd8c4 tempest-VolumesGetTest-1858470535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8248acf0-418f-4246-a522-4ec83ef51ac6 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:02:19 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-e7d40846-434d-472d-8912-f24c057dd3af tempest-VolumesExtendTest-227742800 None] Lock "cinder-11062d73-af29-4ac6-bf91-aa84bb02837f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.104s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:02:19 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-e7d40846-434d-472d-8912-f24c057dd3af tempest-VolumesExtendTest-227742800 None] Acquiring lock "cinder-quobyte-3f00dd72-e6c7-4332-a871-f74d30a01a81" by "delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:02:19 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-e7d40846-434d-472d-8912-f24c057dd3af tempest-VolumesExtendTest-227742800 None] Lock "cinder-quobyte-3f00dd72-e6c7-4332-a871-f74d30a01a81" acquired by "delete_snapshot" :: waited 0.017s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:02:19 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-e7d40846-434d-472d-8912-f24c057dd3af tempest-VolumesExtendTest-227742800 None] Acquiring lock "cinder-quobyte-11062d73-af29-4ac6-bf91-aa84bb02837f" by "_delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:02:19 devstack sudo[98159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8248acf0-418f-4246-a522-4ec83ef51ac6 1073741824 Sep 17 22:02:19 devstack sudo[98159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:02:19 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-e7d40846-434d-472d-8912-f24c057dd3af tempest-VolumesExtendTest-227742800 None] Lock "cinder-quobyte-11062d73-af29-4ac6-bf91-aa84bb02837f" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:02:19 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-e7d40846-434d-472d-8912-f24c057dd3af tempest-VolumesExtendTest-227742800 None] Deleting offline snapshot 11062d73-af29-4ac6-bf91-aa84bb02837f of volume 3f00dd72-e6c7-4332-a871-f74d30a01a81 {{(pid=85458) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 22:02:19 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-e7d40846-434d-472d-8912-f24c057dd3af tempest-VolumesExtendTest-227742800 None] snapshot_file for this snap is: volume-3f00dd72-e6c7-4332-a871-f74d30a01a81.11062d73-af29-4ac6-bf91-aa84bb02837f {{(pid=85458) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 22:02:19 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f6c0de0-e9c2-48a9-b1c2-8bd9549958b1]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:02:19 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e7d40846-434d-472d-8912-f24c057dd3af tempest-VolumesExtendTest-227742800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-3f00dd72-e6c7-4332-a871-f74d30a01a81.11062d73-af29-4ac6-bf91-aa84bb02837f {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:02:20 devstack sudo[98161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-3f00dd72-e6c7-4332-a871-f74d30a01a81.11062d73-af29-4ac6-bf91-aa84bb02837f Sep 17 22:02:20 devstack sudo[98161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:02:20 devstack sudo[98159]: pam_unix(sudo:session): session closed for user root Sep 17 22:02:20 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-35322066-ce70-47b1-8c35-d030793dd8c4 tempest-VolumesGetTest-1858470535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8248acf0-418f-4246-a522-4ec83ef51ac6 1073741824" returned: 0 in 0.624s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:02:20 devstack sudo[98161]: pam_unix(sudo:session): session closed for user root Sep 17 22:02:20 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e7d40846-434d-472d-8912-f24c057dd3af tempest-VolumesExtendTest-227742800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-3f00dd72-e6c7-4332-a871-f74d30a01a81.11062d73-af29-4ac6-bf91-aa84bb02837f" returned: 0 in 0.556s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:02:20 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-e7d40846-434d-472d-8912-f24c057dd3af tempest-VolumesExtendTest-227742800 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3f00dd72-e6c7-4332-a871-f74d30a01a81(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85458) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 22:02:20 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-35322066-ce70-47b1-8c35-d030793dd8c4 tempest-VolumesGetTest-1858470535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8248acf0-418f-4246-a522-4ec83ef51ac6 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:02:20 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e0db526-83e4-4477-bfb8-ef3e31b1d560]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:02:20 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e7d40846-434d-472d-8912-f24c057dd3af tempest-VolumesExtendTest-227742800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-3f00dd72-e6c7-4332-a871-f74d30a01a81 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:02:20 devstack sudo[98170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8248acf0-418f-4246-a522-4ec83ef51ac6 Sep 17 22:02:20 devstack sudo[98170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:02:20 devstack sudo[98171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-3f00dd72-e6c7-4332-a871-f74d30a01a81 Sep 17 22:02:20 devstack sudo[98171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:02:20 devstack sudo[98170]: pam_unix(sudo:session): session closed for user root Sep 17 22:02:20 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-35322066-ce70-47b1-8c35-d030793dd8c4 tempest-VolumesGetTest-1858470535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8248acf0-418f-4246-a522-4ec83ef51ac6" returned: 0 in 0.354s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:02:20 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-35322066-ce70-47b1-8c35-d030793dd8c4 tempest-VolumesGetTest-1858470535 None] <== create_volume: return (1076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 22:02:20 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-35322066-ce70-47b1-8c35-d030793dd8c4 tempest-VolumesGetTest-1858470535 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.079s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:02:20 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-35322066-ce70-47b1-8c35-d030793dd8c4 tempest-VolumesGetTest-1858470535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee6c0097-4d14-4ebc-8e1e-c859cf783f39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8248acf0-418f-4246-a522-4ec83ef51ac6', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:02:20 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-35322066-ce70-47b1-8c35-d030793dd8c4 tempest-VolumesGetTest-1858470535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4cfa0f9-5976-4d84-80dc-eaf2b877a9ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:02:20 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-35322066-ce70-47b1-8c35-d030793dd8c4 tempest-VolumesGetTest-1858470535 None] Volume volume-8248acf0-418f-4246-a522-4ec83ef51ac6 (8248acf0-418f-4246-a522-4ec83ef51ac6): created successfully Sep 17 22:02:20 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-35322066-ce70-47b1-8c35-d030793dd8c4 tempest-VolumesGetTest-1858470535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4cfa0f9-5976-4d84-80dc-eaf2b877a9ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:02:20 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-35322066-ce70-47b1-8c35-d030793dd8c4 tempest-VolumesGetTest-1858470535 None] Flow 'volume_create_manager' (266be114-35cf-475a-934b-4eac071a85f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:02:20 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-35322066-ce70-47b1-8c35-d030793dd8c4 tempest-VolumesGetTest-1858470535 None] Created volume successfully. Sep 17 22:02:21 devstack sudo[98171]: pam_unix(sudo:session): session closed for user root Sep 17 22:02:21 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e7d40846-434d-472d-8912-f24c057dd3af tempest-VolumesExtendTest-227742800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-3f00dd72-e6c7-4332-a871-f74d30a01a81" returned: 0 in 0.542s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:02:21 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e7d40846-434d-472d-8912-f24c057dd3af tempest-VolumesExtendTest-227742800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-3f00dd72-e6c7-4332-a871-f74d30a01a81.11062d73-af29-4ac6-bf91-aa84bb02837f {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:02:21 devstack sudo[98178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-3f00dd72-e6c7-4332-a871-f74d30a01a81.11062d73-af29-4ac6-bf91-aa84bb02837f Sep 17 22:02:21 devstack sudo[98178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:02:21 devstack sudo[98178]: pam_unix(sudo:session): session closed for user root Sep 17 22:02:21 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e7d40846-434d-472d-8912-f24c057dd3af tempest-VolumesExtendTest-227742800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-3f00dd72-e6c7-4332-a871-f74d30a01a81.11062d73-af29-4ac6-bf91-aa84bb02837f" returned: 0 in 0.558s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:02:21 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e7d40846-434d-472d-8912-f24c057dd3af tempest-VolumesExtendTest-227742800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-3f00dd72-e6c7-4332-a871-f74d30a01a81.11062d73-af29-4ac6-bf91-aa84bb02837f {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:02:21 devstack sudo[98184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-3f00dd72-e6c7-4332-a871-f74d30a01a81.11062d73-af29-4ac6-bf91-aa84bb02837f Sep 17 22:02:21 devstack sudo[98184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:02:22 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-b3ded156-3340-4bfe-b6cf-987a1724b67f tempest-VolumesGetTest-1858470535 None] Acquiring lock "cinder-8248acf0-418f-4246-a522-4ec83ef51ac6-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:02:22 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-b3ded156-3340-4bfe-b6cf-987a1724b67f tempest-VolumesGetTest-1858470535 None] Lock "cinder-8248acf0-418f-4246-a522-4ec83ef51ac6-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:02:22 devstack cinder-volume[85458]: DEBUG dbcounter [-] [85458] Writing DB stats cinder:SELECT=154,cinder:UPDATE=189,cinder:DELETE=18,cinder:INSERT=51 {{(pid=85458) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 22:02:22 devstack cinder-volume[85458]: DEBUG dbcounter [-] [85458] Writing DB stats cinder:UPDATE=194,cinder:SELECT=145,cinder:INSERT=60,cinder:DELETE=16 {{(pid=85458) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 22:02:22 devstack sudo[98184]: pam_unix(sudo:session): session closed for user root Sep 17 22:02:22 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-b3ded156-3340-4bfe-b6cf-987a1724b67f tempest-VolumesGetTest-1858470535 None] Acquiring lock "cinder-quobyte-8248acf0-418f-4246-a522-4ec83ef51ac6" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:02:22 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e7d40846-434d-472d-8912-f24c057dd3af tempest-VolumesExtendTest-227742800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-3f00dd72-e6c7-4332-a871-f74d30a01a81.11062d73-af29-4ac6-bf91-aa84bb02837f" returned: 0 in 0.465s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:02:22 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-b3ded156-3340-4bfe-b6cf-987a1724b67f tempest-VolumesGetTest-1858470535 None] Lock "cinder-quobyte-8248acf0-418f-4246-a522-4ec83ef51ac6" acquired by "delete_volume" :: waited 0.067s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:02:22 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-e7d40846-434d-472d-8912-f24c057dd3af tempest-VolumesExtendTest-227742800 None] Lock "cinder-quobyte-11062d73-af29-4ac6-bf91-aa84bb02837f" released by "_delete_snapshot" :: held 2.356s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:02:22 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cfd6512-40a3-4797-b42f-75b56b46ddf1]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:02:22 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-b3ded156-3340-4bfe-b6cf-987a1724b67f tempest-VolumesGetTest-1858470535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8248acf0-418f-4246-a522-4ec83ef51ac6 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:02:22 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-e7d40846-434d-472d-8912-f24c057dd3af tempest-VolumesExtendTest-227742800 None] Lock "cinder-quobyte-3f00dd72-e6c7-4332-a871-f74d30a01a81" released by "delete_snapshot" :: held 2.414s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:02:22 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-e7d40846-434d-472d-8912-f24c057dd3af tempest-VolumesExtendTest-227742800 None] Created reservations ['d5264a64-87b9-4c15-8d4e-61c8d1ff1272', '439f1c1f-dc7c-411f-9008-61b2d17aea1c', '855a1b1e-f3bc-48d4-9371-cbb97c930302', '009c46ab-0766-45cb-b3ec-e5899be675ad'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:02:22 devstack sudo[98187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8248acf0-418f-4246-a522-4ec83ef51ac6 Sep 17 22:02:22 devstack sudo[98187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:02:22 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-e7d40846-434d-472d-8912-f24c057dd3af tempest-VolumesExtendTest-227742800 None] Delete snapshot completed successfully. Sep 17 22:02:22 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-e7d40846-434d-472d-8912-f24c057dd3af tempest-VolumesExtendTest-227742800 None] Lock "cinder-11062d73-af29-4ac6-bf91-aa84bb02837f-delete_snapshot" released by "delete_snapshot" :: held 2.627s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:02:22 devstack sudo[98187]: pam_unix(sudo:session): session closed for user root Sep 17 22:02:22 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-b3ded156-3340-4bfe-b6cf-987a1724b67f tempest-VolumesGetTest-1858470535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8248acf0-418f-4246-a522-4ec83ef51ac6" returned: 0 in 0.392s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:02:22 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-b3ded156-3340-4bfe-b6cf-987a1724b67f tempest-VolumesGetTest-1858470535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8248acf0-418f-4246-a522-4ec83ef51ac6 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:02:22 devstack sudo[98192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8248acf0-418f-4246-a522-4ec83ef51ac6 Sep 17 22:02:22 devstack sudo[98192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:02:22 devstack sudo[98192]: pam_unix(sudo:session): session closed for user root Sep 17 22:02:22 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-b3ded156-3340-4bfe-b6cf-987a1724b67f tempest-VolumesGetTest-1858470535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8248acf0-418f-4246-a522-4ec83ef51ac6" returned: 0 in 0.329s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:02:22 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ec60453-f353-44e4-9857-e5fe13d22e2e tempest-VolumesDeleteCascade-2087052776 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 22:02:22 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-7ec60453-f353-44e4-9857-e5fe13d22e2e tempest-VolumesDeleteCascade-2087052776 None] Flow 'volume_create_manager' (4b48c41e-0ef1-476e-b6dc-7e270b4bb9da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:02:22 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-7ec60453-f353-44e4-9857-e5fe13d22e2e tempest-VolumesDeleteCascade-2087052776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f1cc044-d97c-4b98-8736-8ecdd66895c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:02:23 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-b3ded156-3340-4bfe-b6cf-987a1724b67f tempest-VolumesGetTest-1858470535 None] Lock "cinder-quobyte-8248acf0-418f-4246-a522-4ec83ef51ac6" released by "delete_volume" :: held 0.820s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:02:23 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-7ec60453-f353-44e4-9857-e5fe13d22e2e tempest-VolumesDeleteCascade-2087052776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f1cc044-d97c-4b98-8736-8ecdd66895c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:02:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-516253021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c158772-227f-4375-97ed-fd990bf8afac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2b5ef67e0224619ab0cef1895ddc606',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:02:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:02:23Z,use_quota=True,user_id='ab4a33bb86674c8d804b6886b3e2b6dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:02:23 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-7ec60453-f353-44e4-9857-e5fe13d22e2e tempest-VolumesDeleteCascade-2087052776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a9e1398-e0d9-43fc-b246-3ee5cb3e9f8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:02:23 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-7ec60453-f353-44e4-9857-e5fe13d22e2e tempest-VolumesDeleteCascade-2087052776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a9e1398-e0d9-43fc-b246-3ee5cb3e9f8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:02:23 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-7ec60453-f353-44e4-9857-e5fe13d22e2e tempest-VolumesDeleteCascade-2087052776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e581433f-e432-49a2-8116-9a7cfdf89889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:02:23 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-7ec60453-f353-44e4-9857-e5fe13d22e2e tempest-VolumesDeleteCascade-2087052776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e581433f-e432-49a2-8116-9a7cfdf89889) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c158772-227f-4375-97ed-fd990bf8afac', 'volume_name': 'volume-7c158772-227f-4375-97ed-fd990bf8afac', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:02:23 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-7ec60453-f353-44e4-9857-e5fe13d22e2e tempest-VolumesDeleteCascade-2087052776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92bbd60b-de73-4d2f-9667-f73c42e81efd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:02:23 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-7ec60453-f353-44e4-9857-e5fe13d22e2e tempest-VolumesDeleteCascade-2087052776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92bbd60b-de73-4d2f-9667-f73c42e81efd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:02:23 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-7ec60453-f353-44e4-9857-e5fe13d22e2e tempest-VolumesDeleteCascade-2087052776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcb41342-9bd5-4671-aede-a89596a19476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:02:23 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-7ec60453-f353-44e4-9857-e5fe13d22e2e tempest-VolumesDeleteCascade-2087052776 None] Volume 7c158772-227f-4375-97ed-fd990bf8afac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c158772-227f-4375-97ed-fd990bf8afac', 'volume_size': 1} Sep 17 22:02:23 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-7ec60453-f353-44e4-9857-e5fe13d22e2e tempest-VolumesDeleteCascade-2087052776 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:02:23 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-7ec60453-f353-44e4-9857-e5fe13d22e2e tempest-VolumesDeleteCascade-2087052776 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:02:23 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-7ec60453-f353-44e4-9857-e5fe13d22e2e tempest-VolumesDeleteCascade-2087052776 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:02:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-516253021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c158772-227f-4375-97ed-fd990bf8afac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2b5ef67e0224619ab0cef1895ddc606',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:02:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:02:23Z,use_quota=True,user_id='ab4a33bb86674c8d804b6886b3e2b6dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 22:02:23 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-7ec60453-f353-44e4-9857-e5fe13d22e2e tempest-VolumesDeleteCascade-2087052776 None] Creating volume 7c158772-227f-4375-97ed-fd990bf8afac {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 22:02:23 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-7ec60453-f353-44e4-9857-e5fe13d22e2e tempest-VolumesDeleteCascade-2087052776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:02:23 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-7ec60453-f353-44e4-9857-e5fe13d22e2e tempest-VolumesDeleteCascade-2087052776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:02:23 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-7ec60453-f353-44e4-9857-e5fe13d22e2e tempest-VolumesDeleteCascade-2087052776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:02:23 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-7ec60453-f353-44e4-9857-e5fe13d22e2e tempest-VolumesDeleteCascade-2087052776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:02:23 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-7ec60453-f353-44e4-9857-e5fe13d22e2e tempest-VolumesDeleteCascade-2087052776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:02:23 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-7ec60453-f353-44e4-9857-e5fe13d22e2e tempest-VolumesDeleteCascade-2087052776 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 22:02:23 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-7ec60453-f353-44e4-9857-e5fe13d22e2e tempest-VolumesDeleteCascade-2087052776 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 22:02:23 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-7ec60453-f353-44e4-9857-e5fe13d22e2e tempest-VolumesDeleteCascade-2087052776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7c158772-227f-4375-97ed-fd990bf8afac 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:02:23 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-28373c2e-25af-4ce1-a64a-25c09be31414 tempest-VolumesExtendTest-227742800 None] Acquiring lock "cinder-3f00dd72-e6c7-4332-a871-f74d30a01a81-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:02:23 devstack sudo[98195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7c158772-227f-4375-97ed-fd990bf8afac 1073741824 Sep 17 22:02:23 devstack sudo[98195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:02:23 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-28373c2e-25af-4ce1-a64a-25c09be31414 tempest-VolumesExtendTest-227742800 None] Lock "cinder-3f00dd72-e6c7-4332-a871-f74d30a01a81-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:02:23 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-b3ded156-3340-4bfe-b6cf-987a1724b67f tempest-VolumesGetTest-1858470535 None] Created reservations ['62e4d13c-43dc-4c4a-9338-a74bdde44638', '40599708-c49b-4a97-87e7-736968b595a8', '3eb838a2-5598-4370-9904-11eb30e31ede', 'ebcbb5a7-6fdf-4af0-b9de-de53814171ed'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:02:23 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-28373c2e-25af-4ce1-a64a-25c09be31414 tempest-VolumesExtendTest-227742800 None] Acquiring lock "cinder-quobyte-3f00dd72-e6c7-4332-a871-f74d30a01a81" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:02:23 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-28373c2e-25af-4ce1-a64a-25c09be31414 tempest-VolumesExtendTest-227742800 None] Lock "cinder-quobyte-3f00dd72-e6c7-4332-a871-f74d30a01a81" acquired by "delete_volume" :: waited 0.031s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:02:23 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d5c06ae-b234-452c-a239-8a33f4d99369]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:02:23 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-28373c2e-25af-4ce1-a64a-25c09be31414 tempest-VolumesExtendTest-227742800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-3f00dd72-e6c7-4332-a871-f74d30a01a81 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:02:23 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-b3ded156-3340-4bfe-b6cf-987a1724b67f tempest-VolumesGetTest-1858470535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:02:23 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-b3ded156-3340-4bfe-b6cf-987a1724b67f tempest-VolumesGetTest-1858470535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:02:23 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-b3ded156-3340-4bfe-b6cf-987a1724b67f tempest-VolumesGetTest-1858470535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:02:23 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-b3ded156-3340-4bfe-b6cf-987a1724b67f tempest-VolumesGetTest-1858470535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:02:23 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-b3ded156-3340-4bfe-b6cf-987a1724b67f tempest-VolumesGetTest-1858470535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:02:23 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-b3ded156-3340-4bfe-b6cf-987a1724b67f tempest-VolumesGetTest-1858470535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:02:23 devstack sudo[98200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:02:23 devstack sudo[98200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:02:23 devstack sudo[98197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-3f00dd72-e6c7-4332-a871-f74d30a01a81 Sep 17 22:02:23 devstack sudo[98197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:02:23 devstack sudo[98195]: pam_unix(sudo:session): session closed for user root Sep 17 22:02:23 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-7ec60453-f353-44e4-9857-e5fe13d22e2e tempest-VolumesDeleteCascade-2087052776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7c158772-227f-4375-97ed-fd990bf8afac 1073741824" returned: 0 in 0.575s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:02:23 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-7ec60453-f353-44e4-9857-e5fe13d22e2e tempest-VolumesDeleteCascade-2087052776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7c158772-227f-4375-97ed-fd990bf8afac {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:02:23 devstack sudo[98200]: pam_unix(sudo:session): session closed for user root Sep 17 22:02:23 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-b3ded156-3340-4bfe-b6cf-987a1724b67f tempest-VolumesGetTest-1858470535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.334s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:02:23 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-b3ded156-3340-4bfe-b6cf-987a1724b67f tempest-VolumesGetTest-1858470535 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:02:23 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-b3ded156-3340-4bfe-b6cf-987a1724b67f tempest-VolumesGetTest-1858470535 None] Deleted volume successfully. Sep 17 22:02:23 devstack sudo[98206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7c158772-227f-4375-97ed-fd990bf8afac Sep 17 22:02:23 devstack sudo[98206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:02:23 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-b3ded156-3340-4bfe-b6cf-987a1724b67f tempest-VolumesGetTest-1858470535 None] Lock "cinder-8248acf0-418f-4246-a522-4ec83ef51ac6-delete_volume" released by "delete_volume" :: held 1.710s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:02:23 devstack sudo[98197]: pam_unix(sudo:session): session closed for user root Sep 17 22:02:23 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-28373c2e-25af-4ce1-a64a-25c09be31414 tempest-VolumesExtendTest-227742800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-3f00dd72-e6c7-4332-a871-f74d30a01a81" returned: 0 in 0.498s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:02:23 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-28373c2e-25af-4ce1-a64a-25c09be31414 tempest-VolumesExtendTest-227742800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-3f00dd72-e6c7-4332-a871-f74d30a01a81 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:02:23 devstack sudo[98211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-3f00dd72-e6c7-4332-a871-f74d30a01a81 Sep 17 22:02:23 devstack sudo[98211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:02:24 devstack sudo[98206]: pam_unix(sudo:session): session closed for user root Sep 17 22:02:24 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-7ec60453-f353-44e4-9857-e5fe13d22e2e tempest-VolumesDeleteCascade-2087052776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7c158772-227f-4375-97ed-fd990bf8afac" returned: 0 in 0.322s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:02:24 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-7ec60453-f353-44e4-9857-e5fe13d22e2e tempest-VolumesDeleteCascade-2087052776 None] <== create_volume: return (946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 22:02:24 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-7ec60453-f353-44e4-9857-e5fe13d22e2e tempest-VolumesDeleteCascade-2087052776 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.951s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:02:24 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-7ec60453-f353-44e4-9857-e5fe13d22e2e tempest-VolumesDeleteCascade-2087052776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcb41342-9bd5-4671-aede-a89596a19476) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c158772-227f-4375-97ed-fd990bf8afac', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:02:24 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-7ec60453-f353-44e4-9857-e5fe13d22e2e tempest-VolumesDeleteCascade-2087052776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bddd25b8-fb4a-4217-ab59-1740ddbb2285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:02:24 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-7ec60453-f353-44e4-9857-e5fe13d22e2e tempest-VolumesDeleteCascade-2087052776 None] Volume volume-7c158772-227f-4375-97ed-fd990bf8afac (7c158772-227f-4375-97ed-fd990bf8afac): created successfully Sep 17 22:02:24 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-7ec60453-f353-44e4-9857-e5fe13d22e2e tempest-VolumesDeleteCascade-2087052776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bddd25b8-fb4a-4217-ab59-1740ddbb2285) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:02:24 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-7ec60453-f353-44e4-9857-e5fe13d22e2e tempest-VolumesDeleteCascade-2087052776 None] Flow 'volume_create_manager' (4b48c41e-0ef1-476e-b6dc-7e270b4bb9da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:02:24 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-7ec60453-f353-44e4-9857-e5fe13d22e2e tempest-VolumesDeleteCascade-2087052776 None] Created volume successfully. Sep 17 22:02:24 devstack sudo[98211]: pam_unix(sudo:session): session closed for user root Sep 17 22:02:24 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-28373c2e-25af-4ce1-a64a-25c09be31414 tempest-VolumesExtendTest-227742800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-3f00dd72-e6c7-4332-a871-f74d30a01a81" returned: 0 in 0.304s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:02:24 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-28373c2e-25af-4ce1-a64a-25c09be31414 tempest-VolumesExtendTest-227742800 None] Lock "cinder-quobyte-3f00dd72-e6c7-4332-a871-f74d30a01a81" released by "delete_volume" :: held 0.879s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:02:24 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-28373c2e-25af-4ce1-a64a-25c09be31414 tempest-VolumesExtendTest-227742800 None] Created reservations ['eaca0840-2e51-4181-ac2a-5306fae7b1e1', '5c0760a0-e222-447f-a9b9-2f3c1bb8dde6', '8f8b2bda-7c61-4675-a5c4-386f0099a6d6', 'd7539e60-5776-48fc-9d0a-c8fc40a5546f'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:02:24 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-28373c2e-25af-4ce1-a64a-25c09be31414 tempest-VolumesExtendTest-227742800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:02:24 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-28373c2e-25af-4ce1-a64a-25c09be31414 tempest-VolumesExtendTest-227742800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:02:24 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-28373c2e-25af-4ce1-a64a-25c09be31414 tempest-VolumesExtendTest-227742800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:02:24 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-28373c2e-25af-4ce1-a64a-25c09be31414 tempest-VolumesExtendTest-227742800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:02:24 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-28373c2e-25af-4ce1-a64a-25c09be31414 tempest-VolumesExtendTest-227742800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:02:24 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-28373c2e-25af-4ce1-a64a-25c09be31414 tempest-VolumesExtendTest-227742800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:02:24 devstack sudo[98215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:02:24 devstack sudo[98215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:02:24 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-ce75bab8-8f68-4e99-95ed-21381fc00461 tempest-VolumesGetTest-1858470535 None] Acquiring lock "cinder-522710a7-a8f9-4f77-a31a-e2444f8a2935-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:02:24 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-ce75bab8-8f68-4e99-95ed-21381fc00461 tempest-VolumesGetTest-1858470535 None] Lock "cinder-522710a7-a8f9-4f77-a31a-e2444f8a2935-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:02:24 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-ce75bab8-8f68-4e99-95ed-21381fc00461 tempest-VolumesGetTest-1858470535 None] Acquiring lock "cinder-quobyte-522710a7-a8f9-4f77-a31a-e2444f8a2935" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:02:24 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-ce75bab8-8f68-4e99-95ed-21381fc00461 tempest-VolumesGetTest-1858470535 None] Lock "cinder-quobyte-522710a7-a8f9-4f77-a31a-e2444f8a2935" acquired by "delete_volume" :: waited 0.021s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:02:24 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7c06469-155f-44c6-b0a6-22f961aaf01f]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:02:24 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-ce75bab8-8f68-4e99-95ed-21381fc00461 tempest-VolumesGetTest-1858470535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-522710a7-a8f9-4f77-a31a-e2444f8a2935 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:02:24 devstack sudo[98215]: pam_unix(sudo:session): session closed for user root Sep 17 22:02:24 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-28373c2e-25af-4ce1-a64a-25c09be31414 tempest-VolumesExtendTest-227742800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.297s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:02:24 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-28373c2e-25af-4ce1-a64a-25c09be31414 tempest-VolumesExtendTest-227742800 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:02:24 devstack sudo[98217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-522710a7-a8f9-4f77-a31a-e2444f8a2935 Sep 17 22:02:24 devstack sudo[98217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:02:24 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-28373c2e-25af-4ce1-a64a-25c09be31414 tempest-VolumesExtendTest-227742800 None] Deleted volume successfully. Sep 17 22:02:24 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-28373c2e-25af-4ce1-a64a-25c09be31414 tempest-VolumesExtendTest-227742800 None] Lock "cinder-3f00dd72-e6c7-4332-a871-f74d30a01a81-delete_volume" released by "delete_volume" :: held 1.567s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:02:24 devstack sudo[98217]: pam_unix(sudo:session): session closed for user root Sep 17 22:02:24 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-ce75bab8-8f68-4e99-95ed-21381fc00461 tempest-VolumesGetTest-1858470535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-522710a7-a8f9-4f77-a31a-e2444f8a2935" returned: 0 in 0.366s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:02:24 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-ce75bab8-8f68-4e99-95ed-21381fc00461 tempest-VolumesGetTest-1858470535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-522710a7-a8f9-4f77-a31a-e2444f8a2935 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:02:24 devstack sudo[98223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-522710a7-a8f9-4f77-a31a-e2444f8a2935 Sep 17 22:02:24 devstack sudo[98223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:02:25 devstack sudo[98223]: pam_unix(sudo:session): session closed for user root Sep 17 22:02:25 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-ce75bab8-8f68-4e99-95ed-21381fc00461 tempest-VolumesGetTest-1858470535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-522710a7-a8f9-4f77-a31a-e2444f8a2935" returned: 0 in 0.309s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:02:25 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-ce75bab8-8f68-4e99-95ed-21381fc00461 tempest-VolumesGetTest-1858470535 None] Lock "cinder-quobyte-522710a7-a8f9-4f77-a31a-e2444f8a2935" released by "delete_volume" :: held 0.737s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:02:25 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-ce75bab8-8f68-4e99-95ed-21381fc00461 tempest-VolumesGetTest-1858470535 None] Created reservations ['f263ef2d-33e3-4415-a38e-544cb6c75939', 'b844bc82-997b-4708-9a01-3ed148d22ee4', 'fed76b1e-c66c-4586-9c40-dbe0ed6935fb', '24f855e1-91a5-4558-a008-f0c0f637e78a'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:02:25 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-06ed44cf-78d9-4634-8493-cabef34eb1ea tempest-VolumesDeleteCascade-2087052776 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:02:25 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-06ed44cf-78d9-4634-8493-cabef34eb1ea tempest-VolumesDeleteCascade-2087052776 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:02:25 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-06ed44cf-78d9-4634-8493-cabef34eb1ea tempest-VolumesDeleteCascade-2087052776 None] Creating offline snapshot c5ea53ed-4293-40a5-ab66-5e87468b0492 of volume 7c158772-227f-4375-97ed-fd990bf8afac {{(pid=85458) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 22:02:25 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[80d29556-0082-49e2-bb45-70072e9a1fe4]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:02:25 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-06ed44cf-78d9-4634-8493-cabef34eb1ea tempest-VolumesDeleteCascade-2087052776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7c158772-227f-4375-97ed-fd990bf8afac {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:02:25 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-ce75bab8-8f68-4e99-95ed-21381fc00461 tempest-VolumesGetTest-1858470535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:02:25 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-ce75bab8-8f68-4e99-95ed-21381fc00461 tempest-VolumesGetTest-1858470535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:02:25 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-ce75bab8-8f68-4e99-95ed-21381fc00461 tempest-VolumesGetTest-1858470535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:02:25 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-ce75bab8-8f68-4e99-95ed-21381fc00461 tempest-VolumesGetTest-1858470535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:02:25 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-ce75bab8-8f68-4e99-95ed-21381fc00461 tempest-VolumesGetTest-1858470535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:02:25 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-ce75bab8-8f68-4e99-95ed-21381fc00461 tempest-VolumesGetTest-1858470535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:02:25 devstack sudo[98227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:02:25 devstack sudo[98227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:02:25 devstack sudo[98226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7c158772-227f-4375-97ed-fd990bf8afac Sep 17 22:02:25 devstack sudo[98226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:02:25 devstack sudo[98227]: pam_unix(sudo:session): session closed for user root Sep 17 22:02:25 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-ce75bab8-8f68-4e99-95ed-21381fc00461 tempest-VolumesGetTest-1858470535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.365s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:02:25 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-ce75bab8-8f68-4e99-95ed-21381fc00461 tempest-VolumesGetTest-1858470535 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:02:25 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-ce75bab8-8f68-4e99-95ed-21381fc00461 tempest-VolumesGetTest-1858470535 None] Deleted volume successfully. Sep 17 22:02:25 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-ce75bab8-8f68-4e99-95ed-21381fc00461 tempest-VolumesGetTest-1858470535 None] Lock "cinder-522710a7-a8f9-4f77-a31a-e2444f8a2935-delete_volume" released by "delete_volume" :: held 1.435s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:02:26 devstack sudo[98226]: pam_unix(sudo:session): session closed for user root Sep 17 22:02:26 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-06ed44cf-78d9-4634-8493-cabef34eb1ea tempest-VolumesDeleteCascade-2087052776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7c158772-227f-4375-97ed-fd990bf8afac" returned: 0 in 0.638s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:02:26 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-06ed44cf-78d9-4634-8493-cabef34eb1ea tempest-VolumesDeleteCascade-2087052776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7c158772-227f-4375-97ed-fd990bf8afac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7c158772-227f-4375-97ed-fd990bf8afac.c5ea53ed-4293-40a5-ab66-5e87468b0492 1G {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:02:26 devstack sudo[98234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7c158772-227f-4375-97ed-fd990bf8afac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7c158772-227f-4375-97ed-fd990bf8afac.c5ea53ed-4293-40a5-ab66-5e87468b0492 1G Sep 17 22:02:26 devstack sudo[98234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:02:26 devstack sudo[98234]: pam_unix(sudo:session): session closed for user root Sep 17 22:02:26 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-06ed44cf-78d9-4634-8493-cabef34eb1ea tempest-VolumesDeleteCascade-2087052776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7c158772-227f-4375-97ed-fd990bf8afac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7c158772-227f-4375-97ed-fd990bf8afac.c5ea53ed-4293-40a5-ab66-5e87468b0492 1G" returned: 0 in 0.534s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:02:26 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-06ed44cf-78d9-4634-8493-cabef34eb1ea tempest-VolumesDeleteCascade-2087052776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c158772-227f-4375-97ed-fd990bf8afac -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7c158772-227f-4375-97ed-fd990bf8afac.c5ea53ed-4293-40a5-ab66-5e87468b0492 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:02:26 devstack sudo[98240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c158772-227f-4375-97ed-fd990bf8afac -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7c158772-227f-4375-97ed-fd990bf8afac.c5ea53ed-4293-40a5-ab66-5e87468b0492 Sep 17 22:02:26 devstack sudo[98240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:02:26 devstack sudo[98240]: pam_unix(sudo:session): session closed for user root Sep 17 22:02:26 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-06ed44cf-78d9-4634-8493-cabef34eb1ea tempest-VolumesDeleteCascade-2087052776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c158772-227f-4375-97ed-fd990bf8afac -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7c158772-227f-4375-97ed-fd990bf8afac.c5ea53ed-4293-40a5-ab66-5e87468b0492" returned: 0 in 0.363s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:02:26 devstack cinder-volume[85458]: WARNING cinder.volume.drivers.remotefs [None req-06ed44cf-78d9-4634-8493-cabef34eb1ea tempest-VolumesDeleteCascade-2087052776 None] /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7c158772-227f-4375-97ed-fd990bf8afac.c5ea53ed-4293-40a5-ab66-5e87468b0492 is being set with open permissions: ugo+rw Sep 17 22:02:26 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-06ed44cf-78d9-4634-8493-cabef34eb1ea tempest-VolumesDeleteCascade-2087052776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7c158772-227f-4375-97ed-fd990bf8afac.c5ea53ed-4293-40a5-ab66-5e87468b0492 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:02:26 devstack sudo[98245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7c158772-227f-4375-97ed-fd990bf8afac.c5ea53ed-4293-40a5-ab66-5e87468b0492 Sep 17 22:02:26 devstack sudo[98245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:02:27 devstack sudo[98245]: pam_unix(sudo:session): session closed for user root Sep 17 22:02:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-06ed44cf-78d9-4634-8493-cabef34eb1ea tempest-VolumesDeleteCascade-2087052776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7c158772-227f-4375-97ed-fd990bf8afac.c5ea53ed-4293-40a5-ab66-5e87468b0492" returned: 0 in 0.297s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:02:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-06ed44cf-78d9-4634-8493-cabef34eb1ea tempest-VolumesDeleteCascade-2087052776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7c158772-227f-4375-97ed-fd990bf8afac.info {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:02:27 devstack sudo[98248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7c158772-227f-4375-97ed-fd990bf8afac.info Sep 17 22:02:27 devstack sudo[98248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:02:27 devstack sudo[98248]: pam_unix(sudo:session): session closed for user root Sep 17 22:02:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-06ed44cf-78d9-4634-8493-cabef34eb1ea tempest-VolumesDeleteCascade-2087052776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7c158772-227f-4375-97ed-fd990bf8afac.info" returned: 0 in 0.315s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:02:27 devstack cinder-volume[85458]: WARNING cinder.volume.drivers.remotefs [None req-06ed44cf-78d9-4634-8493-cabef34eb1ea tempest-VolumesDeleteCascade-2087052776 None] /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7c158772-227f-4375-97ed-fd990bf8afac.info is being set with open permissions: ugo+rw Sep 17 22:02:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-06ed44cf-78d9-4634-8493-cabef34eb1ea tempest-VolumesDeleteCascade-2087052776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7c158772-227f-4375-97ed-fd990bf8afac.info {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:02:27 devstack sudo[98251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7c158772-227f-4375-97ed-fd990bf8afac.info Sep 17 22:02:27 devstack sudo[98251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:02:27 devstack cinder-volume[85458]: DEBUG oslo_service.periodic_task [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85458) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 22:02:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:02:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:02:27 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:02:27 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:02:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:02:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:02:27 devstack sudo[98253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:02:27 devstack sudo[98253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:02:27 devstack sudo[98251]: pam_unix(sudo:session): session closed for user root Sep 17 22:02:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-06ed44cf-78d9-4634-8493-cabef34eb1ea tempest-VolumesDeleteCascade-2087052776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7c158772-227f-4375-97ed-fd990bf8afac.info" returned: 0 in 0.278s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:02:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-06ed44cf-78d9-4634-8493-cabef34eb1ea tempest-VolumesDeleteCascade-2087052776 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.561s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:02:27 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-06ed44cf-78d9-4634-8493-cabef34eb1ea tempest-VolumesDeleteCascade-2087052776 None] Create snapshot completed successfully Sep 17 22:02:28 devstack sudo[98253]: pam_unix(sudo:session): session closed for user root Sep 17 22:02:28 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.298s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:02:28 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:02:28 devstack cinder-volume[85458]: DEBUG oslo_service.periodic_task [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Running periodic task VolumeManager._thread_info {{(pid=85458) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 22:02:28 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] thread count: 28 {{(pid=85458) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 22:02:28 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] thread info: [<_MainThread(MainThread, started 127546830999680)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85458) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 22:02:28 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-4918f1ee-c587-4a74-8c32-98a6b3b362bc tempest-VolumesDeleteCascade-2087052776 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:02:28 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-4918f1ee-c587-4a74-8c32-98a6b3b362bc tempest-VolumesDeleteCascade-2087052776 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:02:28 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-4918f1ee-c587-4a74-8c32-98a6b3b362bc tempest-VolumesDeleteCascade-2087052776 None] Creating offline snapshot 1be18c39-3989-4136-adba-f2abb36e2b73 of volume 7c158772-227f-4375-97ed-fd990bf8afac {{(pid=85458) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 22:02:28 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ef991e5-b24b-4a04-a2a2-39367a3af063]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:02:28 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-4918f1ee-c587-4a74-8c32-98a6b3b362bc tempest-VolumesDeleteCascade-2087052776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7c158772-227f-4375-97ed-fd990bf8afac.c5ea53ed-4293-40a5-ab66-5e87468b0492 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:02:29 devstack sudo[98258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7c158772-227f-4375-97ed-fd990bf8afac.c5ea53ed-4293-40a5-ab66-5e87468b0492 Sep 17 22:02:29 devstack sudo[98258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:02:29 devstack sudo[98258]: pam_unix(sudo:session): session closed for user root Sep 17 22:02:29 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-4918f1ee-c587-4a74-8c32-98a6b3b362bc tempest-VolumesDeleteCascade-2087052776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7c158772-227f-4375-97ed-fd990bf8afac.c5ea53ed-4293-40a5-ab66-5e87468b0492" returned: 0 in 0.553s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:02:29 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-4918f1ee-c587-4a74-8c32-98a6b3b362bc tempest-VolumesDeleteCascade-2087052776 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7c158772-227f-4375-97ed-fd990bf8afac(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85458) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 22:02:29 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-4918f1ee-c587-4a74-8c32-98a6b3b362bc tempest-VolumesDeleteCascade-2087052776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7c158772-227f-4375-97ed-fd990bf8afac.c5ea53ed-4293-40a5-ab66-5e87468b0492,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7c158772-227f-4375-97ed-fd990bf8afac.1be18c39-3989-4136-adba-f2abb36e2b73 1G {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:02:29 devstack sudo[98264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7c158772-227f-4375-97ed-fd990bf8afac.c5ea53ed-4293-40a5-ab66-5e87468b0492,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7c158772-227f-4375-97ed-fd990bf8afac.1be18c39-3989-4136-adba-f2abb36e2b73 1G Sep 17 22:02:29 devstack sudo[98264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:02:30 devstack sudo[98264]: pam_unix(sudo:session): session closed for user root Sep 17 22:02:30 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-4918f1ee-c587-4a74-8c32-98a6b3b362bc tempest-VolumesDeleteCascade-2087052776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7c158772-227f-4375-97ed-fd990bf8afac.c5ea53ed-4293-40a5-ab66-5e87468b0492,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7c158772-227f-4375-97ed-fd990bf8afac.1be18c39-3989-4136-adba-f2abb36e2b73 1G" returned: 0 in 0.719s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:02:30 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-4918f1ee-c587-4a74-8c32-98a6b3b362bc tempest-VolumesDeleteCascade-2087052776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c158772-227f-4375-97ed-fd990bf8afac.c5ea53ed-4293-40a5-ab66-5e87468b0492 -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7c158772-227f-4375-97ed-fd990bf8afac.1be18c39-3989-4136-adba-f2abb36e2b73 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:02:30 devstack sudo[98270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c158772-227f-4375-97ed-fd990bf8afac.c5ea53ed-4293-40a5-ab66-5e87468b0492 -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7c158772-227f-4375-97ed-fd990bf8afac.1be18c39-3989-4136-adba-f2abb36e2b73 Sep 17 22:02:30 devstack sudo[98270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:02:30 devstack sudo[98270]: pam_unix(sudo:session): session closed for user root Sep 17 22:02:30 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-4918f1ee-c587-4a74-8c32-98a6b3b362bc tempest-VolumesDeleteCascade-2087052776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c158772-227f-4375-97ed-fd990bf8afac.c5ea53ed-4293-40a5-ab66-5e87468b0492 -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7c158772-227f-4375-97ed-fd990bf8afac.1be18c39-3989-4136-adba-f2abb36e2b73" returned: 0 in 0.491s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:02:30 devstack cinder-volume[85458]: WARNING cinder.volume.drivers.remotefs [None req-4918f1ee-c587-4a74-8c32-98a6b3b362bc tempest-VolumesDeleteCascade-2087052776 None] /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7c158772-227f-4375-97ed-fd990bf8afac.1be18c39-3989-4136-adba-f2abb36e2b73 is being set with open permissions: ugo+rw Sep 17 22:02:30 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-4918f1ee-c587-4a74-8c32-98a6b3b362bc tempest-VolumesDeleteCascade-2087052776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7c158772-227f-4375-97ed-fd990bf8afac.1be18c39-3989-4136-adba-f2abb36e2b73 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:02:30 devstack sudo[98283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7c158772-227f-4375-97ed-fd990bf8afac.1be18c39-3989-4136-adba-f2abb36e2b73 Sep 17 22:02:30 devstack sudo[98283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:02:31 devstack sudo[98283]: pam_unix(sudo:session): session closed for user root Sep 17 22:02:31 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-4918f1ee-c587-4a74-8c32-98a6b3b362bc tempest-VolumesDeleteCascade-2087052776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7c158772-227f-4375-97ed-fd990bf8afac.1be18c39-3989-4136-adba-f2abb36e2b73" returned: 0 in 0.477s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:02:31 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-4918f1ee-c587-4a74-8c32-98a6b3b362bc tempest-VolumesDeleteCascade-2087052776 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.427s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:02:31 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-4918f1ee-c587-4a74-8c32-98a6b3b362bc tempest-VolumesDeleteCascade-2087052776 None] Create snapshot completed successfully Sep 17 22:02:32 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-b365a574-db9a-42c7-81a9-6644b58fc8a8 tempest-VolumesDeleteCascade-2087052776 None] Acquiring lock "cinder-7c158772-227f-4375-97ed-fd990bf8afac-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:02:32 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-b365a574-db9a-42c7-81a9-6644b58fc8a8 tempest-VolumesDeleteCascade-2087052776 None] Lock "cinder-7c158772-227f-4375-97ed-fd990bf8afac-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:02:32 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b365a574-db9a-42c7-81a9-6644b58fc8a8 tempest-VolumesDeleteCascade-2087052776 None] Performing cascade delete. {{(pid=85458) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 17 22:02:32 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-b365a574-db9a-42c7-81a9-6644b58fc8a8 tempest-VolumesDeleteCascade-2087052776 None] Acquiring lock "cinder-1be18c39-3989-4136-adba-f2abb36e2b73-delete_snapshot" by "delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:02:32 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-b365a574-db9a-42c7-81a9-6644b58fc8a8 tempest-VolumesDeleteCascade-2087052776 None] Lock "cinder-1be18c39-3989-4136-adba-f2abb36e2b73-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:02:32 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-b365a574-db9a-42c7-81a9-6644b58fc8a8 tempest-VolumesDeleteCascade-2087052776 None] Acquiring lock "cinder-quobyte-7c158772-227f-4375-97ed-fd990bf8afac" by "delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:02:32 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-b365a574-db9a-42c7-81a9-6644b58fc8a8 tempest-VolumesDeleteCascade-2087052776 None] Lock "cinder-quobyte-7c158772-227f-4375-97ed-fd990bf8afac" acquired by "delete_snapshot" :: waited 0.022s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:02:32 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-b365a574-db9a-42c7-81a9-6644b58fc8a8 tempest-VolumesDeleteCascade-2087052776 None] Acquiring lock "cinder-quobyte-1be18c39-3989-4136-adba-f2abb36e2b73" by "_delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:02:32 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-b365a574-db9a-42c7-81a9-6644b58fc8a8 tempest-VolumesDeleteCascade-2087052776 None] Lock "cinder-quobyte-1be18c39-3989-4136-adba-f2abb36e2b73" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:02:32 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-b365a574-db9a-42c7-81a9-6644b58fc8a8 tempest-VolumesDeleteCascade-2087052776 None] Deleting offline snapshot 1be18c39-3989-4136-adba-f2abb36e2b73 of volume 7c158772-227f-4375-97ed-fd990bf8afac {{(pid=85458) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 22:02:32 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-b365a574-db9a-42c7-81a9-6644b58fc8a8 tempest-VolumesDeleteCascade-2087052776 None] snapshot_file for this snap is: volume-7c158772-227f-4375-97ed-fd990bf8afac.1be18c39-3989-4136-adba-f2abb36e2b73 {{(pid=85458) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 22:02:32 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eb7cf32-5310-4643-9fd0-67247a8b48cb]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:02:32 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-b365a574-db9a-42c7-81a9-6644b58fc8a8 tempest-VolumesDeleteCascade-2087052776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7c158772-227f-4375-97ed-fd990bf8afac.1be18c39-3989-4136-adba-f2abb36e2b73 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:02:32 devstack sudo[98286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7c158772-227f-4375-97ed-fd990bf8afac.1be18c39-3989-4136-adba-f2abb36e2b73 Sep 17 22:02:32 devstack sudo[98286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:02:32 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-63b7a754-3c4c-487f-bda5-aff2cbbfc9f5 tempest-VolumesListTestJSON-44335780 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 22:02:32 devstack sudo[98286]: pam_unix(sudo:session): session closed for user root Sep 17 22:02:32 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-63b7a754-3c4c-487f-bda5-aff2cbbfc9f5 tempest-VolumesListTestJSON-44335780 None] Flow 'volume_create_manager' (0ba37e5d-c75a-4cdc-8b41-6679c84cffa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:02:32 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-63b7a754-3c4c-487f-bda5-aff2cbbfc9f5 tempest-VolumesListTestJSON-44335780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc4cbf83-63d0-4641-92f4-70105de3a75a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:02:32 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-b365a574-db9a-42c7-81a9-6644b58fc8a8 tempest-VolumesDeleteCascade-2087052776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7c158772-227f-4375-97ed-fd990bf8afac.1be18c39-3989-4136-adba-f2abb36e2b73" returned: 0 in 0.562s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:02:32 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-b365a574-db9a-42c7-81a9-6644b58fc8a8 tempest-VolumesDeleteCascade-2087052776 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7c158772-227f-4375-97ed-fd990bf8afac(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85458) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 22:02:32 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-63b7a754-3c4c-487f-bda5-aff2cbbfc9f5 tempest-VolumesListTestJSON-44335780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc4cbf83-63d0-4641-92f4-70105de3a75a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:02:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1732436745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91118cdc-0832-4257-a36f-649a0e85d18b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='27d23877bc654c3bb09e5607bcf1c6ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:02:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:02:33Z,use_quota=True,user_id='0b8b115c77ec4f15af7fdbbb07afec1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:02:32 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-63b7a754-3c4c-487f-bda5-aff2cbbfc9f5 tempest-VolumesListTestJSON-44335780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a44772f1-816c-442e-9d13-b85b704b88b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:02:32 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-63b7a754-3c4c-487f-bda5-aff2cbbfc9f5 tempest-VolumesListTestJSON-44335780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a44772f1-816c-442e-9d13-b85b704b88b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:02:32 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-63b7a754-3c4c-487f-bda5-aff2cbbfc9f5 tempest-VolumesListTestJSON-44335780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (163ab84b-e641-47fe-8492-bbfa171c89fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:02:32 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-63b7a754-3c4c-487f-bda5-aff2cbbfc9f5 tempest-VolumesListTestJSON-44335780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (163ab84b-e641-47fe-8492-bbfa171c89fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91118cdc-0832-4257-a36f-649a0e85d18b', 'volume_name': 'volume-91118cdc-0832-4257-a36f-649a0e85d18b', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:02:32 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-63b7a754-3c4c-487f-bda5-aff2cbbfc9f5 tempest-VolumesListTestJSON-44335780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e4202b1-1e57-4036-8c3e-8b15026ea20b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:02:32 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-63b7a754-3c4c-487f-bda5-aff2cbbfc9f5 tempest-VolumesListTestJSON-44335780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e4202b1-1e57-4036-8c3e-8b15026ea20b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:02:33 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-63b7a754-3c4c-487f-bda5-aff2cbbfc9f5 tempest-VolumesListTestJSON-44335780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26109209-a5f8-4b58-ac4a-72e0182c2c8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:02:33 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-63b7a754-3c4c-487f-bda5-aff2cbbfc9f5 tempest-VolumesListTestJSON-44335780 None] Volume 91118cdc-0832-4257-a36f-649a0e85d18b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91118cdc-0832-4257-a36f-649a0e85d18b', 'volume_size': 1} Sep 17 22:02:33 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-63b7a754-3c4c-487f-bda5-aff2cbbfc9f5 tempest-VolumesListTestJSON-44335780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:02:33 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-63b7a754-3c4c-487f-bda5-aff2cbbfc9f5 tempest-VolumesListTestJSON-44335780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:02:33 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-63b7a754-3c4c-487f-bda5-aff2cbbfc9f5 tempest-VolumesListTestJSON-44335780 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:02:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1732436745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91118cdc-0832-4257-a36f-649a0e85d18b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='27d23877bc654c3bb09e5607bcf1c6ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:02:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:02:33Z,use_quota=True,user_id='0b8b115c77ec4f15af7fdbbb07afec1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 22:02:33 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-63b7a754-3c4c-487f-bda5-aff2cbbfc9f5 tempest-VolumesListTestJSON-44335780 None] Creating volume 91118cdc-0832-4257-a36f-649a0e85d18b {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 22:02:33 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-63b7a754-3c4c-487f-bda5-aff2cbbfc9f5 tempest-VolumesListTestJSON-44335780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:02:33 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-63b7a754-3c4c-487f-bda5-aff2cbbfc9f5 tempest-VolumesListTestJSON-44335780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:02:33 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-63b7a754-3c4c-487f-bda5-aff2cbbfc9f5 tempest-VolumesListTestJSON-44335780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:02:33 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-63b7a754-3c4c-487f-bda5-aff2cbbfc9f5 tempest-VolumesListTestJSON-44335780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:02:33 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-63b7a754-3c4c-487f-bda5-aff2cbbfc9f5 tempest-VolumesListTestJSON-44335780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:02:33 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-63b7a754-3c4c-487f-bda5-aff2cbbfc9f5 tempest-VolumesListTestJSON-44335780 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 22:02:33 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-63b7a754-3c4c-487f-bda5-aff2cbbfc9f5 tempest-VolumesListTestJSON-44335780 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 22:02:33 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-63b7a754-3c4c-487f-bda5-aff2cbbfc9f5 tempest-VolumesListTestJSON-44335780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-91118cdc-0832-4257-a36f-649a0e85d18b 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:02:33 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[93c0a562-37f0-4946-9246-1927496ae4e1]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:02:33 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-b365a574-db9a-42c7-81a9-6644b58fc8a8 tempest-VolumesDeleteCascade-2087052776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7c158772-227f-4375-97ed-fd990bf8afac.c5ea53ed-4293-40a5-ab66-5e87468b0492 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:02:33 devstack sudo[98291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-91118cdc-0832-4257-a36f-649a0e85d18b 1073741824 Sep 17 22:02:33 devstack sudo[98291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:02:33 devstack sudo[98292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7c158772-227f-4375-97ed-fd990bf8afac.c5ea53ed-4293-40a5-ab66-5e87468b0492 Sep 17 22:02:33 devstack sudo[98292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:02:33 devstack sudo[98292]: pam_unix(sudo:session): session closed for user root Sep 17 22:02:33 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-b365a574-db9a-42c7-81a9-6644b58fc8a8 tempest-VolumesDeleteCascade-2087052776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7c158772-227f-4375-97ed-fd990bf8afac.c5ea53ed-4293-40a5-ab66-5e87468b0492" returned: 0 in 0.513s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:02:33 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-b365a574-db9a-42c7-81a9-6644b58fc8a8 tempest-VolumesDeleteCascade-2087052776 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7c158772-227f-4375-97ed-fd990bf8afac(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85458) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 22:02:33 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-b365a574-db9a-42c7-81a9-6644b58fc8a8 tempest-VolumesDeleteCascade-2087052776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7c158772-227f-4375-97ed-fd990bf8afac.1be18c39-3989-4136-adba-f2abb36e2b73 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:02:33 devstack sudo[98302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7c158772-227f-4375-97ed-fd990bf8afac.1be18c39-3989-4136-adba-f2abb36e2b73 Sep 17 22:02:33 devstack sudo[98302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:02:33 devstack sudo[98291]: pam_unix(sudo:session): session closed for user root Sep 17 22:02:33 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-63b7a754-3c4c-487f-bda5-aff2cbbfc9f5 tempest-VolumesListTestJSON-44335780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-91118cdc-0832-4257-a36f-649a0e85d18b 1073741824" returned: 0 in 0.663s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:02:33 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-63b7a754-3c4c-487f-bda5-aff2cbbfc9f5 tempest-VolumesListTestJSON-44335780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-91118cdc-0832-4257-a36f-649a0e85d18b {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:02:33 devstack sudo[98304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-91118cdc-0832-4257-a36f-649a0e85d18b Sep 17 22:02:33 devstack sudo[98304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:02:34 devstack sudo[98304]: pam_unix(sudo:session): session closed for user root Sep 17 22:02:34 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-63b7a754-3c4c-487f-bda5-aff2cbbfc9f5 tempest-VolumesListTestJSON-44335780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-91118cdc-0832-4257-a36f-649a0e85d18b" returned: 0 in 0.279s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:02:34 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-63b7a754-3c4c-487f-bda5-aff2cbbfc9f5 tempest-VolumesListTestJSON-44335780 None] <== create_volume: return (1026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 22:02:34 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-63b7a754-3c4c-487f-bda5-aff2cbbfc9f5 tempest-VolumesListTestJSON-44335780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.031s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:02:34 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-63b7a754-3c4c-487f-bda5-aff2cbbfc9f5 tempest-VolumesListTestJSON-44335780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26109209-a5f8-4b58-ac4a-72e0182c2c8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91118cdc-0832-4257-a36f-649a0e85d18b', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:02:34 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-63b7a754-3c4c-487f-bda5-aff2cbbfc9f5 tempest-VolumesListTestJSON-44335780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9078363e-29c8-4338-8c44-a4f41374e12b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:02:34 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-63b7a754-3c4c-487f-bda5-aff2cbbfc9f5 tempest-VolumesListTestJSON-44335780 None] Volume volume-91118cdc-0832-4257-a36f-649a0e85d18b (91118cdc-0832-4257-a36f-649a0e85d18b): created successfully Sep 17 22:02:34 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-63b7a754-3c4c-487f-bda5-aff2cbbfc9f5 tempest-VolumesListTestJSON-44335780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9078363e-29c8-4338-8c44-a4f41374e12b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:02:34 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-63b7a754-3c4c-487f-bda5-aff2cbbfc9f5 tempest-VolumesListTestJSON-44335780 None] Flow 'volume_create_manager' (0ba37e5d-c75a-4cdc-8b41-6679c84cffa8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:02:34 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-63b7a754-3c4c-487f-bda5-aff2cbbfc9f5 tempest-VolumesListTestJSON-44335780 None] Created volume successfully. Sep 17 22:02:34 devstack sudo[98302]: pam_unix(sudo:session): session closed for user root Sep 17 22:02:34 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-b365a574-db9a-42c7-81a9-6644b58fc8a8 tempest-VolumesDeleteCascade-2087052776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7c158772-227f-4375-97ed-fd990bf8afac.1be18c39-3989-4136-adba-f2abb36e2b73" returned: 0 in 0.579s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:02:34 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-b365a574-db9a-42c7-81a9-6644b58fc8a8 tempest-VolumesDeleteCascade-2087052776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7c158772-227f-4375-97ed-fd990bf8afac.1be18c39-3989-4136-adba-f2abb36e2b73 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:02:34 devstack sudo[98310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7c158772-227f-4375-97ed-fd990bf8afac.1be18c39-3989-4136-adba-f2abb36e2b73 Sep 17 22:02:34 devstack sudo[98310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:02:34 devstack sudo[98310]: pam_unix(sudo:session): session closed for user root Sep 17 22:02:34 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-b365a574-db9a-42c7-81a9-6644b58fc8a8 tempest-VolumesDeleteCascade-2087052776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7c158772-227f-4375-97ed-fd990bf8afac.1be18c39-3989-4136-adba-f2abb36e2b73" returned: 0 in 0.253s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:02:34 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-b365a574-db9a-42c7-81a9-6644b58fc8a8 tempest-VolumesDeleteCascade-2087052776 None] Lock "cinder-quobyte-1be18c39-3989-4136-adba-f2abb36e2b73" released by "_delete_snapshot" :: held 2.151s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:02:34 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-b365a574-db9a-42c7-81a9-6644b58fc8a8 tempest-VolumesDeleteCascade-2087052776 None] Lock "cinder-quobyte-7c158772-227f-4375-97ed-fd990bf8afac" released by "delete_snapshot" :: held 2.177s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:02:34 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-b365a574-db9a-42c7-81a9-6644b58fc8a8 tempest-VolumesDeleteCascade-2087052776 None] Created reservations ['b9050baa-f961-4962-9a9c-9a2621ffebc8', 'f9c35c35-56d0-4354-98bf-26b48ff58df4', 'afc0b334-8603-488b-bb42-4a51c9ea6880', '3f7fc2f0-175c-4241-ae59-b837f4cf0f4c'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:02:34 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-b365a574-db9a-42c7-81a9-6644b58fc8a8 tempest-VolumesDeleteCascade-2087052776 None] Delete snapshot completed successfully. Sep 17 22:02:34 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-b365a574-db9a-42c7-81a9-6644b58fc8a8 tempest-VolumesDeleteCascade-2087052776 None] Lock "cinder-1be18c39-3989-4136-adba-f2abb36e2b73-delete_snapshot" released by "delete_snapshot" :: held 2.368s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:02:34 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-b365a574-db9a-42c7-81a9-6644b58fc8a8 tempest-VolumesDeleteCascade-2087052776 None] Acquiring lock "cinder-c5ea53ed-4293-40a5-ab66-5e87468b0492-delete_snapshot" by "delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:02:34 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-b365a574-db9a-42c7-81a9-6644b58fc8a8 tempest-VolumesDeleteCascade-2087052776 None] Lock "cinder-c5ea53ed-4293-40a5-ab66-5e87468b0492-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:02:34 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-b365a574-db9a-42c7-81a9-6644b58fc8a8 tempest-VolumesDeleteCascade-2087052776 None] Acquiring lock "cinder-quobyte-7c158772-227f-4375-97ed-fd990bf8afac" by "delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:02:34 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-b365a574-db9a-42c7-81a9-6644b58fc8a8 tempest-VolumesDeleteCascade-2087052776 None] Lock "cinder-quobyte-7c158772-227f-4375-97ed-fd990bf8afac" acquired by "delete_snapshot" :: waited 0.017s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:02:34 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-b365a574-db9a-42c7-81a9-6644b58fc8a8 tempest-VolumesDeleteCascade-2087052776 None] Acquiring lock "cinder-quobyte-c5ea53ed-4293-40a5-ab66-5e87468b0492" by "_delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:02:34 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-b365a574-db9a-42c7-81a9-6644b58fc8a8 tempest-VolumesDeleteCascade-2087052776 None] Lock "cinder-quobyte-c5ea53ed-4293-40a5-ab66-5e87468b0492" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:02:34 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-b365a574-db9a-42c7-81a9-6644b58fc8a8 tempest-VolumesDeleteCascade-2087052776 None] Deleting offline snapshot c5ea53ed-4293-40a5-ab66-5e87468b0492 of volume 7c158772-227f-4375-97ed-fd990bf8afac {{(pid=85458) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 22:02:34 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-b365a574-db9a-42c7-81a9-6644b58fc8a8 tempest-VolumesDeleteCascade-2087052776 None] snapshot_file for this snap is: volume-7c158772-227f-4375-97ed-fd990bf8afac.c5ea53ed-4293-40a5-ab66-5e87468b0492 {{(pid=85458) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 22:02:34 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bc9061a-fdfe-4372-9689-687e8a627bd7]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:02:34 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-b365a574-db9a-42c7-81a9-6644b58fc8a8 tempest-VolumesDeleteCascade-2087052776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7c158772-227f-4375-97ed-fd990bf8afac.c5ea53ed-4293-40a5-ab66-5e87468b0492 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:02:34 devstack sudo[98313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7c158772-227f-4375-97ed-fd990bf8afac.c5ea53ed-4293-40a5-ab66-5e87468b0492 Sep 17 22:02:34 devstack sudo[98313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:02:35 devstack sudo[98313]: pam_unix(sudo:session): session closed for user root Sep 17 22:02:35 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-b365a574-db9a-42c7-81a9-6644b58fc8a8 tempest-VolumesDeleteCascade-2087052776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7c158772-227f-4375-97ed-fd990bf8afac.c5ea53ed-4293-40a5-ab66-5e87468b0492" returned: 0 in 0.562s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:02:35 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-b365a574-db9a-42c7-81a9-6644b58fc8a8 tempest-VolumesDeleteCascade-2087052776 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7c158772-227f-4375-97ed-fd990bf8afac(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85458) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 22:02:35 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c4c2d92-3232-4150-a44d-b118f1530e7f]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:02:35 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-b365a574-db9a-42c7-81a9-6644b58fc8a8 tempest-VolumesDeleteCascade-2087052776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7c158772-227f-4375-97ed-fd990bf8afac {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:02:35 devstack sudo[98319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7c158772-227f-4375-97ed-fd990bf8afac Sep 17 22:02:35 devstack sudo[98319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:02:35 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-693fea1a-576b-48e9-89a1-de4bdd39f976 tempest-VolumesListTestJSON-44335780 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 22:02:35 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-693fea1a-576b-48e9-89a1-de4bdd39f976 tempest-VolumesListTestJSON-44335780 None] Flow 'volume_create_manager' (6ece6272-7c3f-44bb-a317-bbe031a845c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:02:35 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-693fea1a-576b-48e9-89a1-de4bdd39f976 tempest-VolumesListTestJSON-44335780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84116083-7e29-4b6a-b743-ec392ae015a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:02:35 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-693fea1a-576b-48e9-89a1-de4bdd39f976 tempest-VolumesListTestJSON-44335780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84116083-7e29-4b6a-b743-ec392ae015a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:02:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1996613660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50f12223-c1ad-4cd2-83b4-e7b49108da87,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='27d23877bc654c3bb09e5607bcf1c6ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:02:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:02:36Z,use_quota=True,user_id='0b8b115c77ec4f15af7fdbbb07afec1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:02:35 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-693fea1a-576b-48e9-89a1-de4bdd39f976 tempest-VolumesListTestJSON-44335780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2550d7a-2be7-4025-bf44-51c1a57f110b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:02:35 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-693fea1a-576b-48e9-89a1-de4bdd39f976 tempest-VolumesListTestJSON-44335780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2550d7a-2be7-4025-bf44-51c1a57f110b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:02:35 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-693fea1a-576b-48e9-89a1-de4bdd39f976 tempest-VolumesListTestJSON-44335780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdfce875-1424-4559-b77d-8cb2abab9f90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:02:35 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-693fea1a-576b-48e9-89a1-de4bdd39f976 tempest-VolumesListTestJSON-44335780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdfce875-1424-4559-b77d-8cb2abab9f90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50f12223-c1ad-4cd2-83b4-e7b49108da87', 'volume_name': 'volume-50f12223-c1ad-4cd2-83b4-e7b49108da87', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:02:35 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-693fea1a-576b-48e9-89a1-de4bdd39f976 tempest-VolumesListTestJSON-44335780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbae499a-14e9-4f8f-a6fc-dce8c39a9c66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:02:35 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-693fea1a-576b-48e9-89a1-de4bdd39f976 tempest-VolumesListTestJSON-44335780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbae499a-14e9-4f8f-a6fc-dce8c39a9c66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:02:36 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-693fea1a-576b-48e9-89a1-de4bdd39f976 tempest-VolumesListTestJSON-44335780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a81677a7-9dde-4215-8247-7ab645f19c53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:02:36 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-693fea1a-576b-48e9-89a1-de4bdd39f976 tempest-VolumesListTestJSON-44335780 None] Volume 50f12223-c1ad-4cd2-83b4-e7b49108da87: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50f12223-c1ad-4cd2-83b4-e7b49108da87', 'volume_size': 1} Sep 17 22:02:36 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-693fea1a-576b-48e9-89a1-de4bdd39f976 tempest-VolumesListTestJSON-44335780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:02:36 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-693fea1a-576b-48e9-89a1-de4bdd39f976 tempest-VolumesListTestJSON-44335780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:02:36 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-693fea1a-576b-48e9-89a1-de4bdd39f976 tempest-VolumesListTestJSON-44335780 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:02:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1996613660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50f12223-c1ad-4cd2-83b4-e7b49108da87,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='27d23877bc654c3bb09e5607bcf1c6ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:02:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:02:36Z,use_quota=True,user_id='0b8b115c77ec4f15af7fdbbb07afec1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 22:02:36 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-693fea1a-576b-48e9-89a1-de4bdd39f976 tempest-VolumesListTestJSON-44335780 None] Creating volume 50f12223-c1ad-4cd2-83b4-e7b49108da87 {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 22:02:36 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-693fea1a-576b-48e9-89a1-de4bdd39f976 tempest-VolumesListTestJSON-44335780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:02:36 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-693fea1a-576b-48e9-89a1-de4bdd39f976 tempest-VolumesListTestJSON-44335780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:02:36 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-693fea1a-576b-48e9-89a1-de4bdd39f976 tempest-VolumesListTestJSON-44335780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:02:36 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-693fea1a-576b-48e9-89a1-de4bdd39f976 tempest-VolumesListTestJSON-44335780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:02:36 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-693fea1a-576b-48e9-89a1-de4bdd39f976 tempest-VolumesListTestJSON-44335780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:02:36 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-693fea1a-576b-48e9-89a1-de4bdd39f976 tempest-VolumesListTestJSON-44335780 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 22:02:36 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-693fea1a-576b-48e9-89a1-de4bdd39f976 tempest-VolumesListTestJSON-44335780 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 22:02:36 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-693fea1a-576b-48e9-89a1-de4bdd39f976 tempest-VolumesListTestJSON-44335780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-50f12223-c1ad-4cd2-83b4-e7b49108da87 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:02:36 devstack sudo[98319]: pam_unix(sudo:session): session closed for user root Sep 17 22:02:36 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-b365a574-db9a-42c7-81a9-6644b58fc8a8 tempest-VolumesDeleteCascade-2087052776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7c158772-227f-4375-97ed-fd990bf8afac" returned: 0 in 0.716s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:02:36 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-b365a574-db9a-42c7-81a9-6644b58fc8a8 tempest-VolumesDeleteCascade-2087052776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7c158772-227f-4375-97ed-fd990bf8afac.c5ea53ed-4293-40a5-ab66-5e87468b0492 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:02:36 devstack sudo[98324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-50f12223-c1ad-4cd2-83b4-e7b49108da87 1073741824 Sep 17 22:02:36 devstack sudo[98324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:02:36 devstack sudo[98325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7c158772-227f-4375-97ed-fd990bf8afac.c5ea53ed-4293-40a5-ab66-5e87468b0492 Sep 17 22:02:36 devstack sudo[98325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:02:36 devstack sudo[98325]: pam_unix(sudo:session): session closed for user root Sep 17 22:02:36 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-b365a574-db9a-42c7-81a9-6644b58fc8a8 tempest-VolumesDeleteCascade-2087052776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7c158772-227f-4375-97ed-fd990bf8afac.c5ea53ed-4293-40a5-ab66-5e87468b0492" returned: 0 in 0.503s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:02:36 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-b365a574-db9a-42c7-81a9-6644b58fc8a8 tempest-VolumesDeleteCascade-2087052776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7c158772-227f-4375-97ed-fd990bf8afac.c5ea53ed-4293-40a5-ab66-5e87468b0492 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:02:36 devstack sudo[98334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7c158772-227f-4375-97ed-fd990bf8afac.c5ea53ed-4293-40a5-ab66-5e87468b0492 Sep 17 22:02:36 devstack sudo[98334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:02:36 devstack sudo[98324]: pam_unix(sudo:session): session closed for user root Sep 17 22:02:36 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-693fea1a-576b-48e9-89a1-de4bdd39f976 tempest-VolumesListTestJSON-44335780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-50f12223-c1ad-4cd2-83b4-e7b49108da87 1073741824" returned: 0 in 0.628s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:02:36 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-693fea1a-576b-48e9-89a1-de4bdd39f976 tempest-VolumesListTestJSON-44335780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-50f12223-c1ad-4cd2-83b4-e7b49108da87 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:02:36 devstack sudo[98336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-50f12223-c1ad-4cd2-83b4-e7b49108da87 Sep 17 22:02:36 devstack sudo[98336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:02:36 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8c0d247-07fc-4272-87f1-965feb48ef99 tempest-TestServerVolumeAttachmentScenario-586490087 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 22:02:36 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b8c0d247-07fc-4272-87f1-965feb48ef99 tempest-TestServerVolumeAttachmentScenario-586490087 None] Flow 'volume_create_manager' (f36268ce-424c-4e26-b850-97e4d083f31f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:02:36 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b8c0d247-07fc-4272-87f1-965feb48ef99 tempest-TestServerVolumeAttachmentScenario-586490087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34d4fbd0-65ce-4273-8256-9630255b672a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:02:36 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b8c0d247-07fc-4272-87f1-965feb48ef99 tempest-TestServerVolumeAttachmentScenario-586490087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34d4fbd0-65ce-4273-8256-9630255b672a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:02:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1132681448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8376aea-d193-41b2-aa63-2f3d2218a42d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97059a1e7f554f03a951243caf239ded',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:02:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:02:37Z,use_quota=True,user_id='e0f9dee3206d4353bd69d4dd96a2ab1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:02:36 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b8c0d247-07fc-4272-87f1-965feb48ef99 tempest-TestServerVolumeAttachmentScenario-586490087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07cdca18-6917-409a-9762-8c8ad231fc2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:02:36 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b8c0d247-07fc-4272-87f1-965feb48ef99 tempest-TestServerVolumeAttachmentScenario-586490087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07cdca18-6917-409a-9762-8c8ad231fc2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:02:36 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b8c0d247-07fc-4272-87f1-965feb48ef99 tempest-TestServerVolumeAttachmentScenario-586490087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e48f28f-0c8b-4820-ae24-c42cff85e169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:02:36 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b8c0d247-07fc-4272-87f1-965feb48ef99 tempest-TestServerVolumeAttachmentScenario-586490087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e48f28f-0c8b-4820-ae24-c42cff85e169) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8376aea-d193-41b2-aa63-2f3d2218a42d', 'volume_name': 'volume-d8376aea-d193-41b2-aa63-2f3d2218a42d', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:02:36 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b8c0d247-07fc-4272-87f1-965feb48ef99 tempest-TestServerVolumeAttachmentScenario-586490087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74626ed7-32d8-4e91-8a8e-15625db30a56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:02:36 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b8c0d247-07fc-4272-87f1-965feb48ef99 tempest-TestServerVolumeAttachmentScenario-586490087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74626ed7-32d8-4e91-8a8e-15625db30a56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:02:36 devstack sudo[98334]: pam_unix(sudo:session): session closed for user root Sep 17 22:02:36 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b8c0d247-07fc-4272-87f1-965feb48ef99 tempest-TestServerVolumeAttachmentScenario-586490087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (529dcde0-368f-4441-b273-e42a57077e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:02:36 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-b8c0d247-07fc-4272-87f1-965feb48ef99 tempest-TestServerVolumeAttachmentScenario-586490087 None] Volume d8376aea-d193-41b2-aa63-2f3d2218a42d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8376aea-d193-41b2-aa63-2f3d2218a42d', 'volume_size': 1} Sep 17 22:02:36 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-b8c0d247-07fc-4272-87f1-965feb48ef99 tempest-TestServerVolumeAttachmentScenario-586490087 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:02:36 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-b365a574-db9a-42c7-81a9-6644b58fc8a8 tempest-VolumesDeleteCascade-2087052776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7c158772-227f-4375-97ed-fd990bf8afac.c5ea53ed-4293-40a5-ab66-5e87468b0492" returned: 0 in 0.399s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:02:37 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-b365a574-db9a-42c7-81a9-6644b58fc8a8 tempest-VolumesDeleteCascade-2087052776 None] Lock "cinder-quobyte-c5ea53ed-4293-40a5-ab66-5e87468b0492" released by "_delete_snapshot" :: held 2.358s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:02:37 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-b365a574-db9a-42c7-81a9-6644b58fc8a8 tempest-VolumesDeleteCascade-2087052776 None] Lock "cinder-quobyte-7c158772-227f-4375-97ed-fd990bf8afac" released by "delete_snapshot" :: held 2.397s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:02:37 devstack sudo[98336]: pam_unix(sudo:session): session closed for user root Sep 17 22:02:37 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-693fea1a-576b-48e9-89a1-de4bdd39f976 tempest-VolumesListTestJSON-44335780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-50f12223-c1ad-4cd2-83b4-e7b49108da87" returned: 0 in 0.394s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:02:37 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-693fea1a-576b-48e9-89a1-de4bdd39f976 tempest-VolumesListTestJSON-44335780 None] <== create_volume: return (1103ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 22:02:37 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-693fea1a-576b-48e9-89a1-de4bdd39f976 tempest-VolumesListTestJSON-44335780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.105s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:02:37 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-b8c0d247-07fc-4272-87f1-965feb48ef99 tempest-TestServerVolumeAttachmentScenario-586490087 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.172s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:02:37 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-b8c0d247-07fc-4272-87f1-965feb48ef99 tempest-TestServerVolumeAttachmentScenario-586490087 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:02:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1132681448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8376aea-d193-41b2-aa63-2f3d2218a42d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97059a1e7f554f03a951243caf239ded',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:02:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:02:37Z,use_quota=True,user_id='e0f9dee3206d4353bd69d4dd96a2ab1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 22:02:37 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-b8c0d247-07fc-4272-87f1-965feb48ef99 tempest-TestServerVolumeAttachmentScenario-586490087 None] Creating volume d8376aea-d193-41b2-aa63-2f3d2218a42d {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 22:02:37 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-b8c0d247-07fc-4272-87f1-965feb48ef99 tempest-TestServerVolumeAttachmentScenario-586490087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:02:37 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-b8c0d247-07fc-4272-87f1-965feb48ef99 tempest-TestServerVolumeAttachmentScenario-586490087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:02:37 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-b8c0d247-07fc-4272-87f1-965feb48ef99 tempest-TestServerVolumeAttachmentScenario-586490087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:02:37 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-b8c0d247-07fc-4272-87f1-965feb48ef99 tempest-TestServerVolumeAttachmentScenario-586490087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:02:37 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-b8c0d247-07fc-4272-87f1-965feb48ef99 tempest-TestServerVolumeAttachmentScenario-586490087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:02:37 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-b8c0d247-07fc-4272-87f1-965feb48ef99 tempest-TestServerVolumeAttachmentScenario-586490087 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 22:02:37 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-b8c0d247-07fc-4272-87f1-965feb48ef99 tempest-TestServerVolumeAttachmentScenario-586490087 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 22:02:37 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-b8c0d247-07fc-4272-87f1-965feb48ef99 tempest-TestServerVolumeAttachmentScenario-586490087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-d8376aea-d193-41b2-aa63-2f3d2218a42d 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:02:37 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-b365a574-db9a-42c7-81a9-6644b58fc8a8 tempest-VolumesDeleteCascade-2087052776 None] Created reservations ['169e7670-7c6f-40cd-88c9-bfb05acc17ed', '28ed4259-4004-4dc1-bcc9-66ed1b00b0c5', '596a120d-f9fd-4de1-81fc-9e416c81b116', '686ba591-322e-4bec-a09b-1f0af46ff0ea'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:02:37 devstack sudo[98342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-d8376aea-d193-41b2-aa63-2f3d2218a42d 1073741824 Sep 17 22:02:37 devstack sudo[98342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:02:37 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-693fea1a-576b-48e9-89a1-de4bdd39f976 tempest-VolumesListTestJSON-44335780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a81677a7-9dde-4215-8247-7ab645f19c53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50f12223-c1ad-4cd2-83b4-e7b49108da87', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:02:37 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-693fea1a-576b-48e9-89a1-de4bdd39f976 tempest-VolumesListTestJSON-44335780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6aab242f-6e13-4858-b5da-5226addc034a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:02:37 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-693fea1a-576b-48e9-89a1-de4bdd39f976 tempest-VolumesListTestJSON-44335780 None] Volume volume-50f12223-c1ad-4cd2-83b4-e7b49108da87 (50f12223-c1ad-4cd2-83b4-e7b49108da87): created successfully Sep 17 22:02:37 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-693fea1a-576b-48e9-89a1-de4bdd39f976 tempest-VolumesListTestJSON-44335780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6aab242f-6e13-4858-b5da-5226addc034a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:02:37 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-693fea1a-576b-48e9-89a1-de4bdd39f976 tempest-VolumesListTestJSON-44335780 None] Flow 'volume_create_manager' (6ece6272-7c3f-44bb-a317-bbe031a845c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:02:37 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-693fea1a-576b-48e9-89a1-de4bdd39f976 tempest-VolumesListTestJSON-44335780 None] Created volume successfully. Sep 17 22:02:37 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-b365a574-db9a-42c7-81a9-6644b58fc8a8 tempest-VolumesDeleteCascade-2087052776 None] Delete snapshot completed successfully. Sep 17 22:02:37 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-b365a574-db9a-42c7-81a9-6644b58fc8a8 tempest-VolumesDeleteCascade-2087052776 None] Lock "cinder-c5ea53ed-4293-40a5-ab66-5e87468b0492-delete_snapshot" released by "delete_snapshot" :: held 2.699s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:02:37 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b365a574-db9a-42c7-81a9-6644b58fc8a8 tempest-VolumesDeleteCascade-2087052776 None] Snapshots deleted, issuing volume delete {{(pid=85458) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 17 22:02:37 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-b365a574-db9a-42c7-81a9-6644b58fc8a8 tempest-VolumesDeleteCascade-2087052776 None] Acquiring lock "cinder-quobyte-7c158772-227f-4375-97ed-fd990bf8afac" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:02:37 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-b365a574-db9a-42c7-81a9-6644b58fc8a8 tempest-VolumesDeleteCascade-2087052776 None] Lock "cinder-quobyte-7c158772-227f-4375-97ed-fd990bf8afac" acquired by "delete_volume" :: waited 0.019s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:02:37 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[43a2ea4c-cf72-4902-a8f3-fa86881e32c2]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:02:37 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-b365a574-db9a-42c7-81a9-6644b58fc8a8 tempest-VolumesDeleteCascade-2087052776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7c158772-227f-4375-97ed-fd990bf8afac {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:02:37 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-17fd56e7-d601-4d36-8bbe-575375bc1857 tempest-TestServerVolumeAttachmentScenario-586490087 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 22:02:37 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-17fd56e7-d601-4d36-8bbe-575375bc1857 tempest-TestServerVolumeAttachmentScenario-586490087 None] Flow 'volume_create_manager' (bc657ab4-745a-4530-bb0d-2f00f22d6bb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:02:37 devstack sudo[98344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7c158772-227f-4375-97ed-fd990bf8afac Sep 17 22:02:37 devstack sudo[98344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:02:37 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-17fd56e7-d601-4d36-8bbe-575375bc1857 tempest-TestServerVolumeAttachmentScenario-586490087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d9bde0c-9809-4914-ac3b-0d7aa733812a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:02:37 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-17fd56e7-d601-4d36-8bbe-575375bc1857 tempest-TestServerVolumeAttachmentScenario-586490087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d9bde0c-9809-4914-ac3b-0d7aa733812a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:02:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-522685273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eff03be2-a889-4085-9fed-4fb591d03907,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97059a1e7f554f03a951243caf239ded',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:02:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:02:37Z,use_quota=True,user_id='e0f9dee3206d4353bd69d4dd96a2ab1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:02:37 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-17fd56e7-d601-4d36-8bbe-575375bc1857 tempest-TestServerVolumeAttachmentScenario-586490087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d20b314-d3e1-4774-96f6-78d348e3a06c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:02:37 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-17fd56e7-d601-4d36-8bbe-575375bc1857 tempest-TestServerVolumeAttachmentScenario-586490087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d20b314-d3e1-4774-96f6-78d348e3a06c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:02:37 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-17fd56e7-d601-4d36-8bbe-575375bc1857 tempest-TestServerVolumeAttachmentScenario-586490087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1754cee-cff1-430e-941e-41e4f4c36794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:02:37 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-17fd56e7-d601-4d36-8bbe-575375bc1857 tempest-TestServerVolumeAttachmentScenario-586490087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1754cee-cff1-430e-941e-41e4f4c36794) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eff03be2-a889-4085-9fed-4fb591d03907', 'volume_name': 'volume-eff03be2-a889-4085-9fed-4fb591d03907', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:02:37 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-17fd56e7-d601-4d36-8bbe-575375bc1857 tempest-TestServerVolumeAttachmentScenario-586490087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ebfcfa3-8414-4166-a361-891b58ff296e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:02:37 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-17fd56e7-d601-4d36-8bbe-575375bc1857 tempest-TestServerVolumeAttachmentScenario-586490087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ebfcfa3-8414-4166-a361-891b58ff296e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:02:37 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-17fd56e7-d601-4d36-8bbe-575375bc1857 tempest-TestServerVolumeAttachmentScenario-586490087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15afe657-be46-4fb8-8e6b-4e11092e0824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:02:37 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-17fd56e7-d601-4d36-8bbe-575375bc1857 tempest-TestServerVolumeAttachmentScenario-586490087 None] Volume eff03be2-a889-4085-9fed-4fb591d03907: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eff03be2-a889-4085-9fed-4fb591d03907', 'volume_size': 1} Sep 17 22:02:37 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-17fd56e7-d601-4d36-8bbe-575375bc1857 tempest-TestServerVolumeAttachmentScenario-586490087 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:02:37 devstack sudo[98342]: pam_unix(sudo:session): session closed for user root Sep 17 22:02:37 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-b8c0d247-07fc-4272-87f1-965feb48ef99 tempest-TestServerVolumeAttachmentScenario-586490087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-d8376aea-d193-41b2-aa63-2f3d2218a42d 1073741824" returned: 0 in 0.737s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:02:37 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-b8c0d247-07fc-4272-87f1-965feb48ef99 tempest-TestServerVolumeAttachmentScenario-586490087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-d8376aea-d193-41b2-aa63-2f3d2218a42d {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:02:37 devstack sudo[98344]: pam_unix(sudo:session): session closed for user root Sep 17 22:02:37 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-b365a574-db9a-42c7-81a9-6644b58fc8a8 tempest-VolumesDeleteCascade-2087052776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7c158772-227f-4375-97ed-fd990bf8afac" returned: 0 in 0.580s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:02:37 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-b365a574-db9a-42c7-81a9-6644b58fc8a8 tempest-VolumesDeleteCascade-2087052776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7c158772-227f-4375-97ed-fd990bf8afac {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:02:37 devstack sudo[98354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-d8376aea-d193-41b2-aa63-2f3d2218a42d Sep 17 22:02:37 devstack sudo[98354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:02:37 devstack sudo[98355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7c158772-227f-4375-97ed-fd990bf8afac Sep 17 22:02:38 devstack sudo[98355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:02:38 devstack sudo[98355]: pam_unix(sudo:session): session closed for user root Sep 17 22:02:38 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-b365a574-db9a-42c7-81a9-6644b58fc8a8 tempest-VolumesDeleteCascade-2087052776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7c158772-227f-4375-97ed-fd990bf8afac" returned: 0 in 0.377s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:02:38 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-b365a574-db9a-42c7-81a9-6644b58fc8a8 tempest-VolumesDeleteCascade-2087052776 None] Lock "cinder-quobyte-7c158772-227f-4375-97ed-fd990bf8afac" released by "delete_volume" :: held 1.059s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:02:38 devstack sudo[98354]: pam_unix(sudo:session): session closed for user root Sep 17 22:02:38 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-b8c0d247-07fc-4272-87f1-965feb48ef99 tempest-TestServerVolumeAttachmentScenario-586490087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-d8376aea-d193-41b2-aa63-2f3d2218a42d" returned: 0 in 0.453s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:02:38 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-b8c0d247-07fc-4272-87f1-965feb48ef99 tempest-TestServerVolumeAttachmentScenario-586490087 None] <== create_volume: return (1268ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 22:02:38 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-b8c0d247-07fc-4272-87f1-965feb48ef99 tempest-TestServerVolumeAttachmentScenario-586490087 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.277s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:02:38 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-17fd56e7-d601-4d36-8bbe-575375bc1857 tempest-TestServerVolumeAttachmentScenario-586490087 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.759s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:02:38 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-17fd56e7-d601-4d36-8bbe-575375bc1857 tempest-TestServerVolumeAttachmentScenario-586490087 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:02:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-522685273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eff03be2-a889-4085-9fed-4fb591d03907,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97059a1e7f554f03a951243caf239ded',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:02:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:02:37Z,use_quota=True,user_id='e0f9dee3206d4353bd69d4dd96a2ab1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 22:02:38 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-17fd56e7-d601-4d36-8bbe-575375bc1857 tempest-TestServerVolumeAttachmentScenario-586490087 None] Creating volume eff03be2-a889-4085-9fed-4fb591d03907 {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 22:02:38 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-17fd56e7-d601-4d36-8bbe-575375bc1857 tempest-TestServerVolumeAttachmentScenario-586490087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:02:38 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-17fd56e7-d601-4d36-8bbe-575375bc1857 tempest-TestServerVolumeAttachmentScenario-586490087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:02:38 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-17fd56e7-d601-4d36-8bbe-575375bc1857 tempest-TestServerVolumeAttachmentScenario-586490087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:02:38 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-17fd56e7-d601-4d36-8bbe-575375bc1857 tempest-TestServerVolumeAttachmentScenario-586490087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:02:38 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-17fd56e7-d601-4d36-8bbe-575375bc1857 tempest-TestServerVolumeAttachmentScenario-586490087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:02:38 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-17fd56e7-d601-4d36-8bbe-575375bc1857 tempest-TestServerVolumeAttachmentScenario-586490087 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 22:02:38 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-17fd56e7-d601-4d36-8bbe-575375bc1857 tempest-TestServerVolumeAttachmentScenario-586490087 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 22:02:38 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-17fd56e7-d601-4d36-8bbe-575375bc1857 tempest-TestServerVolumeAttachmentScenario-586490087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-eff03be2-a889-4085-9fed-4fb591d03907 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:02:38 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b8c0d247-07fc-4272-87f1-965feb48ef99 tempest-TestServerVolumeAttachmentScenario-586490087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (529dcde0-368f-4441-b273-e42a57077e2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8376aea-d193-41b2-aa63-2f3d2218a42d', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:02:38 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b8c0d247-07fc-4272-87f1-965feb48ef99 tempest-TestServerVolumeAttachmentScenario-586490087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e9ffe75-2772-40c6-ab6b-125adc5999a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:02:38 devstack sudo[98360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-eff03be2-a889-4085-9fed-4fb591d03907 1073741824 Sep 17 22:02:38 devstack sudo[98360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:02:38 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-b8c0d247-07fc-4272-87f1-965feb48ef99 tempest-TestServerVolumeAttachmentScenario-586490087 None] Volume volume-d8376aea-d193-41b2-aa63-2f3d2218a42d (d8376aea-d193-41b2-aa63-2f3d2218a42d): created successfully Sep 17 22:02:38 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b8c0d247-07fc-4272-87f1-965feb48ef99 tempest-TestServerVolumeAttachmentScenario-586490087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e9ffe75-2772-40c6-ab6b-125adc5999a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:02:38 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b8c0d247-07fc-4272-87f1-965feb48ef99 tempest-TestServerVolumeAttachmentScenario-586490087 None] Flow 'volume_create_manager' (f36268ce-424c-4e26-b850-97e4d083f31f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:02:38 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-b8c0d247-07fc-4272-87f1-965feb48ef99 tempest-TestServerVolumeAttachmentScenario-586490087 None] Created volume successfully. Sep 17 22:02:38 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-b365a574-db9a-42c7-81a9-6644b58fc8a8 tempest-VolumesDeleteCascade-2087052776 None] Created reservations ['f2ba580b-6553-45bf-b222-437c7a8383ba', '8c3adb50-49b6-4160-ac7b-3b4ef9d84552', '2a453f82-04f1-46fd-9978-988d11914adf', 'd3f8ee4f-7fc0-42fd-ae63-e6d34ddf6949'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:02:38 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-b365a574-db9a-42c7-81a9-6644b58fc8a8 tempest-VolumesDeleteCascade-2087052776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:02:38 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-b365a574-db9a-42c7-81a9-6644b58fc8a8 tempest-VolumesDeleteCascade-2087052776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:02:38 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-b365a574-db9a-42c7-81a9-6644b58fc8a8 tempest-VolumesDeleteCascade-2087052776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:02:38 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-b365a574-db9a-42c7-81a9-6644b58fc8a8 tempest-VolumesDeleteCascade-2087052776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:02:38 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-b365a574-db9a-42c7-81a9-6644b58fc8a8 tempest-VolumesDeleteCascade-2087052776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:02:38 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-b365a574-db9a-42c7-81a9-6644b58fc8a8 tempest-VolumesDeleteCascade-2087052776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:02:38 devstack sudo[98362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:02:38 devstack sudo[98362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:02:39 devstack sudo[98362]: pam_unix(sudo:session): session closed for user root Sep 17 22:02:39 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-b365a574-db9a-42c7-81a9-6644b58fc8a8 tempest-VolumesDeleteCascade-2087052776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.350s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:02:39 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-b365a574-db9a-42c7-81a9-6644b58fc8a8 tempest-VolumesDeleteCascade-2087052776 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:02:39 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-b365a574-db9a-42c7-81a9-6644b58fc8a8 tempest-VolumesDeleteCascade-2087052776 None] Deleted volume successfully. Sep 17 22:02:39 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-b365a574-db9a-42c7-81a9-6644b58fc8a8 tempest-VolumesDeleteCascade-2087052776 None] Lock "cinder-7c158772-227f-4375-97ed-fd990bf8afac-delete_volume" released by "delete_volume" :: held 7.114s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:02:39 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-522d52f7-ae4c-4475-aa17-1ce009f45a5a tempest-VolumesListTestJSON-44335780 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 22:02:39 devstack sudo[98360]: pam_unix(sudo:session): session closed for user root Sep 17 22:02:39 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-522d52f7-ae4c-4475-aa17-1ce009f45a5a tempest-VolumesListTestJSON-44335780 None] Flow 'volume_create_manager' (66d2a90c-1a26-41ca-bf91-736f87993b04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:02:39 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-522d52f7-ae4c-4475-aa17-1ce009f45a5a tempest-VolumesListTestJSON-44335780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3aceb19e-25f9-4106-82b2-79e9a3f8c721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:02:39 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-17fd56e7-d601-4d36-8bbe-575375bc1857 tempest-TestServerVolumeAttachmentScenario-586490087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-eff03be2-a889-4085-9fed-4fb591d03907 1073741824" returned: 0 in 0.880s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:02:39 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-522d52f7-ae4c-4475-aa17-1ce009f45a5a tempest-VolumesListTestJSON-44335780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3aceb19e-25f9-4106-82b2-79e9a3f8c721) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:02:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-667155015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85791c45-dc10-469e-89d8-05b137799b53,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='27d23877bc654c3bb09e5607bcf1c6ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:02:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:02:39Z,use_quota=True,user_id='0b8b115c77ec4f15af7fdbbb07afec1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:02:39 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-522d52f7-ae4c-4475-aa17-1ce009f45a5a tempest-VolumesListTestJSON-44335780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d01b63f-2639-4e86-ab90-4a7857823b38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:02:39 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-522d52f7-ae4c-4475-aa17-1ce009f45a5a tempest-VolumesListTestJSON-44335780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d01b63f-2639-4e86-ab90-4a7857823b38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:02:39 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-522d52f7-ae4c-4475-aa17-1ce009f45a5a tempest-VolumesListTestJSON-44335780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c58b50a-f07c-4456-ba76-f4d2148fbb56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:02:39 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-522d52f7-ae4c-4475-aa17-1ce009f45a5a tempest-VolumesListTestJSON-44335780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c58b50a-f07c-4456-ba76-f4d2148fbb56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85791c45-dc10-469e-89d8-05b137799b53', 'volume_name': 'volume-85791c45-dc10-469e-89d8-05b137799b53', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:02:39 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-522d52f7-ae4c-4475-aa17-1ce009f45a5a tempest-VolumesListTestJSON-44335780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24ea314d-1052-4784-b39b-c36bb8647cc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:02:39 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-522d52f7-ae4c-4475-aa17-1ce009f45a5a tempest-VolumesListTestJSON-44335780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24ea314d-1052-4784-b39b-c36bb8647cc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:02:39 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-522d52f7-ae4c-4475-aa17-1ce009f45a5a tempest-VolumesListTestJSON-44335780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f618848-bab9-43a2-b867-e091d0a86fd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:02:39 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-522d52f7-ae4c-4475-aa17-1ce009f45a5a tempest-VolumesListTestJSON-44335780 None] Volume 85791c45-dc10-469e-89d8-05b137799b53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85791c45-dc10-469e-89d8-05b137799b53', 'volume_size': 1} Sep 17 22:02:39 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-522d52f7-ae4c-4475-aa17-1ce009f45a5a tempest-VolumesListTestJSON-44335780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:02:39 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-17fd56e7-d601-4d36-8bbe-575375bc1857 tempest-TestServerVolumeAttachmentScenario-586490087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-eff03be2-a889-4085-9fed-4fb591d03907 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:02:39 devstack sudo[98369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-eff03be2-a889-4085-9fed-4fb591d03907 Sep 17 22:02:39 devstack sudo[98369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:02:39 devstack sudo[98369]: pam_unix(sudo:session): session closed for user root Sep 17 22:02:39 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-17fd56e7-d601-4d36-8bbe-575375bc1857 tempest-TestServerVolumeAttachmentScenario-586490087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-eff03be2-a889-4085-9fed-4fb591d03907" returned: 0 in 0.310s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:02:39 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-17fd56e7-d601-4d36-8bbe-575375bc1857 tempest-TestServerVolumeAttachmentScenario-586490087 None] <== create_volume: return (1313ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 22:02:39 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-17fd56e7-d601-4d36-8bbe-575375bc1857 tempest-TestServerVolumeAttachmentScenario-586490087 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.317s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:02:39 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-522d52f7-ae4c-4475-aa17-1ce009f45a5a tempest-VolumesListTestJSON-44335780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.339s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:02:39 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-522d52f7-ae4c-4475-aa17-1ce009f45a5a tempest-VolumesListTestJSON-44335780 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:02:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-667155015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85791c45-dc10-469e-89d8-05b137799b53,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='27d23877bc654c3bb09e5607bcf1c6ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:02:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:02:39Z,use_quota=True,user_id='0b8b115c77ec4f15af7fdbbb07afec1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 22:02:39 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-522d52f7-ae4c-4475-aa17-1ce009f45a5a tempest-VolumesListTestJSON-44335780 None] Creating volume 85791c45-dc10-469e-89d8-05b137799b53 {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 22:02:39 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-522d52f7-ae4c-4475-aa17-1ce009f45a5a tempest-VolumesListTestJSON-44335780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:02:39 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-522d52f7-ae4c-4475-aa17-1ce009f45a5a tempest-VolumesListTestJSON-44335780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:02:39 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-522d52f7-ae4c-4475-aa17-1ce009f45a5a tempest-VolumesListTestJSON-44335780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:02:39 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-522d52f7-ae4c-4475-aa17-1ce009f45a5a tempest-VolumesListTestJSON-44335780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:02:39 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-522d52f7-ae4c-4475-aa17-1ce009f45a5a tempest-VolumesListTestJSON-44335780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:02:39 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-522d52f7-ae4c-4475-aa17-1ce009f45a5a tempest-VolumesListTestJSON-44335780 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 22:02:39 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-522d52f7-ae4c-4475-aa17-1ce009f45a5a tempest-VolumesListTestJSON-44335780 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 22:02:39 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-522d52f7-ae4c-4475-aa17-1ce009f45a5a tempest-VolumesListTestJSON-44335780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-85791c45-dc10-469e-89d8-05b137799b53 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:02:39 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-17fd56e7-d601-4d36-8bbe-575375bc1857 tempest-TestServerVolumeAttachmentScenario-586490087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15afe657-be46-4fb8-8e6b-4e11092e0824) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eff03be2-a889-4085-9fed-4fb591d03907', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:02:39 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-17fd56e7-d601-4d36-8bbe-575375bc1857 tempest-TestServerVolumeAttachmentScenario-586490087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c180b5c9-3acb-4876-9fb8-0f371d0f7cb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:02:39 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-17fd56e7-d601-4d36-8bbe-575375bc1857 tempest-TestServerVolumeAttachmentScenario-586490087 None] Volume volume-eff03be2-a889-4085-9fed-4fb591d03907 (eff03be2-a889-4085-9fed-4fb591d03907): created successfully Sep 17 22:02:39 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-17fd56e7-d601-4d36-8bbe-575375bc1857 tempest-TestServerVolumeAttachmentScenario-586490087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c180b5c9-3acb-4876-9fb8-0f371d0f7cb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:02:39 devstack sudo[98372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-85791c45-dc10-469e-89d8-05b137799b53 1073741824 Sep 17 22:02:39 devstack sudo[98372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:02:39 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-17fd56e7-d601-4d36-8bbe-575375bc1857 tempest-TestServerVolumeAttachmentScenario-586490087 None] Flow 'volume_create_manager' (bc657ab4-745a-4530-bb0d-2f00f22d6bb6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:02:39 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-17fd56e7-d601-4d36-8bbe-575375bc1857 tempest-TestServerVolumeAttachmentScenario-586490087 None] Created volume successfully. Sep 17 22:02:40 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-c639c18f-0336-4bf4-bc12-178a206167f1 tempest-VolumesDeleteCascade-2087052776 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 22:02:40 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-c639c18f-0336-4bf4-bc12-178a206167f1 tempest-VolumesDeleteCascade-2087052776 None] Flow 'volume_create_manager' (0f488bbc-ccce-4f78-b5dc-abfe606f520d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:02:40 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-c639c18f-0336-4bf4-bc12-178a206167f1 tempest-VolumesDeleteCascade-2087052776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30269ce6-c478-4eb3-af16-ce2ada78b491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:02:40 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-c639c18f-0336-4bf4-bc12-178a206167f1 tempest-VolumesDeleteCascade-2087052776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30269ce6-c478-4eb3-af16-ce2ada78b491) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:02:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-340353344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff781d46-cd9f-4ea9-94cd-719be3ba3e01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2b5ef67e0224619ab0cef1895ddc606',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:02:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:02:40Z,use_quota=True,user_id='ab4a33bb86674c8d804b6886b3e2b6dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:02:40 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-c639c18f-0336-4bf4-bc12-178a206167f1 tempest-VolumesDeleteCascade-2087052776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e1c1bdb-9ff1-4314-a4d4-c3553cc45a9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:02:40 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-c639c18f-0336-4bf4-bc12-178a206167f1 tempest-VolumesDeleteCascade-2087052776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e1c1bdb-9ff1-4314-a4d4-c3553cc45a9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:02:40 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-c639c18f-0336-4bf4-bc12-178a206167f1 tempest-VolumesDeleteCascade-2087052776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f4de8c5-2848-40ed-82dd-8003ae7819a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:02:40 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-c639c18f-0336-4bf4-bc12-178a206167f1 tempest-VolumesDeleteCascade-2087052776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f4de8c5-2848-40ed-82dd-8003ae7819a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff781d46-cd9f-4ea9-94cd-719be3ba3e01', 'volume_name': 'volume-ff781d46-cd9f-4ea9-94cd-719be3ba3e01', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:02:40 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-c639c18f-0336-4bf4-bc12-178a206167f1 tempest-VolumesDeleteCascade-2087052776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e036501e-2840-4982-b167-fcfad35d9fc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:02:40 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-c639c18f-0336-4bf4-bc12-178a206167f1 tempest-VolumesDeleteCascade-2087052776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e036501e-2840-4982-b167-fcfad35d9fc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:02:40 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-c639c18f-0336-4bf4-bc12-178a206167f1 tempest-VolumesDeleteCascade-2087052776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7728b8d-6e0a-48b0-9afe-b0eafa669729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:02:40 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-c639c18f-0336-4bf4-bc12-178a206167f1 tempest-VolumesDeleteCascade-2087052776 None] Volume ff781d46-cd9f-4ea9-94cd-719be3ba3e01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff781d46-cd9f-4ea9-94cd-719be3ba3e01', 'volume_size': 1} Sep 17 22:02:40 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-c639c18f-0336-4bf4-bc12-178a206167f1 tempest-VolumesDeleteCascade-2087052776 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:02:40 devstack sudo[98372]: pam_unix(sudo:session): session closed for user root Sep 17 22:02:40 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-522d52f7-ae4c-4475-aa17-1ce009f45a5a tempest-VolumesListTestJSON-44335780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-85791c45-dc10-469e-89d8-05b137799b53 1073741824" returned: 0 in 0.732s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:02:40 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-522d52f7-ae4c-4475-aa17-1ce009f45a5a tempest-VolumesListTestJSON-44335780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-85791c45-dc10-469e-89d8-05b137799b53 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:02:40 devstack sudo[98378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-85791c45-dc10-469e-89d8-05b137799b53 Sep 17 22:02:40 devstack sudo[98378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:02:40 devstack sudo[98378]: pam_unix(sudo:session): session closed for user root Sep 17 22:02:40 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-522d52f7-ae4c-4475-aa17-1ce009f45a5a tempest-VolumesListTestJSON-44335780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-85791c45-dc10-469e-89d8-05b137799b53" returned: 0 in 0.292s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:02:40 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-522d52f7-ae4c-4475-aa17-1ce009f45a5a tempest-VolumesListTestJSON-44335780 None] <== create_volume: return (1069ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 22:02:40 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-522d52f7-ae4c-4475-aa17-1ce009f45a5a tempest-VolumesListTestJSON-44335780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.072s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:02:40 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-c639c18f-0336-4bf4-bc12-178a206167f1 tempest-VolumesDeleteCascade-2087052776 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.478s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:02:40 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-c639c18f-0336-4bf4-bc12-178a206167f1 tempest-VolumesDeleteCascade-2087052776 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:02:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-340353344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff781d46-cd9f-4ea9-94cd-719be3ba3e01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2b5ef67e0224619ab0cef1895ddc606',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:02:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:02:40Z,use_quota=True,user_id='ab4a33bb86674c8d804b6886b3e2b6dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 22:02:40 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-c639c18f-0336-4bf4-bc12-178a206167f1 tempest-VolumesDeleteCascade-2087052776 None] Creating volume ff781d46-cd9f-4ea9-94cd-719be3ba3e01 {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 22:02:40 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-c639c18f-0336-4bf4-bc12-178a206167f1 tempest-VolumesDeleteCascade-2087052776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:02:40 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-c639c18f-0336-4bf4-bc12-178a206167f1 tempest-VolumesDeleteCascade-2087052776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:02:40 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-c639c18f-0336-4bf4-bc12-178a206167f1 tempest-VolumesDeleteCascade-2087052776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:02:40 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-c639c18f-0336-4bf4-bc12-178a206167f1 tempest-VolumesDeleteCascade-2087052776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:02:40 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-c639c18f-0336-4bf4-bc12-178a206167f1 tempest-VolumesDeleteCascade-2087052776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:02:40 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-c639c18f-0336-4bf4-bc12-178a206167f1 tempest-VolumesDeleteCascade-2087052776 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 22:02:40 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-c639c18f-0336-4bf4-bc12-178a206167f1 tempest-VolumesDeleteCascade-2087052776 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 22:02:40 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-c639c18f-0336-4bf4-bc12-178a206167f1 tempest-VolumesDeleteCascade-2087052776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ff781d46-cd9f-4ea9-94cd-719be3ba3e01 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:02:40 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-522d52f7-ae4c-4475-aa17-1ce009f45a5a tempest-VolumesListTestJSON-44335780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f618848-bab9-43a2-b867-e091d0a86fd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85791c45-dc10-469e-89d8-05b137799b53', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:02:40 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-522d52f7-ae4c-4475-aa17-1ce009f45a5a tempest-VolumesListTestJSON-44335780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a67c68f0-0e95-4bab-9ef1-984ca049ea10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:02:40 devstack sudo[98381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ff781d46-cd9f-4ea9-94cd-719be3ba3e01 1073741824 Sep 17 22:02:40 devstack sudo[98381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:02:40 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-522d52f7-ae4c-4475-aa17-1ce009f45a5a tempest-VolumesListTestJSON-44335780 None] Volume volume-85791c45-dc10-469e-89d8-05b137799b53 (85791c45-dc10-469e-89d8-05b137799b53): created successfully Sep 17 22:02:40 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-522d52f7-ae4c-4475-aa17-1ce009f45a5a tempest-VolumesListTestJSON-44335780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a67c68f0-0e95-4bab-9ef1-984ca049ea10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:02:40 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-522d52f7-ae4c-4475-aa17-1ce009f45a5a tempest-VolumesListTestJSON-44335780 None] Flow 'volume_create_manager' (66d2a90c-1a26-41ca-bf91-736f87993b04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:02:40 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-522d52f7-ae4c-4475-aa17-1ce009f45a5a tempest-VolumesListTestJSON-44335780 None] Created volume successfully. Sep 17 22:02:41 devstack sudo[98381]: pam_unix(sudo:session): session closed for user root Sep 17 22:02:41 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-c639c18f-0336-4bf4-bc12-178a206167f1 tempest-VolumesDeleteCascade-2087052776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ff781d46-cd9f-4ea9-94cd-719be3ba3e01 1073741824" returned: 0 in 0.682s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:02:41 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-c639c18f-0336-4bf4-bc12-178a206167f1 tempest-VolumesDeleteCascade-2087052776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ff781d46-cd9f-4ea9-94cd-719be3ba3e01 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:02:41 devstack sudo[98387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ff781d46-cd9f-4ea9-94cd-719be3ba3e01 Sep 17 22:02:41 devstack sudo[98387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:02:41 devstack sudo[98387]: pam_unix(sudo:session): session closed for user root Sep 17 22:02:41 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-c639c18f-0336-4bf4-bc12-178a206167f1 tempest-VolumesDeleteCascade-2087052776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ff781d46-cd9f-4ea9-94cd-719be3ba3e01" returned: 0 in 0.407s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:02:41 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-c639c18f-0336-4bf4-bc12-178a206167f1 tempest-VolumesDeleteCascade-2087052776 None] <== create_volume: return (1151ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 22:02:41 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-c639c18f-0336-4bf4-bc12-178a206167f1 tempest-VolumesDeleteCascade-2087052776 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.162s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:02:42 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-c639c18f-0336-4bf4-bc12-178a206167f1 tempest-VolumesDeleteCascade-2087052776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7728b8d-6e0a-48b0-9afe-b0eafa669729) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff781d46-cd9f-4ea9-94cd-719be3ba3e01', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:02:42 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-c639c18f-0336-4bf4-bc12-178a206167f1 tempest-VolumesDeleteCascade-2087052776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45f20d9f-6092-4f3a-bef1-a82834f5eabe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:02:42 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-c639c18f-0336-4bf4-bc12-178a206167f1 tempest-VolumesDeleteCascade-2087052776 None] Volume volume-ff781d46-cd9f-4ea9-94cd-719be3ba3e01 (ff781d46-cd9f-4ea9-94cd-719be3ba3e01): created successfully Sep 17 22:02:42 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-c639c18f-0336-4bf4-bc12-178a206167f1 tempest-VolumesDeleteCascade-2087052776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45f20d9f-6092-4f3a-bef1-a82834f5eabe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:02:42 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-c639c18f-0336-4bf4-bc12-178a206167f1 tempest-VolumesDeleteCascade-2087052776 None] Flow 'volume_create_manager' (0f488bbc-ccce-4f78-b5dc-abfe606f520d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:02:42 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-c639c18f-0336-4bf4-bc12-178a206167f1 tempest-VolumesDeleteCascade-2087052776 None] Created volume successfully. Sep 17 22:02:42 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-3cd2286b-3a46-44e2-8eb4-8db32a9767da tempest-VolumesDeleteCascade-2087052776 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:02:42 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-3cd2286b-3a46-44e2-8eb4-8db32a9767da tempest-VolumesDeleteCascade-2087052776 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:02:42 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-3cd2286b-3a46-44e2-8eb4-8db32a9767da tempest-VolumesDeleteCascade-2087052776 None] Creating offline snapshot e76e8d18-ed5d-4c91-8c04-33ae7b0451d9 of volume ff781d46-cd9f-4ea9-94cd-719be3ba3e01 {{(pid=85458) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 22:02:42 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[09ac1a3b-1917-4fb9-ba3c-bfa6c79a1080]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:02:42 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-3cd2286b-3a46-44e2-8eb4-8db32a9767da tempest-VolumesDeleteCascade-2087052776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ff781d46-cd9f-4ea9-94cd-719be3ba3e01 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:02:42 devstack sudo[98393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ff781d46-cd9f-4ea9-94cd-719be3ba3e01 Sep 17 22:02:42 devstack sudo[98393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:02:43 devstack sudo[98393]: pam_unix(sudo:session): session closed for user root Sep 17 22:02:43 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-3cd2286b-3a46-44e2-8eb4-8db32a9767da tempest-VolumesDeleteCascade-2087052776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ff781d46-cd9f-4ea9-94cd-719be3ba3e01" returned: 0 in 0.651s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:02:43 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-3cd2286b-3a46-44e2-8eb4-8db32a9767da tempest-VolumesDeleteCascade-2087052776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ff781d46-cd9f-4ea9-94cd-719be3ba3e01,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ff781d46-cd9f-4ea9-94cd-719be3ba3e01.e76e8d18-ed5d-4c91-8c04-33ae7b0451d9 1G {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:02:43 devstack sudo[98398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ff781d46-cd9f-4ea9-94cd-719be3ba3e01,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ff781d46-cd9f-4ea9-94cd-719be3ba3e01.e76e8d18-ed5d-4c91-8c04-33ae7b0451d9 1G Sep 17 22:02:43 devstack sudo[98398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:02:43 devstack sudo[98398]: pam_unix(sudo:session): session closed for user root Sep 17 22:02:43 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-3cd2286b-3a46-44e2-8eb4-8db32a9767da tempest-VolumesDeleteCascade-2087052776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ff781d46-cd9f-4ea9-94cd-719be3ba3e01,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ff781d46-cd9f-4ea9-94cd-719be3ba3e01.e76e8d18-ed5d-4c91-8c04-33ae7b0451d9 1G" returned: 0 in 0.588s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:02:43 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-3cd2286b-3a46-44e2-8eb4-8db32a9767da tempest-VolumesDeleteCascade-2087052776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff781d46-cd9f-4ea9-94cd-719be3ba3e01 -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ff781d46-cd9f-4ea9-94cd-719be3ba3e01.e76e8d18-ed5d-4c91-8c04-33ae7b0451d9 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:02:43 devstack sudo[98404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff781d46-cd9f-4ea9-94cd-719be3ba3e01 -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ff781d46-cd9f-4ea9-94cd-719be3ba3e01.e76e8d18-ed5d-4c91-8c04-33ae7b0451d9 Sep 17 22:02:43 devstack sudo[98404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:02:44 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-8fef9f78-c66b-45ff-86d3-f302ac3d4bfd tempest-VolumesListTestJSON-44335780 None] Acquiring lock "cinder-85791c45-dc10-469e-89d8-05b137799b53-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:02:44 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-8fef9f78-c66b-45ff-86d3-f302ac3d4bfd tempest-VolumesListTestJSON-44335780 None] Lock "cinder-85791c45-dc10-469e-89d8-05b137799b53-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:02:44 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-8fef9f78-c66b-45ff-86d3-f302ac3d4bfd tempest-VolumesListTestJSON-44335780 None] Acquiring lock "cinder-quobyte-85791c45-dc10-469e-89d8-05b137799b53" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:02:44 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-8fef9f78-c66b-45ff-86d3-f302ac3d4bfd tempest-VolumesListTestJSON-44335780 None] Lock "cinder-quobyte-85791c45-dc10-469e-89d8-05b137799b53" acquired by "delete_volume" :: waited 0.029s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:02:44 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4b9f9c1-98ef-4da8-a3cb-8bad828401a3]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:02:44 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-8fef9f78-c66b-45ff-86d3-f302ac3d4bfd tempest-VolumesListTestJSON-44335780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-85791c45-dc10-469e-89d8-05b137799b53 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:02:44 devstack sudo[98404]: pam_unix(sudo:session): session closed for user root Sep 17 22:02:44 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-3cd2286b-3a46-44e2-8eb4-8db32a9767da tempest-VolumesDeleteCascade-2087052776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff781d46-cd9f-4ea9-94cd-719be3ba3e01 -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ff781d46-cd9f-4ea9-94cd-719be3ba3e01.e76e8d18-ed5d-4c91-8c04-33ae7b0451d9" returned: 0 in 0.669s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:02:44 devstack cinder-volume[85458]: WARNING cinder.volume.drivers.remotefs [None req-3cd2286b-3a46-44e2-8eb4-8db32a9767da tempest-VolumesDeleteCascade-2087052776 None] /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ff781d46-cd9f-4ea9-94cd-719be3ba3e01.e76e8d18-ed5d-4c91-8c04-33ae7b0451d9 is being set with open permissions: ugo+rw Sep 17 22:02:44 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-3cd2286b-3a46-44e2-8eb4-8db32a9767da tempest-VolumesDeleteCascade-2087052776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ff781d46-cd9f-4ea9-94cd-719be3ba3e01.e76e8d18-ed5d-4c91-8c04-33ae7b0451d9 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:02:44 devstack sudo[98410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-85791c45-dc10-469e-89d8-05b137799b53 Sep 17 22:02:44 devstack sudo[98410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:02:44 devstack sudo[98411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ff781d46-cd9f-4ea9-94cd-719be3ba3e01.e76e8d18-ed5d-4c91-8c04-33ae7b0451d9 Sep 17 22:02:44 devstack sudo[98411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:02:44 devstack sudo[98411]: pam_unix(sudo:session): session closed for user root Sep 17 22:02:44 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-3cd2286b-3a46-44e2-8eb4-8db32a9767da tempest-VolumesDeleteCascade-2087052776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ff781d46-cd9f-4ea9-94cd-719be3ba3e01.e76e8d18-ed5d-4c91-8c04-33ae7b0451d9" returned: 0 in 0.364s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:02:44 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-3cd2286b-3a46-44e2-8eb4-8db32a9767da tempest-VolumesDeleteCascade-2087052776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ff781d46-cd9f-4ea9-94cd-719be3ba3e01.info {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:02:45 devstack sudo[98429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ff781d46-cd9f-4ea9-94cd-719be3ba3e01.info Sep 17 22:02:45 devstack sudo[98429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:02:45 devstack sudo[98410]: pam_unix(sudo:session): session closed for user root Sep 17 22:02:45 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-8fef9f78-c66b-45ff-86d3-f302ac3d4bfd tempest-VolumesListTestJSON-44335780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-85791c45-dc10-469e-89d8-05b137799b53" returned: 0 in 0.639s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:02:45 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-8fef9f78-c66b-45ff-86d3-f302ac3d4bfd tempest-VolumesListTestJSON-44335780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-85791c45-dc10-469e-89d8-05b137799b53 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:02:45 devstack sudo[98433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-85791c45-dc10-469e-89d8-05b137799b53 Sep 17 22:02:45 devstack sudo[98433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:02:45 devstack sudo[98429]: pam_unix(sudo:session): session closed for user root Sep 17 22:02:45 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-3cd2286b-3a46-44e2-8eb4-8db32a9767da tempest-VolumesDeleteCascade-2087052776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ff781d46-cd9f-4ea9-94cd-719be3ba3e01.info" returned: 0 in 0.529s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:02:45 devstack cinder-volume[85458]: WARNING cinder.volume.drivers.remotefs [None req-3cd2286b-3a46-44e2-8eb4-8db32a9767da tempest-VolumesDeleteCascade-2087052776 None] /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ff781d46-cd9f-4ea9-94cd-719be3ba3e01.info is being set with open permissions: ugo+rw Sep 17 22:02:45 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-3cd2286b-3a46-44e2-8eb4-8db32a9767da tempest-VolumesDeleteCascade-2087052776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ff781d46-cd9f-4ea9-94cd-719be3ba3e01.info {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:02:45 devstack sudo[98441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ff781d46-cd9f-4ea9-94cd-719be3ba3e01.info Sep 17 22:02:45 devstack sudo[98433]: pam_unix(sudo:session): session closed for user root Sep 17 22:02:45 devstack sudo[98441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:02:45 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-8fef9f78-c66b-45ff-86d3-f302ac3d4bfd tempest-VolumesListTestJSON-44335780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-85791c45-dc10-469e-89d8-05b137799b53" returned: 0 in 0.499s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:02:45 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-8fef9f78-c66b-45ff-86d3-f302ac3d4bfd tempest-VolumesListTestJSON-44335780 None] Lock "cinder-quobyte-85791c45-dc10-469e-89d8-05b137799b53" released by "delete_volume" :: held 1.232s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:02:45 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-8fef9f78-c66b-45ff-86d3-f302ac3d4bfd tempest-VolumesListTestJSON-44335780 None] Created reservations ['06bf2f27-c013-4a12-8125-f3ade978154c', '7b856242-4746-4381-845a-c5f482af9ed9', '13734536-c175-4991-81b3-4aefcb0f7440', '81bff05c-9f9c-405c-903e-3ee5298d3f7a'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:02:45 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-8fef9f78-c66b-45ff-86d3-f302ac3d4bfd tempest-VolumesListTestJSON-44335780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:02:45 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-8fef9f78-c66b-45ff-86d3-f302ac3d4bfd tempest-VolumesListTestJSON-44335780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:02:45 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-8fef9f78-c66b-45ff-86d3-f302ac3d4bfd tempest-VolumesListTestJSON-44335780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:02:45 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-8fef9f78-c66b-45ff-86d3-f302ac3d4bfd tempest-VolumesListTestJSON-44335780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:02:45 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-8fef9f78-c66b-45ff-86d3-f302ac3d4bfd tempest-VolumesListTestJSON-44335780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:02:45 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-8fef9f78-c66b-45ff-86d3-f302ac3d4bfd tempest-VolumesListTestJSON-44335780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:02:45 devstack sudo[98443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:02:45 devstack sudo[98443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:02:45 devstack sudo[98441]: pam_unix(sudo:session): session closed for user root Sep 17 22:02:45 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-3cd2286b-3a46-44e2-8eb4-8db32a9767da tempest-VolumesDeleteCascade-2087052776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ff781d46-cd9f-4ea9-94cd-719be3ba3e01.info" returned: 0 in 0.357s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:02:45 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-3cd2286b-3a46-44e2-8eb4-8db32a9767da tempest-VolumesDeleteCascade-2087052776 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.331s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:02:45 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-3cd2286b-3a46-44e2-8eb4-8db32a9767da tempest-VolumesDeleteCascade-2087052776 None] Create snapshot completed successfully Sep 17 22:02:46 devstack sudo[98443]: pam_unix(sudo:session): session closed for user root Sep 17 22:02:46 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-8fef9f78-c66b-45ff-86d3-f302ac3d4bfd tempest-VolumesListTestJSON-44335780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.363s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:02:46 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-8fef9f78-c66b-45ff-86d3-f302ac3d4bfd tempest-VolumesListTestJSON-44335780 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:02:46 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-8fef9f78-c66b-45ff-86d3-f302ac3d4bfd tempest-VolumesListTestJSON-44335780 None] Deleted volume successfully. Sep 17 22:02:46 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-8fef9f78-c66b-45ff-86d3-f302ac3d4bfd tempest-VolumesListTestJSON-44335780 None] Lock "cinder-85791c45-dc10-469e-89d8-05b137799b53-delete_volume" released by "delete_volume" :: held 1.925s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:02:46 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-9368fc41-d25b-40b5-8414-72982f282cbc tempest-VolumesListTestJSON-44335780 None] Acquiring lock "cinder-50f12223-c1ad-4cd2-83b4-e7b49108da87-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:02:46 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-9368fc41-d25b-40b5-8414-72982f282cbc tempest-VolumesListTestJSON-44335780 None] Lock "cinder-50f12223-c1ad-4cd2-83b4-e7b49108da87-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:02:46 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-9368fc41-d25b-40b5-8414-72982f282cbc tempest-VolumesListTestJSON-44335780 None] Acquiring lock "cinder-quobyte-50f12223-c1ad-4cd2-83b4-e7b49108da87" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:02:46 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-9368fc41-d25b-40b5-8414-72982f282cbc tempest-VolumesListTestJSON-44335780 None] Lock "cinder-quobyte-50f12223-c1ad-4cd2-83b4-e7b49108da87" acquired by "delete_volume" :: waited 0.047s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:02:46 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[a65a8b2e-9fee-49d0-85f2-45942d9a48ed]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:02:46 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-9368fc41-d25b-40b5-8414-72982f282cbc tempest-VolumesListTestJSON-44335780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-50f12223-c1ad-4cd2-83b4-e7b49108da87 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:02:47 devstack sudo[98447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-50f12223-c1ad-4cd2-83b4-e7b49108da87 Sep 17 22:02:47 devstack sudo[98447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:02:47 devstack sudo[98447]: pam_unix(sudo:session): session closed for user root Sep 17 22:02:47 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-9368fc41-d25b-40b5-8414-72982f282cbc tempest-VolumesListTestJSON-44335780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-50f12223-c1ad-4cd2-83b4-e7b49108da87" returned: 0 in 0.725s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:02:47 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-9368fc41-d25b-40b5-8414-72982f282cbc tempest-VolumesListTestJSON-44335780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-50f12223-c1ad-4cd2-83b4-e7b49108da87 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:02:47 devstack sudo[98454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-50f12223-c1ad-4cd2-83b4-e7b49108da87 Sep 17 22:02:47 devstack sudo[98454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:02:47 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d5769fa-b29b-4c42-b6d1-c1537acaa850 tempest-VolumesDeleteCascade-2087052776 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 22:02:47 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-9d5769fa-b29b-4c42-b6d1-c1537acaa850 tempest-VolumesDeleteCascade-2087052776 None] Flow 'volume_create_manager' (e72db8e8-fad9-4fdf-8854-14ecbe1ecec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:02:47 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-9d5769fa-b29b-4c42-b6d1-c1537acaa850 tempest-VolumesDeleteCascade-2087052776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (827e29bf-141b-4424-8b48-2c7008e61e68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:02:47 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-9d5769fa-b29b-4c42-b6d1-c1537acaa850 tempest-VolumesDeleteCascade-2087052776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (827e29bf-141b-4424-8b48-2c7008e61e68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:02:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1746481908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab77bdc5-369e-4e5a-bd95-9a91bf44577b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2b5ef67e0224619ab0cef1895ddc606',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:02:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e76e8d18-ed5d-4c91-8c04-33ae7b0451d9,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:02:48Z,use_quota=True,user_id='ab4a33bb86674c8d804b6886b3e2b6dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:02:47 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-9d5769fa-b29b-4c42-b6d1-c1537acaa850 tempest-VolumesDeleteCascade-2087052776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18dbd653-93cd-4079-be05-d045e2f547b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:02:47 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-9d5769fa-b29b-4c42-b6d1-c1537acaa850 tempest-VolumesDeleteCascade-2087052776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18dbd653-93cd-4079-be05-d045e2f547b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:02:47 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-9d5769fa-b29b-4c42-b6d1-c1537acaa850 tempest-VolumesDeleteCascade-2087052776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (179aae4b-d492-4f69-9b2a-8de8775ba402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:02:47 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-9d5769fa-b29b-4c42-b6d1-c1537acaa850 tempest-VolumesDeleteCascade-2087052776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (179aae4b-d492-4f69-9b2a-8de8775ba402) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ab77bdc5-369e-4e5a-bd95-9a91bf44577b', 'volume_name': 'volume-ab77bdc5-369e-4e5a-bd95-9a91bf44577b', 'volume_size': 1, 'snapshot_id': 'e76e8d18-ed5d-4c91-8c04-33ae7b0451d9'}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:02:47 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-9d5769fa-b29b-4c42-b6d1-c1537acaa850 tempest-VolumesDeleteCascade-2087052776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c139cf4-498d-4a0b-b58f-3afc08930178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:02:47 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-9d5769fa-b29b-4c42-b6d1-c1537acaa850 tempest-VolumesDeleteCascade-2087052776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c139cf4-498d-4a0b-b58f-3afc08930178) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:02:47 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-9d5769fa-b29b-4c42-b6d1-c1537acaa850 tempest-VolumesDeleteCascade-2087052776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e58a6580-db13-4321-8c39-140d69b73785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:02:47 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-9d5769fa-b29b-4c42-b6d1-c1537acaa850 tempest-VolumesDeleteCascade-2087052776 None] Volume ab77bdc5-369e-4e5a-bd95-9a91bf44577b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ab77bdc5-369e-4e5a-bd95-9a91bf44577b', 'volume_size': 1, 'snapshot_id': 'e76e8d18-ed5d-4c91-8c04-33ae7b0451d9'} Sep 17 22:02:47 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-9d5769fa-b29b-4c42-b6d1-c1537acaa850 tempest-VolumesDeleteCascade-2087052776 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:02:47 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-9d5769fa-b29b-4c42-b6d1-c1537acaa850 tempest-VolumesDeleteCascade-2087052776 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:02:47 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-9d5769fa-b29b-4c42-b6d1-c1537acaa850 tempest-VolumesDeleteCascade-2087052776 None] Acquiring lock "cinder-quobyte-e76e8d18-ed5d-4c91-8c04-33ae7b0451d9-ab77bdc5-369e-4e5a-bd95-9a91bf44577b" by "_create_volume_from_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:02:47 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-9d5769fa-b29b-4c42-b6d1-c1537acaa850 tempest-VolumesDeleteCascade-2087052776 None] Lock "cinder-quobyte-e76e8d18-ed5d-4c91-8c04-33ae7b0451d9-ab77bdc5-369e-4e5a-bd95-9a91bf44577b" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:02:47 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-9d5769fa-b29b-4c42-b6d1-c1537acaa850 tempest-VolumesDeleteCascade-2087052776 None] Creating volume ab77bdc5-369e-4e5a-bd95-9a91bf44577b from snapshot e76e8d18-ed5d-4c91-8c04-33ae7b0451d9 {{(pid=85458) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 17 22:02:47 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-9d5769fa-b29b-4c42-b6d1-c1537acaa850 tempest-VolumesDeleteCascade-2087052776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:02:47 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-9d5769fa-b29b-4c42-b6d1-c1537acaa850 tempest-VolumesDeleteCascade-2087052776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:02:47 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-9d5769fa-b29b-4c42-b6d1-c1537acaa850 tempest-VolumesDeleteCascade-2087052776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:02:47 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-9d5769fa-b29b-4c42-b6d1-c1537acaa850 tempest-VolumesDeleteCascade-2087052776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:02:47 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-9d5769fa-b29b-4c42-b6d1-c1537acaa850 tempest-VolumesDeleteCascade-2087052776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:02:47 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-9d5769fa-b29b-4c42-b6d1-c1537acaa850 tempest-VolumesDeleteCascade-2087052776 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 22:02:47 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-9d5769fa-b29b-4c42-b6d1-c1537acaa850 tempest-VolumesDeleteCascade-2087052776 None] Acquiring lock "cinder-quobyte-ab77bdc5-369e-4e5a-bd95-9a91bf44577b" by "_copy_volume_from_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:02:48 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-9d5769fa-b29b-4c42-b6d1-c1537acaa850 tempest-VolumesDeleteCascade-2087052776 None] Lock "cinder-quobyte-ab77bdc5-369e-4e5a-bd95-9a91bf44577b" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:02:48 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-9d5769fa-b29b-4c42-b6d1-c1537acaa850 tempest-VolumesDeleteCascade-2087052776 None] snapshot: e76e8d18-ed5d-4c91-8c04-33ae7b0451d9, volume: ab77bdc5-369e-4e5a-bd95-9a91bf44577b, {{(pid=85458) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 17 22:02:48 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-9d5769fa-b29b-4c42-b6d1-c1537acaa850 tempest-VolumesDeleteCascade-2087052776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:02:48 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-9d5769fa-b29b-4c42-b6d1-c1537acaa850 tempest-VolumesDeleteCascade-2087052776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:02:48 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-9d5769fa-b29b-4c42-b6d1-c1537acaa850 tempest-VolumesDeleteCascade-2087052776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:02:48 devstack sudo[98454]: pam_unix(sudo:session): session closed for user root Sep 17 22:02:48 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-9d5769fa-b29b-4c42-b6d1-c1537acaa850 tempest-VolumesDeleteCascade-2087052776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:02:48 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-9d5769fa-b29b-4c42-b6d1-c1537acaa850 tempest-VolumesDeleteCascade-2087052776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:02:48 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-9368fc41-d25b-40b5-8414-72982f282cbc tempest-VolumesListTestJSON-44335780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-50f12223-c1ad-4cd2-83b4-e7b49108da87" returned: 0 in 0.414s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:02:48 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[350ada02-6fe3-4529-a263-c4854f424da5]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:02:48 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-9d5769fa-b29b-4c42-b6d1-c1537acaa850 tempest-VolumesDeleteCascade-2087052776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ff781d46-cd9f-4ea9-94cd-719be3ba3e01.e76e8d18-ed5d-4c91-8c04-33ae7b0451d9 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:02:48 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-9368fc41-d25b-40b5-8414-72982f282cbc tempest-VolumesListTestJSON-44335780 None] Lock "cinder-quobyte-50f12223-c1ad-4cd2-83b4-e7b49108da87" released by "delete_volume" :: held 1.236s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:02:48 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-9368fc41-d25b-40b5-8414-72982f282cbc tempest-VolumesListTestJSON-44335780 None] Created reservations ['01c794c3-8b1d-446b-97f3-c812c80bd92b', '303023be-1035-4199-8c4f-54f48e9334ad', '0a1e4a51-d0ec-4b59-b77b-1a409051a953', 'f9d6e4e7-4e7f-4295-9adf-95e784b143d6'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:02:48 devstack sudo[98457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ff781d46-cd9f-4ea9-94cd-719be3ba3e01.e76e8d18-ed5d-4c91-8c04-33ae7b0451d9 Sep 17 22:02:48 devstack sudo[98457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:02:48 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-9368fc41-d25b-40b5-8414-72982f282cbc tempest-VolumesListTestJSON-44335780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:02:48 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-9368fc41-d25b-40b5-8414-72982f282cbc tempest-VolumesListTestJSON-44335780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:02:48 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-9368fc41-d25b-40b5-8414-72982f282cbc tempest-VolumesListTestJSON-44335780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:02:48 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-9368fc41-d25b-40b5-8414-72982f282cbc tempest-VolumesListTestJSON-44335780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:02:48 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-9368fc41-d25b-40b5-8414-72982f282cbc tempest-VolumesListTestJSON-44335780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:02:48 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-9368fc41-d25b-40b5-8414-72982f282cbc tempest-VolumesListTestJSON-44335780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:02:48 devstack sudo[98459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:02:48 devstack sudo[98459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:02:48 devstack sudo[98459]: pam_unix(sudo:session): session closed for user root Sep 17 22:02:48 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-9368fc41-d25b-40b5-8414-72982f282cbc tempest-VolumesListTestJSON-44335780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.342s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:02:48 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-9368fc41-d25b-40b5-8414-72982f282cbc tempest-VolumesListTestJSON-44335780 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:02:48 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-9368fc41-d25b-40b5-8414-72982f282cbc tempest-VolumesListTestJSON-44335780 None] Deleted volume successfully. Sep 17 22:02:48 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-9368fc41-d25b-40b5-8414-72982f282cbc tempest-VolumesListTestJSON-44335780 None] Lock "cinder-50f12223-c1ad-4cd2-83b4-e7b49108da87-delete_volume" released by "delete_volume" :: held 1.972s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:02:48 devstack sudo[98457]: pam_unix(sudo:session): session closed for user root Sep 17 22:02:48 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-9d5769fa-b29b-4c42-b6d1-c1537acaa850 tempest-VolumesDeleteCascade-2087052776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ff781d46-cd9f-4ea9-94cd-719be3ba3e01.e76e8d18-ed5d-4c91-8c04-33ae7b0451d9" returned: 0 in 0.707s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:02:48 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-9d5769fa-b29b-4c42-b6d1-c1537acaa850 tempest-VolumesDeleteCascade-2087052776 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff781d46-cd9f-4ea9-94cd-719be3ba3e01(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85458) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 22:02:48 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[6629ea5e-33ce-4da7-a5e3-c75146da204f]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:02:48 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-9d5769fa-b29b-4c42-b6d1-c1537acaa850 tempest-VolumesDeleteCascade-2087052776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ff781d46-cd9f-4ea9-94cd-719be3ba3e01 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:02:49 devstack sudo[98480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ff781d46-cd9f-4ea9-94cd-719be3ba3e01 Sep 17 22:02:49 devstack sudo[98480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:02:49 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-96eb2f09-e8b3-4958-b16c-29cc24288a49 tempest-VolumesListTestJSON-44335780 None] Acquiring lock "cinder-91118cdc-0832-4257-a36f-649a0e85d18b-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:02:49 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-96eb2f09-e8b3-4958-b16c-29cc24288a49 tempest-VolumesListTestJSON-44335780 None] Lock "cinder-91118cdc-0832-4257-a36f-649a0e85d18b-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:02:49 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-96eb2f09-e8b3-4958-b16c-29cc24288a49 tempest-VolumesListTestJSON-44335780 None] Acquiring lock "cinder-quobyte-91118cdc-0832-4257-a36f-649a0e85d18b" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:02:49 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-96eb2f09-e8b3-4958-b16c-29cc24288a49 tempest-VolumesListTestJSON-44335780 None] Lock "cinder-quobyte-91118cdc-0832-4257-a36f-649a0e85d18b" acquired by "delete_volume" :: waited 0.020s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:02:49 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e91ddea-eb41-4a0a-8a0b-4741b947e730]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:02:49 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-96eb2f09-e8b3-4958-b16c-29cc24288a49 tempest-VolumesListTestJSON-44335780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-91118cdc-0832-4257-a36f-649a0e85d18b {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:02:49 devstack sudo[98480]: pam_unix(sudo:session): session closed for user root Sep 17 22:02:49 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-9d5769fa-b29b-4c42-b6d1-c1537acaa850 tempest-VolumesDeleteCascade-2087052776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ff781d46-cd9f-4ea9-94cd-719be3ba3e01" returned: 0 in 0.739s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:02:49 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-9d5769fa-b29b-4c42-b6d1-c1537acaa850 tempest-VolumesDeleteCascade-2087052776 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ff781d46-cd9f-4ea9-94cd-719be3ba3e01 {{(pid=85458) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 17 22:02:49 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-9d5769fa-b29b-4c42-b6d1-c1537acaa850 tempest-VolumesDeleteCascade-2087052776 None] Creating direct copy from snapshot {{(pid=85458) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 17 22:02:49 devstack cinder-volume[85458]: DEBUG cinder.utils [None req-9d5769fa-b29b-4c42-b6d1-c1537acaa850 tempest-VolumesDeleteCascade-2087052776 None] Path /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ab77bdc5-369e-4e5a-bd95-9a91bf44577b not found in is_blk_device check {{(pid=85458) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 17 22:02:49 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-9d5769fa-b29b-4c42-b6d1-c1537acaa850 tempest-VolumesDeleteCascade-2087052776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ff781d46-cd9f-4ea9-94cd-719be3ba3e01 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ab77bdc5-369e-4e5a-bd95-9a91bf44577b {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:02:49 devstack sudo[98530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ff781d46-cd9f-4ea9-94cd-719be3ba3e01 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ab77bdc5-369e-4e5a-bd95-9a91bf44577b Sep 17 22:02:49 devstack sudo[98530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:02:49 devstack sudo[98527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-91118cdc-0832-4257-a36f-649a0e85d18b Sep 17 22:02:49 devstack sudo[98527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:02:50 devstack sudo[98527]: pam_unix(sudo:session): session closed for user root Sep 17 22:02:50 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-96eb2f09-e8b3-4958-b16c-29cc24288a49 tempest-VolumesListTestJSON-44335780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-91118cdc-0832-4257-a36f-649a0e85d18b" returned: 0 in 0.797s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:02:50 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-96eb2f09-e8b3-4958-b16c-29cc24288a49 tempest-VolumesListTestJSON-44335780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-91118cdc-0832-4257-a36f-649a0e85d18b {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:02:50 devstack sudo[98548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-91118cdc-0832-4257-a36f-649a0e85d18b Sep 17 22:02:50 devstack sudo[98548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:02:51 devstack sudo[98548]: pam_unix(sudo:session): session closed for user root Sep 17 22:02:51 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-96eb2f09-e8b3-4958-b16c-29cc24288a49 tempest-VolumesListTestJSON-44335780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-91118cdc-0832-4257-a36f-649a0e85d18b" returned: 0 in 1.041s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:02:51 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-96eb2f09-e8b3-4958-b16c-29cc24288a49 tempest-VolumesListTestJSON-44335780 None] Lock "cinder-quobyte-91118cdc-0832-4257-a36f-649a0e85d18b" released by "delete_volume" :: held 1.962s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:02:51 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-96eb2f09-e8b3-4958-b16c-29cc24288a49 tempest-VolumesListTestJSON-44335780 None] Created reservations ['8361734b-acaa-419f-9b68-33b0ed697438', 'b70a3b61-8303-4d12-b227-192cb734b249', '985d4814-a81e-4ec3-9a78-0560462439a2', '29e2e6bf-27df-44d7-aa46-ad07da55e617'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:02:52 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-96eb2f09-e8b3-4958-b16c-29cc24288a49 tempest-VolumesListTestJSON-44335780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:02:52 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-96eb2f09-e8b3-4958-b16c-29cc24288a49 tempest-VolumesListTestJSON-44335780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:02:52 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-96eb2f09-e8b3-4958-b16c-29cc24288a49 tempest-VolumesListTestJSON-44335780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:02:52 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-96eb2f09-e8b3-4958-b16c-29cc24288a49 tempest-VolumesListTestJSON-44335780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:02:52 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-96eb2f09-e8b3-4958-b16c-29cc24288a49 tempest-VolumesListTestJSON-44335780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:02:52 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-96eb2f09-e8b3-4958-b16c-29cc24288a49 tempest-VolumesListTestJSON-44335780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:02:52 devstack sudo[98559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:02:52 devstack sudo[98559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:02:52 devstack sudo[98559]: pam_unix(sudo:session): session closed for user root Sep 17 22:02:52 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-96eb2f09-e8b3-4958-b16c-29cc24288a49 tempest-VolumesListTestJSON-44335780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.717s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:02:52 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-96eb2f09-e8b3-4958-b16c-29cc24288a49 tempest-VolumesListTestJSON-44335780 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:02:52 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-96eb2f09-e8b3-4958-b16c-29cc24288a49 tempest-VolumesListTestJSON-44335780 None] Deleted volume successfully. Sep 17 22:02:52 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-96eb2f09-e8b3-4958-b16c-29cc24288a49 tempest-VolumesListTestJSON-44335780 None] Lock "cinder-91118cdc-0832-4257-a36f-649a0e85d18b-delete_volume" released by "delete_volume" :: held 3.595s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:03:00 devstack sudo[98530]: pam_unix(sudo:session): session closed for user root Sep 17 22:03:00 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-9d5769fa-b29b-4c42-b6d1-c1537acaa850 tempest-VolumesDeleteCascade-2087052776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ff781d46-cd9f-4ea9-94cd-719be3ba3e01 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ab77bdc5-369e-4e5a-bd95-9a91bf44577b" returned: 0 in 10.988s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:03:00 devstack cinder-volume[85458]: DEBUG cinder.image.image_utils [None req-9d5769fa-b29b-4c42-b6d1-c1537acaa850 tempest-VolumesDeleteCascade-2087052776 None] Image conversion details: src /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ff781d46-cd9f-4ea9-94cd-719be3ba3e01, size 1024.00 MB, duration 10.99 sec, destination /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ab77bdc5-369e-4e5a-bd95-9a91bf44577b {{(pid=85458) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 17 22:03:00 devstack cinder-volume[85458]: INFO cinder.image.image_utils [None req-9d5769fa-b29b-4c42-b6d1-c1537acaa850 tempest-VolumesDeleteCascade-2087052776 None] Converted 1024.00 MB image at 93.18 MB/s Sep 17 22:03:00 devstack cinder-volume[85458]: WARNING cinder.volume.drivers.remotefs [None req-9d5769fa-b29b-4c42-b6d1-c1537acaa850 tempest-VolumesDeleteCascade-2087052776 None] /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ab77bdc5-369e-4e5a-bd95-9a91bf44577b is being set with open permissions: ugo+rw Sep 17 22:03:00 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-9d5769fa-b29b-4c42-b6d1-c1537acaa850 tempest-VolumesDeleteCascade-2087052776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ab77bdc5-369e-4e5a-bd95-9a91bf44577b {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:03:00 devstack sudo[98567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ab77bdc5-369e-4e5a-bd95-9a91bf44577b Sep 17 22:03:00 devstack sudo[98567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:03:01 devstack sudo[98567]: pam_unix(sudo:session): session closed for user root Sep 17 22:03:01 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-9d5769fa-b29b-4c42-b6d1-c1537acaa850 tempest-VolumesDeleteCascade-2087052776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ab77bdc5-369e-4e5a-bd95-9a91bf44577b" returned: 0 in 0.483s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:03:01 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-9d5769fa-b29b-4c42-b6d1-c1537acaa850 tempest-VolumesDeleteCascade-2087052776 None] Lock "cinder-quobyte-ab77bdc5-369e-4e5a-bd95-9a91bf44577b" released by "_copy_volume_from_snapshot" :: held 13.038s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:03:01 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-9d5769fa-b29b-4c42-b6d1-c1537acaa850 tempest-VolumesDeleteCascade-2087052776 None] Lock "cinder-quobyte-e76e8d18-ed5d-4c91-8c04-33ae7b0451d9-ab77bdc5-369e-4e5a-bd95-9a91bf44577b" released by "_create_volume_from_snapshot" :: held 13.149s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:03:01 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-9d5769fa-b29b-4c42-b6d1-c1537acaa850 tempest-VolumesDeleteCascade-2087052776 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.176s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:03:01 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-9d5769fa-b29b-4c42-b6d1-c1537acaa850 tempest-VolumesDeleteCascade-2087052776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e58a6580-db13-4321-8c39-140d69b73785) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab77bdc5-369e-4e5a-bd95-9a91bf44577b', 'volume_size': 1, 'snapshot_id': 'e76e8d18-ed5d-4c91-8c04-33ae7b0451d9'}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:03:01 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-9d5769fa-b29b-4c42-b6d1-c1537acaa850 tempest-VolumesDeleteCascade-2087052776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e50dcb0-efc5-43af-85f1-8f1126c92938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:03:01 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-9d5769fa-b29b-4c42-b6d1-c1537acaa850 tempest-VolumesDeleteCascade-2087052776 None] Volume volume-ab77bdc5-369e-4e5a-bd95-9a91bf44577b (ab77bdc5-369e-4e5a-bd95-9a91bf44577b): created successfully Sep 17 22:03:01 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-9d5769fa-b29b-4c42-b6d1-c1537acaa850 tempest-VolumesDeleteCascade-2087052776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e50dcb0-efc5-43af-85f1-8f1126c92938) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:03:01 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-9d5769fa-b29b-4c42-b6d1-c1537acaa850 tempest-VolumesDeleteCascade-2087052776 None] Flow 'volume_create_manager' (e72db8e8-fad9-4fdf-8854-14ecbe1ecec7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:03:01 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-9d5769fa-b29b-4c42-b6d1-c1537acaa850 tempest-VolumesDeleteCascade-2087052776 None] Created volume successfully. Sep 17 22:03:01 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-fd718ce6-e44f-4de6-8bfc-322be8d74077 tempest-VolumesDeleteCascade-2087052776 None] Acquiring lock "cinder-ff781d46-cd9f-4ea9-94cd-719be3ba3e01-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:03:01 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-fd718ce6-e44f-4de6-8bfc-322be8d74077 tempest-VolumesDeleteCascade-2087052776 None] Lock "cinder-ff781d46-cd9f-4ea9-94cd-719be3ba3e01-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:03:02 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-fd718ce6-e44f-4de6-8bfc-322be8d74077 tempest-VolumesDeleteCascade-2087052776 None] Performing cascade delete. {{(pid=85458) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 17 22:03:02 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-fd718ce6-e44f-4de6-8bfc-322be8d74077 tempest-VolumesDeleteCascade-2087052776 None] Acquiring lock "cinder-e76e8d18-ed5d-4c91-8c04-33ae7b0451d9-delete_snapshot" by "delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:03:02 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-fd718ce6-e44f-4de6-8bfc-322be8d74077 tempest-VolumesDeleteCascade-2087052776 None] Lock "cinder-e76e8d18-ed5d-4c91-8c04-33ae7b0451d9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:03:02 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-fd718ce6-e44f-4de6-8bfc-322be8d74077 tempest-VolumesDeleteCascade-2087052776 None] Acquiring lock "cinder-quobyte-ff781d46-cd9f-4ea9-94cd-719be3ba3e01" by "delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:03:02 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-fd718ce6-e44f-4de6-8bfc-322be8d74077 tempest-VolumesDeleteCascade-2087052776 None] Lock "cinder-quobyte-ff781d46-cd9f-4ea9-94cd-719be3ba3e01" acquired by "delete_snapshot" :: waited 0.027s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:03:02 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-fd718ce6-e44f-4de6-8bfc-322be8d74077 tempest-VolumesDeleteCascade-2087052776 None] Acquiring lock "cinder-quobyte-e76e8d18-ed5d-4c91-8c04-33ae7b0451d9" by "_delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:03:02 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-fd718ce6-e44f-4de6-8bfc-322be8d74077 tempest-VolumesDeleteCascade-2087052776 None] Lock "cinder-quobyte-e76e8d18-ed5d-4c91-8c04-33ae7b0451d9" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:03:02 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-fd718ce6-e44f-4de6-8bfc-322be8d74077 tempest-VolumesDeleteCascade-2087052776 None] Deleting offline snapshot e76e8d18-ed5d-4c91-8c04-33ae7b0451d9 of volume ff781d46-cd9f-4ea9-94cd-719be3ba3e01 {{(pid=85458) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 22:03:02 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-fd718ce6-e44f-4de6-8bfc-322be8d74077 tempest-VolumesDeleteCascade-2087052776 None] snapshot_file for this snap is: volume-ff781d46-cd9f-4ea9-94cd-719be3ba3e01.e76e8d18-ed5d-4c91-8c04-33ae7b0451d9 {{(pid=85458) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 22:03:02 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[af8c2687-6e1a-4961-a239-f4d45b382d57]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:03:02 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-fd718ce6-e44f-4de6-8bfc-322be8d74077 tempest-VolumesDeleteCascade-2087052776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ff781d46-cd9f-4ea9-94cd-719be3ba3e01.e76e8d18-ed5d-4c91-8c04-33ae7b0451d9 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:03:02 devstack sudo[98570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ff781d46-cd9f-4ea9-94cd-719be3ba3e01.e76e8d18-ed5d-4c91-8c04-33ae7b0451d9 Sep 17 22:03:02 devstack sudo[98570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:03:02 devstack sudo[98570]: pam_unix(sudo:session): session closed for user root Sep 17 22:03:02 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-fd718ce6-e44f-4de6-8bfc-322be8d74077 tempest-VolumesDeleteCascade-2087052776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ff781d46-cd9f-4ea9-94cd-719be3ba3e01.e76e8d18-ed5d-4c91-8c04-33ae7b0451d9" returned: 0 in 0.507s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:03:02 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-fd718ce6-e44f-4de6-8bfc-322be8d74077 tempest-VolumesDeleteCascade-2087052776 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff781d46-cd9f-4ea9-94cd-719be3ba3e01(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85458) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 22:03:02 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[5349a40e-f735-4edc-8cc6-f6b9e6e8f7fc]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:03:02 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-fd718ce6-e44f-4de6-8bfc-322be8d74077 tempest-VolumesDeleteCascade-2087052776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ff781d46-cd9f-4ea9-94cd-719be3ba3e01 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:03:02 devstack sudo[98580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ff781d46-cd9f-4ea9-94cd-719be3ba3e01 Sep 17 22:03:02 devstack sudo[98580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:03:03 devstack sudo[98580]: pam_unix(sudo:session): session closed for user root Sep 17 22:03:03 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-fd718ce6-e44f-4de6-8bfc-322be8d74077 tempest-VolumesDeleteCascade-2087052776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ff781d46-cd9f-4ea9-94cd-719be3ba3e01" returned: 0 in 0.923s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:03:03 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-fd718ce6-e44f-4de6-8bfc-322be8d74077 tempest-VolumesDeleteCascade-2087052776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ff781d46-cd9f-4ea9-94cd-719be3ba3e01.e76e8d18-ed5d-4c91-8c04-33ae7b0451d9 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:03:03 devstack sudo[98585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ff781d46-cd9f-4ea9-94cd-719be3ba3e01.e76e8d18-ed5d-4c91-8c04-33ae7b0451d9 Sep 17 22:03:03 devstack sudo[98585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:03:04 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-58944dd8-b6d7-4955-9bac-84571d6b287c tempest-VolumesNegativeTest-849504903 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 22:03:04 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-58944dd8-b6d7-4955-9bac-84571d6b287c tempest-VolumesNegativeTest-849504903 None] Flow 'volume_create_manager' (f891dd0f-f0a4-454a-92bb-8212ba8edfa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:03:04 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-58944dd8-b6d7-4955-9bac-84571d6b287c tempest-VolumesNegativeTest-849504903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (826762be-5a16-4402-9151-683f553040bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:03:04 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-58944dd8-b6d7-4955-9bac-84571d6b287c tempest-VolumesNegativeTest-849504903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (826762be-5a16-4402-9151-683f553040bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:03:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1594582764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ef567c1-f071-4201-b148-89df91cd8a50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce98945e6cd844528f4b44b8a94aa68b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:03:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:03:04Z,use_quota=True,user_id='5d3cca450ea64475908dc1d27711bf55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:03:04 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-58944dd8-b6d7-4955-9bac-84571d6b287c tempest-VolumesNegativeTest-849504903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23be6e7d-3d44-45ac-bd83-53596cced4ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:03:04 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-58944dd8-b6d7-4955-9bac-84571d6b287c tempest-VolumesNegativeTest-849504903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23be6e7d-3d44-45ac-bd83-53596cced4ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:03:04 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-58944dd8-b6d7-4955-9bac-84571d6b287c tempest-VolumesNegativeTest-849504903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d182291-bd05-406d-82b8-c982b76ceb08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:03:04 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-58944dd8-b6d7-4955-9bac-84571d6b287c tempest-VolumesNegativeTest-849504903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d182291-bd05-406d-82b8-c982b76ceb08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ef567c1-f071-4201-b148-89df91cd8a50', 'volume_name': 'volume-3ef567c1-f071-4201-b148-89df91cd8a50', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:03:04 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-58944dd8-b6d7-4955-9bac-84571d6b287c tempest-VolumesNegativeTest-849504903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e5ea471-2510-436d-b3b0-628f739637ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:03:04 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-58944dd8-b6d7-4955-9bac-84571d6b287c tempest-VolumesNegativeTest-849504903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e5ea471-2510-436d-b3b0-628f739637ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:03:04 devstack sudo[98585]: pam_unix(sudo:session): session closed for user root Sep 17 22:03:04 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-58944dd8-b6d7-4955-9bac-84571d6b287c tempest-VolumesNegativeTest-849504903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c33281c-85b8-4d3c-803e-ec77412d7679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:03:04 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-58944dd8-b6d7-4955-9bac-84571d6b287c tempest-VolumesNegativeTest-849504903 None] Volume 3ef567c1-f071-4201-b148-89df91cd8a50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ef567c1-f071-4201-b148-89df91cd8a50', 'volume_size': 1} Sep 17 22:03:04 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-58944dd8-b6d7-4955-9bac-84571d6b287c tempest-VolumesNegativeTest-849504903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:03:04 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-58944dd8-b6d7-4955-9bac-84571d6b287c tempest-VolumesNegativeTest-849504903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:03:04 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-58944dd8-b6d7-4955-9bac-84571d6b287c tempest-VolumesNegativeTest-849504903 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:03:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1594582764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ef567c1-f071-4201-b148-89df91cd8a50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce98945e6cd844528f4b44b8a94aa68b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:03:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:03:04Z,use_quota=True,user_id='5d3cca450ea64475908dc1d27711bf55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 22:03:04 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-58944dd8-b6d7-4955-9bac-84571d6b287c tempest-VolumesNegativeTest-849504903 None] Creating volume 3ef567c1-f071-4201-b148-89df91cd8a50 {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 22:03:04 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-58944dd8-b6d7-4955-9bac-84571d6b287c tempest-VolumesNegativeTest-849504903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:03:04 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-58944dd8-b6d7-4955-9bac-84571d6b287c tempest-VolumesNegativeTest-849504903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:03:04 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-58944dd8-b6d7-4955-9bac-84571d6b287c tempest-VolumesNegativeTest-849504903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:03:04 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-58944dd8-b6d7-4955-9bac-84571d6b287c tempest-VolumesNegativeTest-849504903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:03:04 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-58944dd8-b6d7-4955-9bac-84571d6b287c tempest-VolumesNegativeTest-849504903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:03:04 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-58944dd8-b6d7-4955-9bac-84571d6b287c tempest-VolumesNegativeTest-849504903 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 22:03:04 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-58944dd8-b6d7-4955-9bac-84571d6b287c tempest-VolumesNegativeTest-849504903 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 22:03:04 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-58944dd8-b6d7-4955-9bac-84571d6b287c tempest-VolumesNegativeTest-849504903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-3ef567c1-f071-4201-b148-89df91cd8a50 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:03:04 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-fd718ce6-e44f-4de6-8bfc-322be8d74077 tempest-VolumesDeleteCascade-2087052776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ff781d46-cd9f-4ea9-94cd-719be3ba3e01.e76e8d18-ed5d-4c91-8c04-33ae7b0451d9" returned: 0 in 0.809s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:03:04 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-fd718ce6-e44f-4de6-8bfc-322be8d74077 tempest-VolumesDeleteCascade-2087052776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ff781d46-cd9f-4ea9-94cd-719be3ba3e01.e76e8d18-ed5d-4c91-8c04-33ae7b0451d9 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:03:04 devstack sudo[98618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-3ef567c1-f071-4201-b148-89df91cd8a50 1073741824 Sep 17 22:03:04 devstack sudo[98618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:03:04 devstack sudo[98619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ff781d46-cd9f-4ea9-94cd-719be3ba3e01.e76e8d18-ed5d-4c91-8c04-33ae7b0451d9 Sep 17 22:03:04 devstack sudo[98619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:03:04 devstack sudo[98619]: pam_unix(sudo:session): session closed for user root Sep 17 22:03:04 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-fd718ce6-e44f-4de6-8bfc-322be8d74077 tempest-VolumesDeleteCascade-2087052776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ff781d46-cd9f-4ea9-94cd-719be3ba3e01.e76e8d18-ed5d-4c91-8c04-33ae7b0451d9" returned: 0 in 0.333s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:03:04 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-fd718ce6-e44f-4de6-8bfc-322be8d74077 tempest-VolumesDeleteCascade-2087052776 None] Lock "cinder-quobyte-e76e8d18-ed5d-4c91-8c04-33ae7b0451d9" released by "_delete_snapshot" :: held 2.738s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:03:04 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-fd718ce6-e44f-4de6-8bfc-322be8d74077 tempest-VolumesDeleteCascade-2087052776 None] Lock "cinder-quobyte-ff781d46-cd9f-4ea9-94cd-719be3ba3e01" released by "delete_snapshot" :: held 2.776s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:03:04 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-fd718ce6-e44f-4de6-8bfc-322be8d74077 tempest-VolumesDeleteCascade-2087052776 None] Created reservations ['6b4870b2-e438-4314-86b5-62244bdd10d5', 'e5dd5c85-4265-4eae-80e6-ccb6e371d02e', '7b73720d-049c-4869-a3c1-0305108d8244', '0181cd88-7c84-4083-a0d2-ba95de3a5675'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:03:05 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-fd718ce6-e44f-4de6-8bfc-322be8d74077 tempest-VolumesDeleteCascade-2087052776 None] Delete snapshot completed successfully. Sep 17 22:03:05 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-fd718ce6-e44f-4de6-8bfc-322be8d74077 tempest-VolumesDeleteCascade-2087052776 None] Lock "cinder-e76e8d18-ed5d-4c91-8c04-33ae7b0451d9-delete_snapshot" released by "delete_snapshot" :: held 3.021s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:03:05 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-fd718ce6-e44f-4de6-8bfc-322be8d74077 tempest-VolumesDeleteCascade-2087052776 None] Snapshots deleted, issuing volume delete {{(pid=85458) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 17 22:03:05 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-fd718ce6-e44f-4de6-8bfc-322be8d74077 tempest-VolumesDeleteCascade-2087052776 None] Acquiring lock "cinder-quobyte-ff781d46-cd9f-4ea9-94cd-719be3ba3e01" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:03:05 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-fd718ce6-e44f-4de6-8bfc-322be8d74077 tempest-VolumesDeleteCascade-2087052776 None] Lock "cinder-quobyte-ff781d46-cd9f-4ea9-94cd-719be3ba3e01" acquired by "delete_volume" :: waited 0.020s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:03:05 devstack sudo[98618]: pam_unix(sudo:session): session closed for user root Sep 17 22:03:05 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-58944dd8-b6d7-4955-9bac-84571d6b287c tempest-VolumesNegativeTest-849504903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-3ef567c1-f071-4201-b148-89df91cd8a50 1073741824" returned: 0 in 0.672s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:03:05 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaae6925-90a3-45ee-889c-51132fa1a079]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:03:05 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-fd718ce6-e44f-4de6-8bfc-322be8d74077 tempest-VolumesDeleteCascade-2087052776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ff781d46-cd9f-4ea9-94cd-719be3ba3e01 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:03:05 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-58944dd8-b6d7-4955-9bac-84571d6b287c tempest-VolumesNegativeTest-849504903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-3ef567c1-f071-4201-b148-89df91cd8a50 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:03:05 devstack sudo[98628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-3ef567c1-f071-4201-b148-89df91cd8a50 Sep 17 22:03:05 devstack sudo[98628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:03:05 devstack sudo[98627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ff781d46-cd9f-4ea9-94cd-719be3ba3e01 Sep 17 22:03:05 devstack sudo[98627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:03:05 devstack sudo[98628]: pam_unix(sudo:session): session closed for user root Sep 17 22:03:05 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-58944dd8-b6d7-4955-9bac-84571d6b287c tempest-VolumesNegativeTest-849504903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-3ef567c1-f071-4201-b148-89df91cd8a50" returned: 0 in 0.292s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:03:05 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-58944dd8-b6d7-4955-9bac-84571d6b287c tempest-VolumesNegativeTest-849504903 None] <== create_volume: return (1044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 22:03:05 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-58944dd8-b6d7-4955-9bac-84571d6b287c tempest-VolumesNegativeTest-849504903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.048s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:03:05 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-58944dd8-b6d7-4955-9bac-84571d6b287c tempest-VolumesNegativeTest-849504903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c33281c-85b8-4d3c-803e-ec77412d7679) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ef567c1-f071-4201-b148-89df91cd8a50', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:03:05 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-58944dd8-b6d7-4955-9bac-84571d6b287c tempest-VolumesNegativeTest-849504903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bcca36e-e8ca-4aed-83a7-efcfd9b8364e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:03:05 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-58944dd8-b6d7-4955-9bac-84571d6b287c tempest-VolumesNegativeTest-849504903 None] Volume volume-3ef567c1-f071-4201-b148-89df91cd8a50 (3ef567c1-f071-4201-b148-89df91cd8a50): created successfully Sep 17 22:03:05 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-58944dd8-b6d7-4955-9bac-84571d6b287c tempest-VolumesNegativeTest-849504903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bcca36e-e8ca-4aed-83a7-efcfd9b8364e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:03:05 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-58944dd8-b6d7-4955-9bac-84571d6b287c tempest-VolumesNegativeTest-849504903 None] Flow 'volume_create_manager' (f891dd0f-f0a4-454a-92bb-8212ba8edfa1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:03:05 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-58944dd8-b6d7-4955-9bac-84571d6b287c tempest-VolumesNegativeTest-849504903 None] Created volume successfully. Sep 17 22:03:05 devstack sudo[98627]: pam_unix(sudo:session): session closed for user root Sep 17 22:03:05 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-fd718ce6-e44f-4de6-8bfc-322be8d74077 tempest-VolumesDeleteCascade-2087052776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ff781d46-cd9f-4ea9-94cd-719be3ba3e01" returned: 0 in 0.455s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:03:05 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-fd718ce6-e44f-4de6-8bfc-322be8d74077 tempest-VolumesDeleteCascade-2087052776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ff781d46-cd9f-4ea9-94cd-719be3ba3e01 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:03:05 devstack sudo[98635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ff781d46-cd9f-4ea9-94cd-719be3ba3e01 Sep 17 22:03:05 devstack sudo[98635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:03:05 devstack sudo[98635]: pam_unix(sudo:session): session closed for user root Sep 17 22:03:05 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-fd718ce6-e44f-4de6-8bfc-322be8d74077 tempest-VolumesDeleteCascade-2087052776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ff781d46-cd9f-4ea9-94cd-719be3ba3e01" returned: 0 in 0.266s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:03:05 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-fd718ce6-e44f-4de6-8bfc-322be8d74077 tempest-VolumesDeleteCascade-2087052776 None] Lock "cinder-quobyte-ff781d46-cd9f-4ea9-94cd-719be3ba3e01" released by "delete_volume" :: held 0.807s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:03:05 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-fd718ce6-e44f-4de6-8bfc-322be8d74077 tempest-VolumesDeleteCascade-2087052776 None] Created reservations ['034d9ae9-0c85-4349-8b92-a3514ecce492', '1286c2e0-1f4a-4d4f-9b5e-4afb1c7d200d', 'a5cd1e3b-21c3-4ddc-a497-dfda12e13e33', '13c7a248-5650-4166-978f-fc4d5ae356e2'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:03:06 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-fd718ce6-e44f-4de6-8bfc-322be8d74077 tempest-VolumesDeleteCascade-2087052776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:03:06 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-fd718ce6-e44f-4de6-8bfc-322be8d74077 tempest-VolumesDeleteCascade-2087052776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:03:06 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-fd718ce6-e44f-4de6-8bfc-322be8d74077 tempest-VolumesDeleteCascade-2087052776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:03:06 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-fd718ce6-e44f-4de6-8bfc-322be8d74077 tempest-VolumesDeleteCascade-2087052776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:03:06 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-fd718ce6-e44f-4de6-8bfc-322be8d74077 tempest-VolumesDeleteCascade-2087052776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:03:06 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-fd718ce6-e44f-4de6-8bfc-322be8d74077 tempest-VolumesDeleteCascade-2087052776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:03:06 devstack sudo[98638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:03:06 devstack sudo[98638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:03:06 devstack sudo[98638]: pam_unix(sudo:session): session closed for user root Sep 17 22:03:06 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-fd718ce6-e44f-4de6-8bfc-322be8d74077 tempest-VolumesDeleteCascade-2087052776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.316s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:03:06 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-fd718ce6-e44f-4de6-8bfc-322be8d74077 tempest-VolumesDeleteCascade-2087052776 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:03:06 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-fd718ce6-e44f-4de6-8bfc-322be8d74077 tempest-VolumesDeleteCascade-2087052776 None] Deleted volume successfully. Sep 17 22:03:06 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-fd718ce6-e44f-4de6-8bfc-322be8d74077 tempest-VolumesDeleteCascade-2087052776 None] Lock "cinder-ff781d46-cd9f-4ea9-94cd-719be3ba3e01-delete_volume" released by "delete_volume" :: held 4.487s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:03:06 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-a12f558b-418d-41cd-9233-f5eda04cb8ea tempest-VolumesDeleteCascade-2087052776 None] Acquiring lock "cinder-ab77bdc5-369e-4e5a-bd95-9a91bf44577b-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:03:06 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-a12f558b-418d-41cd-9233-f5eda04cb8ea tempest-VolumesDeleteCascade-2087052776 None] Lock "cinder-ab77bdc5-369e-4e5a-bd95-9a91bf44577b-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:03:06 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-a12f558b-418d-41cd-9233-f5eda04cb8ea tempest-VolumesDeleteCascade-2087052776 None] Acquiring lock "cinder-quobyte-ab77bdc5-369e-4e5a-bd95-9a91bf44577b" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:03:06 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-a12f558b-418d-41cd-9233-f5eda04cb8ea tempest-VolumesDeleteCascade-2087052776 None] Lock "cinder-quobyte-ab77bdc5-369e-4e5a-bd95-9a91bf44577b" acquired by "delete_volume" :: waited 0.022s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:03:06 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[47f2ae89-c94f-426c-b39c-fbc188e43e4e]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:03:06 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a12f558b-418d-41cd-9233-f5eda04cb8ea tempest-VolumesDeleteCascade-2087052776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ab77bdc5-369e-4e5a-bd95-9a91bf44577b {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:03:07 devstack sudo[98641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ab77bdc5-369e-4e5a-bd95-9a91bf44577b Sep 17 22:03:07 devstack sudo[98641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:03:07 devstack sudo[98641]: pam_unix(sudo:session): session closed for user root Sep 17 22:03:07 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a12f558b-418d-41cd-9233-f5eda04cb8ea tempest-VolumesDeleteCascade-2087052776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ab77bdc5-369e-4e5a-bd95-9a91bf44577b" returned: 0 in 0.448s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:03:07 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a12f558b-418d-41cd-9233-f5eda04cb8ea tempest-VolumesDeleteCascade-2087052776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ab77bdc5-369e-4e5a-bd95-9a91bf44577b {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:03:07 devstack sudo[98650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ab77bdc5-369e-4e5a-bd95-9a91bf44577b Sep 17 22:03:07 devstack sudo[98650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:03:07 devstack sudo[98650]: pam_unix(sudo:session): session closed for user root Sep 17 22:03:07 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a12f558b-418d-41cd-9233-f5eda04cb8ea tempest-VolumesDeleteCascade-2087052776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ab77bdc5-369e-4e5a-bd95-9a91bf44577b" returned: 0 in 0.287s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:03:07 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-a12f558b-418d-41cd-9233-f5eda04cb8ea tempest-VolumesDeleteCascade-2087052776 None] Lock "cinder-quobyte-ab77bdc5-369e-4e5a-bd95-9a91bf44577b" released by "delete_volume" :: held 0.804s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:03:07 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-a12f558b-418d-41cd-9233-f5eda04cb8ea tempest-VolumesDeleteCascade-2087052776 None] Created reservations ['582e2da4-88ba-4270-aad5-5732767d348b', '83537e22-cb9b-49f9-9b9f-50707912aad3', 'bff9c261-b856-4be4-87be-7224a468a3b7', '07ef1b79-bb86-4faa-8950-bc0317d28efd'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:03:07 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-a12f558b-418d-41cd-9233-f5eda04cb8ea tempest-VolumesDeleteCascade-2087052776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:03:07 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-a12f558b-418d-41cd-9233-f5eda04cb8ea tempest-VolumesDeleteCascade-2087052776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:03:07 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-a12f558b-418d-41cd-9233-f5eda04cb8ea tempest-VolumesDeleteCascade-2087052776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:03:07 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-a12f558b-418d-41cd-9233-f5eda04cb8ea tempest-VolumesDeleteCascade-2087052776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:03:07 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-a12f558b-418d-41cd-9233-f5eda04cb8ea tempest-VolumesDeleteCascade-2087052776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:03:07 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a12f558b-418d-41cd-9233-f5eda04cb8ea tempest-VolumesDeleteCascade-2087052776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:03:07 devstack sudo[98653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:03:07 devstack sudo[98653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:03:08 devstack sudo[98653]: pam_unix(sudo:session): session closed for user root Sep 17 22:03:08 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a12f558b-418d-41cd-9233-f5eda04cb8ea tempest-VolumesDeleteCascade-2087052776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.493s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:03:08 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-a12f558b-418d-41cd-9233-f5eda04cb8ea tempest-VolumesDeleteCascade-2087052776 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:03:08 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-a12f558b-418d-41cd-9233-f5eda04cb8ea tempest-VolumesDeleteCascade-2087052776 None] Deleted volume successfully. Sep 17 22:03:08 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-a12f558b-418d-41cd-9233-f5eda04cb8ea tempest-VolumesDeleteCascade-2087052776 None] Lock "cinder-ab77bdc5-369e-4e5a-bd95-9a91bf44577b-delete_volume" released by "delete_volume" :: held 1.615s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:03:17 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7b72b26-39c8-4caf-b964-259483afcb1b tempest-VolumesTransfersTest-1224866535 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 22:03:17 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-c7b72b26-39c8-4caf-b964-259483afcb1b tempest-VolumesTransfersTest-1224866535 None] Flow 'volume_create_manager' (9f6f82ce-ccf0-44c3-891f-329cc9c7615b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:03:17 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-c7b72b26-39c8-4caf-b964-259483afcb1b tempest-VolumesTransfersTest-1224866535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (541038e3-b613-4933-9408-bbcdb7b17611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:03:17 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-c7b72b26-39c8-4caf-b964-259483afcb1b tempest-VolumesTransfersTest-1224866535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (541038e3-b613-4933-9408-bbcdb7b17611) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:03:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1658725232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff6df0b3-50e3-4e82-80f8-88bae2af6797,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00ce9dc563df489a80ebbb70919ba1f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:03:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:03:18Z,use_quota=True,user_id='f7c1db66a91e4af1900745755ef33a15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:03:17 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-c7b72b26-39c8-4caf-b964-259483afcb1b tempest-VolumesTransfersTest-1224866535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (814a3074-b103-4bcb-80ac-be77740e8376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:03:17 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-c7b72b26-39c8-4caf-b964-259483afcb1b tempest-VolumesTransfersTest-1224866535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (814a3074-b103-4bcb-80ac-be77740e8376) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:03:17 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-c7b72b26-39c8-4caf-b964-259483afcb1b tempest-VolumesTransfersTest-1224866535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b90cd6e7-ebfb-44a9-89dd-dd8b2a8031cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:03:17 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-c7b72b26-39c8-4caf-b964-259483afcb1b tempest-VolumesTransfersTest-1224866535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b90cd6e7-ebfb-44a9-89dd-dd8b2a8031cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff6df0b3-50e3-4e82-80f8-88bae2af6797', 'volume_name': 'volume-ff6df0b3-50e3-4e82-80f8-88bae2af6797', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:03:17 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-c7b72b26-39c8-4caf-b964-259483afcb1b tempest-VolumesTransfersTest-1224866535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52853e5d-86ab-4285-9d3a-4f138f4f6cf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:03:17 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-c7b72b26-39c8-4caf-b964-259483afcb1b tempest-VolumesTransfersTest-1224866535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52853e5d-86ab-4285-9d3a-4f138f4f6cf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:03:17 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-c7b72b26-39c8-4caf-b964-259483afcb1b tempest-VolumesTransfersTest-1224866535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfbb16b3-4159-454e-ba2a-12ad36f5d94c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:03:17 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-c7b72b26-39c8-4caf-b964-259483afcb1b tempest-VolumesTransfersTest-1224866535 None] Volume ff6df0b3-50e3-4e82-80f8-88bae2af6797: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff6df0b3-50e3-4e82-80f8-88bae2af6797', 'volume_size': 1} Sep 17 22:03:17 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-c7b72b26-39c8-4caf-b964-259483afcb1b tempest-VolumesTransfersTest-1224866535 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:03:17 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-c7b72b26-39c8-4caf-b964-259483afcb1b tempest-VolumesTransfersTest-1224866535 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:03:17 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-c7b72b26-39c8-4caf-b964-259483afcb1b tempest-VolumesTransfersTest-1224866535 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:03:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1658725232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff6df0b3-50e3-4e82-80f8-88bae2af6797,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00ce9dc563df489a80ebbb70919ba1f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:03:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:03:18Z,use_quota=True,user_id='f7c1db66a91e4af1900745755ef33a15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 22:03:17 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-c7b72b26-39c8-4caf-b964-259483afcb1b tempest-VolumesTransfersTest-1224866535 None] Creating volume ff6df0b3-50e3-4e82-80f8-88bae2af6797 {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 22:03:17 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-c7b72b26-39c8-4caf-b964-259483afcb1b tempest-VolumesTransfersTest-1224866535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:03:17 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-c7b72b26-39c8-4caf-b964-259483afcb1b tempest-VolumesTransfersTest-1224866535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:03:17 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-c7b72b26-39c8-4caf-b964-259483afcb1b tempest-VolumesTransfersTest-1224866535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:03:17 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-c7b72b26-39c8-4caf-b964-259483afcb1b tempest-VolumesTransfersTest-1224866535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:03:17 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-c7b72b26-39c8-4caf-b964-259483afcb1b tempest-VolumesTransfersTest-1224866535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:03:17 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-c7b72b26-39c8-4caf-b964-259483afcb1b tempest-VolumesTransfersTest-1224866535 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 22:03:17 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-c7b72b26-39c8-4caf-b964-259483afcb1b tempest-VolumesTransfersTest-1224866535 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 22:03:17 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-c7b72b26-39c8-4caf-b964-259483afcb1b tempest-VolumesTransfersTest-1224866535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ff6df0b3-50e3-4e82-80f8-88bae2af6797 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:03:17 devstack sudo[98767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ff6df0b3-50e3-4e82-80f8-88bae2af6797 1073741824 Sep 17 22:03:17 devstack sudo[98767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:03:18 devstack sudo[98767]: pam_unix(sudo:session): session closed for user root Sep 17 22:03:18 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-c7b72b26-39c8-4caf-b964-259483afcb1b tempest-VolumesTransfersTest-1224866535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ff6df0b3-50e3-4e82-80f8-88bae2af6797 1073741824" returned: 0 in 0.822s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:03:18 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-c7b72b26-39c8-4caf-b964-259483afcb1b tempest-VolumesTransfersTest-1224866535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ff6df0b3-50e3-4e82-80f8-88bae2af6797 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:03:18 devstack sudo[98777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ff6df0b3-50e3-4e82-80f8-88bae2af6797 Sep 17 22:03:18 devstack sudo[98777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:03:19 devstack sudo[98777]: pam_unix(sudo:session): session closed for user root Sep 17 22:03:19 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-c7b72b26-39c8-4caf-b964-259483afcb1b tempest-VolumesTransfersTest-1224866535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ff6df0b3-50e3-4e82-80f8-88bae2af6797" returned: 0 in 0.425s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:03:19 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-c7b72b26-39c8-4caf-b964-259483afcb1b tempest-VolumesTransfersTest-1224866535 None] <== create_volume: return (1312ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 22:03:19 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-c7b72b26-39c8-4caf-b964-259483afcb1b tempest-VolumesTransfersTest-1224866535 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.317s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:03:19 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-c7b72b26-39c8-4caf-b964-259483afcb1b tempest-VolumesTransfersTest-1224866535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfbb16b3-4159-454e-ba2a-12ad36f5d94c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff6df0b3-50e3-4e82-80f8-88bae2af6797', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:03:19 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-c7b72b26-39c8-4caf-b964-259483afcb1b tempest-VolumesTransfersTest-1224866535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66dcef51-9800-4b0f-bdc3-7be7a8c12307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:03:19 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-c7b72b26-39c8-4caf-b964-259483afcb1b tempest-VolumesTransfersTest-1224866535 None] Volume volume-ff6df0b3-50e3-4e82-80f8-88bae2af6797 (ff6df0b3-50e3-4e82-80f8-88bae2af6797): created successfully Sep 17 22:03:19 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-c7b72b26-39c8-4caf-b964-259483afcb1b tempest-VolumesTransfersTest-1224866535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66dcef51-9800-4b0f-bdc3-7be7a8c12307) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:03:19 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-c7b72b26-39c8-4caf-b964-259483afcb1b tempest-VolumesTransfersTest-1224866535 None] Flow 'volume_create_manager' (9f6f82ce-ccf0-44c3-891f-329cc9c7615b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:03:19 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-c7b72b26-39c8-4caf-b964-259483afcb1b tempest-VolumesTransfersTest-1224866535 None] Created volume successfully. Sep 17 22:03:19 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [req-df00f99e-4013-47c0-b07e-66956ee36d27 req-dece5a2a-970c-4a4a-8ddb-2c8b10281730 tempest-TestServerVolumeAttachmentScenario-586490087 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:03:19 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [req-df00f99e-4013-47c0-b07e-66956ee36d27 req-dece5a2a-970c-4a4a-8ddb-2c8b10281730 tempest-TestServerVolumeAttachmentScenario-586490087 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:03:19 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [req-df00f99e-4013-47c0-b07e-66956ee36d27 req-dece5a2a-970c-4a4a-8ddb-2c8b10281730 tempest-TestServerVolumeAttachmentScenario-586490087 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:03:19 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [req-df00f99e-4013-47c0-b07e-66956ee36d27 req-dece5a2a-970c-4a4a-8ddb-2c8b10281730 tempest-TestServerVolumeAttachmentScenario-586490087 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5', 'name': 'volume-d8376aea-d193-41b2-aa63-2f3d2218a42d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd47af58b-3a43-442d-93a4-ea9fe0481473', 'enforce_multipath': True} {{(pid=85458) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 22:03:19 devstack cinder-volume[85458]: INFO cinder.volume.manager [req-df00f99e-4013-47c0-b07e-66956ee36d27 req-dece5a2a-970c-4a4a-8ddb-2c8b10281730 tempest-TestServerVolumeAttachmentScenario-586490087 None] attachment_update completed successfully. Sep 17 22:03:21 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-051e4db6-a84a-4a30-bbdc-99cf5583e408 tempest-VolumesTransfersTest-2015593692 None] Transfer volume completed successfully. Sep 17 22:03:22 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-8c1d488d-bc22-4927-b6c2-d0e078bb9e12 tempest-VolumesTransfersTest-1017073277 None] Acquiring lock "cinder-ff6df0b3-50e3-4e82-80f8-88bae2af6797-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:03:22 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-8c1d488d-bc22-4927-b6c2-d0e078bb9e12 tempest-VolumesTransfersTest-1017073277 None] Lock "cinder-ff6df0b3-50e3-4e82-80f8-88bae2af6797-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:03:22 devstack cinder-volume[85458]: DEBUG dbcounter [-] [85458] Writing DB stats cinder:SELECT=99,cinder:INSERT=31,cinder:UPDATE=123,cinder:DELETE=9 {{(pid=85458) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 22:03:22 devstack cinder-volume[85458]: DEBUG dbcounter [-] [85458] Writing DB stats cinder:SELECT=111,cinder:INSERT=33,cinder:UPDATE=137,cinder:DELETE=13 {{(pid=85458) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 22:03:22 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-8c1d488d-bc22-4927-b6c2-d0e078bb9e12 tempest-VolumesTransfersTest-1017073277 None] Acquiring lock "cinder-quobyte-ff6df0b3-50e3-4e82-80f8-88bae2af6797" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:03:22 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-8c1d488d-bc22-4927-b6c2-d0e078bb9e12 tempest-VolumesTransfersTest-1017073277 None] Lock "cinder-quobyte-ff6df0b3-50e3-4e82-80f8-88bae2af6797" acquired by "delete_volume" :: waited 0.015s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:03:22 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[511f3e18-7ba9-4c63-b84b-234e87ecb78b]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:03:22 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-8c1d488d-bc22-4927-b6c2-d0e078bb9e12 tempest-VolumesTransfersTest-1017073277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ff6df0b3-50e3-4e82-80f8-88bae2af6797 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:03:22 devstack sudo[99261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ff6df0b3-50e3-4e82-80f8-88bae2af6797 Sep 17 22:03:22 devstack sudo[99261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:03:23 devstack sudo[99261]: pam_unix(sudo:session): session closed for user root Sep 17 22:03:23 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-8c1d488d-bc22-4927-b6c2-d0e078bb9e12 tempest-VolumesTransfersTest-1017073277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ff6df0b3-50e3-4e82-80f8-88bae2af6797" returned: 0 in 0.614s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:03:23 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-8c1d488d-bc22-4927-b6c2-d0e078bb9e12 tempest-VolumesTransfersTest-1017073277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ff6df0b3-50e3-4e82-80f8-88bae2af6797 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:03:23 devstack sudo[99277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ff6df0b3-50e3-4e82-80f8-88bae2af6797 Sep 17 22:03:23 devstack sudo[99277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:03:23 devstack sudo[99277]: pam_unix(sudo:session): session closed for user root Sep 17 22:03:23 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-8c1d488d-bc22-4927-b6c2-d0e078bb9e12 tempest-VolumesTransfersTest-1017073277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-ff6df0b3-50e3-4e82-80f8-88bae2af6797" returned: 0 in 0.358s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:03:23 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-8c1d488d-bc22-4927-b6c2-d0e078bb9e12 tempest-VolumesTransfersTest-1017073277 None] Lock "cinder-quobyte-ff6df0b3-50e3-4e82-80f8-88bae2af6797" released by "delete_volume" :: held 1.048s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:03:23 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-8c1d488d-bc22-4927-b6c2-d0e078bb9e12 tempest-VolumesTransfersTest-1017073277 None] Created reservations ['7491630e-a035-4399-a1c9-852915233d6f', '8aa29f86-b728-4046-b07a-2d34c7c05d3d', '8db2b179-edce-4618-9053-ca913de089c8', '92d0893a-9ab8-46f0-8b17-c007354a3e7f'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:03:23 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-8c1d488d-bc22-4927-b6c2-d0e078bb9e12 tempest-VolumesTransfersTest-1017073277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:03:23 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-8c1d488d-bc22-4927-b6c2-d0e078bb9e12 tempest-VolumesTransfersTest-1017073277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:03:23 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-8c1d488d-bc22-4927-b6c2-d0e078bb9e12 tempest-VolumesTransfersTest-1017073277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:03:23 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-8c1d488d-bc22-4927-b6c2-d0e078bb9e12 tempest-VolumesTransfersTest-1017073277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:03:23 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-8c1d488d-bc22-4927-b6c2-d0e078bb9e12 tempest-VolumesTransfersTest-1017073277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:03:23 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-8c1d488d-bc22-4927-b6c2-d0e078bb9e12 tempest-VolumesTransfersTest-1017073277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:03:23 devstack sudo[99281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:03:23 devstack sudo[99281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:03:24 devstack sudo[99281]: pam_unix(sudo:session): session closed for user root Sep 17 22:03:24 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-8c1d488d-bc22-4927-b6c2-d0e078bb9e12 tempest-VolumesTransfersTest-1017073277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.355s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:03:24 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-8c1d488d-bc22-4927-b6c2-d0e078bb9e12 tempest-VolumesTransfersTest-1017073277 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:03:24 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-8c1d488d-bc22-4927-b6c2-d0e078bb9e12 tempest-VolumesTransfersTest-1017073277 None] Deleted volume successfully. Sep 17 22:03:24 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-8c1d488d-bc22-4927-b6c2-d0e078bb9e12 tempest-VolumesTransfersTest-1017073277 None] Lock "cinder-ff6df0b3-50e3-4e82-80f8-88bae2af6797-delete_volume" released by "delete_volume" :: held 1.814s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:03:24 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-105636a0-5629-4182-9bb7-34aa23d56cb0 tempest-VolumesTransfersTest-1224866535 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 22:03:24 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-105636a0-5629-4182-9bb7-34aa23d56cb0 tempest-VolumesTransfersTest-1224866535 None] Flow 'volume_create_manager' (154b316f-a15e-4cfc-9784-a8204c408568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:03:24 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-105636a0-5629-4182-9bb7-34aa23d56cb0 tempest-VolumesTransfersTest-1224866535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf5b1f2b-7a61-4c5b-9e01-818cbbd3b995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:03:25 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-105636a0-5629-4182-9bb7-34aa23d56cb0 tempest-VolumesTransfersTest-1224866535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf5b1f2b-7a61-4c5b-9e01-818cbbd3b995) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:03:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1709080977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4c7c020-140c-40d2-90ed-fc6dd11d2932,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00ce9dc563df489a80ebbb70919ba1f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:03:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:03:25Z,use_quota=True,user_id='f7c1db66a91e4af1900745755ef33a15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:03:25 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-105636a0-5629-4182-9bb7-34aa23d56cb0 tempest-VolumesTransfersTest-1224866535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48098a92-909f-4880-9a9a-39599d8e28a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:03:25 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-105636a0-5629-4182-9bb7-34aa23d56cb0 tempest-VolumesTransfersTest-1224866535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48098a92-909f-4880-9a9a-39599d8e28a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:03:25 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-105636a0-5629-4182-9bb7-34aa23d56cb0 tempest-VolumesTransfersTest-1224866535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff9d9ce7-3bd3-4e69-bc13-8f85a3293f8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:03:25 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-105636a0-5629-4182-9bb7-34aa23d56cb0 tempest-VolumesTransfersTest-1224866535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff9d9ce7-3bd3-4e69-bc13-8f85a3293f8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4c7c020-140c-40d2-90ed-fc6dd11d2932', 'volume_name': 'volume-d4c7c020-140c-40d2-90ed-fc6dd11d2932', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:03:25 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-105636a0-5629-4182-9bb7-34aa23d56cb0 tempest-VolumesTransfersTest-1224866535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3775b812-e225-498e-bfe4-95e2634e4c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:03:25 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-105636a0-5629-4182-9bb7-34aa23d56cb0 tempest-VolumesTransfersTest-1224866535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3775b812-e225-498e-bfe4-95e2634e4c79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:03:25 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-105636a0-5629-4182-9bb7-34aa23d56cb0 tempest-VolumesTransfersTest-1224866535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (842b84ed-da77-4a64-a017-772c9dd73263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:03:25 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-105636a0-5629-4182-9bb7-34aa23d56cb0 tempest-VolumesTransfersTest-1224866535 None] Volume d4c7c020-140c-40d2-90ed-fc6dd11d2932: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4c7c020-140c-40d2-90ed-fc6dd11d2932', 'volume_size': 1} Sep 17 22:03:25 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-105636a0-5629-4182-9bb7-34aa23d56cb0 tempest-VolumesTransfersTest-1224866535 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:03:25 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-105636a0-5629-4182-9bb7-34aa23d56cb0 tempest-VolumesTransfersTest-1224866535 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:03:25 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-105636a0-5629-4182-9bb7-34aa23d56cb0 tempest-VolumesTransfersTest-1224866535 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:03:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1709080977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4c7c020-140c-40d2-90ed-fc6dd11d2932,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00ce9dc563df489a80ebbb70919ba1f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:03:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:03:25Z,use_quota=True,user_id='f7c1db66a91e4af1900745755ef33a15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 22:03:25 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-105636a0-5629-4182-9bb7-34aa23d56cb0 tempest-VolumesTransfersTest-1224866535 None] Creating volume d4c7c020-140c-40d2-90ed-fc6dd11d2932 {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 22:03:25 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-105636a0-5629-4182-9bb7-34aa23d56cb0 tempest-VolumesTransfersTest-1224866535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:03:25 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-105636a0-5629-4182-9bb7-34aa23d56cb0 tempest-VolumesTransfersTest-1224866535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:03:25 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-105636a0-5629-4182-9bb7-34aa23d56cb0 tempest-VolumesTransfersTest-1224866535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:03:25 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-105636a0-5629-4182-9bb7-34aa23d56cb0 tempest-VolumesTransfersTest-1224866535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:03:25 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-105636a0-5629-4182-9bb7-34aa23d56cb0 tempest-VolumesTransfersTest-1224866535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:03:25 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-105636a0-5629-4182-9bb7-34aa23d56cb0 tempest-VolumesTransfersTest-1224866535 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 22:03:25 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-105636a0-5629-4182-9bb7-34aa23d56cb0 tempest-VolumesTransfersTest-1224866535 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 22:03:25 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-105636a0-5629-4182-9bb7-34aa23d56cb0 tempest-VolumesTransfersTest-1224866535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-d4c7c020-140c-40d2-90ed-fc6dd11d2932 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:03:25 devstack sudo[99338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-d4c7c020-140c-40d2-90ed-fc6dd11d2932 1073741824 Sep 17 22:03:25 devstack sudo[99338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:03:26 devstack sudo[99338]: pam_unix(sudo:session): session closed for user root Sep 17 22:03:26 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-105636a0-5629-4182-9bb7-34aa23d56cb0 tempest-VolumesTransfersTest-1224866535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-d4c7c020-140c-40d2-90ed-fc6dd11d2932 1073741824" returned: 0 in 0.900s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:03:26 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-105636a0-5629-4182-9bb7-34aa23d56cb0 tempest-VolumesTransfersTest-1224866535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-d4c7c020-140c-40d2-90ed-fc6dd11d2932 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:03:26 devstack sudo[99363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-d4c7c020-140c-40d2-90ed-fc6dd11d2932 Sep 17 22:03:26 devstack sudo[99363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:03:26 devstack sudo[99363]: pam_unix(sudo:session): session closed for user root Sep 17 22:03:26 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-105636a0-5629-4182-9bb7-34aa23d56cb0 tempest-VolumesTransfersTest-1224866535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-d4c7c020-140c-40d2-90ed-fc6dd11d2932" returned: 0 in 0.677s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:03:26 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-105636a0-5629-4182-9bb7-34aa23d56cb0 tempest-VolumesTransfersTest-1224866535 None] <== create_volume: return (1676ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 22:03:26 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-105636a0-5629-4182-9bb7-34aa23d56cb0 tempest-VolumesTransfersTest-1224866535 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.680s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:03:26 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-105636a0-5629-4182-9bb7-34aa23d56cb0 tempest-VolumesTransfersTest-1224866535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (842b84ed-da77-4a64-a017-772c9dd73263) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4c7c020-140c-40d2-90ed-fc6dd11d2932', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:03:26 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-105636a0-5629-4182-9bb7-34aa23d56cb0 tempest-VolumesTransfersTest-1224866535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96179a9b-8462-49e4-a5ff-166e05e003e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:03:26 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [req-b2e4f462-1f9c-4caf-959a-cd5499d68b18 req-a50c7d4f-87ca-49d5-82a4-abfc97040103 tempest-TestServerVolumeAttachmentScenario-586490087 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:03:26 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [req-b2e4f462-1f9c-4caf-959a-cd5499d68b18 req-a50c7d4f-87ca-49d5-82a4-abfc97040103 tempest-TestServerVolumeAttachmentScenario-586490087 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:03:26 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-105636a0-5629-4182-9bb7-34aa23d56cb0 tempest-VolumesTransfersTest-1224866535 None] Volume volume-d4c7c020-140c-40d2-90ed-fc6dd11d2932 (d4c7c020-140c-40d2-90ed-fc6dd11d2932): created successfully Sep 17 22:03:26 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-105636a0-5629-4182-9bb7-34aa23d56cb0 tempest-VolumesTransfersTest-1224866535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96179a9b-8462-49e4-a5ff-166e05e003e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:03:26 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-105636a0-5629-4182-9bb7-34aa23d56cb0 tempest-VolumesTransfersTest-1224866535 None] Flow 'volume_create_manager' (154b316f-a15e-4cfc-9784-a8204c408568) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:03:26 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [req-b2e4f462-1f9c-4caf-959a-cd5499d68b18 req-a50c7d4f-87ca-49d5-82a4-abfc97040103 tempest-TestServerVolumeAttachmentScenario-586490087 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.043s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:03:27 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-105636a0-5629-4182-9bb7-34aa23d56cb0 tempest-VolumesTransfersTest-1224866535 None] Created volume successfully. Sep 17 22:03:27 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [req-b2e4f462-1f9c-4caf-959a-cd5499d68b18 req-a50c7d4f-87ca-49d5-82a4-abfc97040103 tempest-TestServerVolumeAttachmentScenario-586490087 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5', 'name': 'volume-eff03be2-a889-4085-9fed-4fb591d03907', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8dc27e37-b404-441f-a51d-bbf98a85e05b', 'enforce_multipath': True} {{(pid=85458) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 22:03:27 devstack cinder-volume[85458]: INFO cinder.volume.manager [req-b2e4f462-1f9c-4caf-959a-cd5499d68b18 req-a50c7d4f-87ca-49d5-82a4-abfc97040103 tempest-TestServerVolumeAttachmentScenario-586490087 None] attachment_update completed successfully. Sep 17 22:03:27 devstack cinder-volume[85458]: DEBUG oslo_service.periodic_task [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85458) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 22:03:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:03:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:03:27 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:03:27 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:03:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:03:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:03:27 devstack sudo[99379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:03:27 devstack sudo[99379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:03:28 devstack sudo[99379]: pam_unix(sudo:session): session closed for user root Sep 17 22:03:28 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.499s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:03:28 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:03:28 devstack cinder-volume[85458]: DEBUG oslo_service.periodic_task [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Running periodic task VolumeManager._thread_info {{(pid=85458) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 22:03:28 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] thread count: 28 {{(pid=85458) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 22:03:28 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] thread info: [<_MainThread(MainThread, started 127546830999680)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85458) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 22:03:28 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-c517ec59-3ae0-4fcb-9fdd-78997ea32abe tempest-VolumesTransfersTest-1017073277 None] Acquiring lock "cinder-d4c7c020-140c-40d2-90ed-fc6dd11d2932-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:03:28 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-c517ec59-3ae0-4fcb-9fdd-78997ea32abe tempest-VolumesTransfersTest-1017073277 None] Lock "cinder-d4c7c020-140c-40d2-90ed-fc6dd11d2932-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:03:28 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-c517ec59-3ae0-4fcb-9fdd-78997ea32abe tempest-VolumesTransfersTest-1017073277 None] Acquiring lock "cinder-quobyte-d4c7c020-140c-40d2-90ed-fc6dd11d2932" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:03:28 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-c517ec59-3ae0-4fcb-9fdd-78997ea32abe tempest-VolumesTransfersTest-1017073277 None] Lock "cinder-quobyte-d4c7c020-140c-40d2-90ed-fc6dd11d2932" acquired by "delete_volume" :: waited 0.019s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:03:28 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[795241b2-f109-4289-b3e9-9c59a0ac3b91]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:03:28 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-c517ec59-3ae0-4fcb-9fdd-78997ea32abe tempest-VolumesTransfersTest-1017073277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-d4c7c020-140c-40d2-90ed-fc6dd11d2932 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:03:29 devstack sudo[99382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-d4c7c020-140c-40d2-90ed-fc6dd11d2932 Sep 17 22:03:29 devstack sudo[99382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:03:29 devstack sudo[99382]: pam_unix(sudo:session): session closed for user root Sep 17 22:03:29 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-c517ec59-3ae0-4fcb-9fdd-78997ea32abe tempest-VolumesTransfersTest-1017073277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-d4c7c020-140c-40d2-90ed-fc6dd11d2932" returned: 0 in 0.543s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:03:29 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-c517ec59-3ae0-4fcb-9fdd-78997ea32abe tempest-VolumesTransfersTest-1017073277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-d4c7c020-140c-40d2-90ed-fc6dd11d2932 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:03:29 devstack sudo[99388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-d4c7c020-140c-40d2-90ed-fc6dd11d2932 Sep 17 22:03:29 devstack sudo[99388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:03:29 devstack sudo[99388]: pam_unix(sudo:session): session closed for user root Sep 17 22:03:29 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-c517ec59-3ae0-4fcb-9fdd-78997ea32abe tempest-VolumesTransfersTest-1017073277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-d4c7c020-140c-40d2-90ed-fc6dd11d2932" returned: 0 in 0.375s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:03:29 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-c517ec59-3ae0-4fcb-9fdd-78997ea32abe tempest-VolumesTransfersTest-1017073277 None] Lock "cinder-quobyte-d4c7c020-140c-40d2-90ed-fc6dd11d2932" released by "delete_volume" :: held 1.043s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:03:30 devstack cinder-volume[85458]: INFO cinder.volume.manager [req-0f04903d-c4e3-41b9-ac75-6009459bbfde req-0530258e-e842-4717-aca4-c868e01799cc tempest-TestServerVolumeAttachmentScenario-586490087 None] Terminate volume connection completed successfully. Sep 17 22:03:30 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [req-0f04903d-c4e3-41b9-ac75-6009459bbfde req-0530258e-e842-4717-aca4-c868e01799cc tempest-TestServerVolumeAttachmentScenario-586490087 None] Deleting attachment 8dc27e37-b404-441f-a51d-bbf98a85e05b. {{(pid=85458) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 22:03:30 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-c517ec59-3ae0-4fcb-9fdd-78997ea32abe tempest-VolumesTransfersTest-1017073277 None] Created reservations ['68a11542-69bc-4dbb-a518-efc343792841', '80aa9acd-08cb-45e1-b70f-b9aca7d31a6d', '2796c6a9-c52d-454d-8a84-23423486dfba', 'b2010117-cc36-4e7a-b933-207dde5419ac'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:03:30 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-c517ec59-3ae0-4fcb-9fdd-78997ea32abe tempest-VolumesTransfersTest-1017073277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:03:30 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-c517ec59-3ae0-4fcb-9fdd-78997ea32abe tempest-VolumesTransfersTest-1017073277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:03:30 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-c517ec59-3ae0-4fcb-9fdd-78997ea32abe tempest-VolumesTransfersTest-1017073277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:03:30 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-c517ec59-3ae0-4fcb-9fdd-78997ea32abe tempest-VolumesTransfersTest-1017073277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:03:30 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-c517ec59-3ae0-4fcb-9fdd-78997ea32abe tempest-VolumesTransfersTest-1017073277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:03:30 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-c517ec59-3ae0-4fcb-9fdd-78997ea32abe tempest-VolumesTransfersTest-1017073277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:03:30 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb1a8fb1-dcf1-4344-b9b3-20e071371836 tempest-TestMinimumBasicScenario-96395444 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 22:03:30 devstack sudo[99393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:03:30 devstack sudo[99393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:03:30 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-cb1a8fb1-dcf1-4344-b9b3-20e071371836 tempest-TestMinimumBasicScenario-96395444 None] Flow 'volume_create_manager' (fc62e88b-d2b4-4f08-b3a3-83fbc17192b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:03:30 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-cb1a8fb1-dcf1-4344-b9b3-20e071371836 tempest-TestMinimumBasicScenario-96395444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f7c3d55-e898-496d-aba9-65db3a0be977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:03:30 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-cb1a8fb1-dcf1-4344-b9b3-20e071371836 tempest-TestMinimumBasicScenario-96395444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f7c3d55-e898-496d-aba9-65db3a0be977) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:03:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1734060029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6153e5e-4f58-4344-b5ae-660bfc3686fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d750ac34f3d74a009830cb746cd39b5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:03:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:03:30Z,use_quota=True,user_id='ea1e80e817ce4ca48ab334f27a8029b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:03:30 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-cb1a8fb1-dcf1-4344-b9b3-20e071371836 tempest-TestMinimumBasicScenario-96395444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ea596d9-5e11-428d-a922-01a2c1bdb5bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:03:30 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-cb1a8fb1-dcf1-4344-b9b3-20e071371836 tempest-TestMinimumBasicScenario-96395444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ea596d9-5e11-428d-a922-01a2c1bdb5bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:03:30 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-cb1a8fb1-dcf1-4344-b9b3-20e071371836 tempest-TestMinimumBasicScenario-96395444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51435670-6ef6-4152-87ae-0a7ee02dec2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:03:30 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-cb1a8fb1-dcf1-4344-b9b3-20e071371836 tempest-TestMinimumBasicScenario-96395444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51435670-6ef6-4152-87ae-0a7ee02dec2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6153e5e-4f58-4344-b5ae-660bfc3686fa', 'volume_name': 'volume-d6153e5e-4f58-4344-b5ae-660bfc3686fa', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:03:30 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-cb1a8fb1-dcf1-4344-b9b3-20e071371836 tempest-TestMinimumBasicScenario-96395444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (922cc37c-9fae-443d-89d1-08a2aa62f97b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:03:30 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-cb1a8fb1-dcf1-4344-b9b3-20e071371836 tempest-TestMinimumBasicScenario-96395444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (922cc37c-9fae-443d-89d1-08a2aa62f97b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:03:30 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-cb1a8fb1-dcf1-4344-b9b3-20e071371836 tempest-TestMinimumBasicScenario-96395444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3644e51-9175-4b53-804b-eb0fdec19b40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:03:30 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-cb1a8fb1-dcf1-4344-b9b3-20e071371836 tempest-TestMinimumBasicScenario-96395444 None] Volume d6153e5e-4f58-4344-b5ae-660bfc3686fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6153e5e-4f58-4344-b5ae-660bfc3686fa', 'volume_size': 1} Sep 17 22:03:30 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-cb1a8fb1-dcf1-4344-b9b3-20e071371836 tempest-TestMinimumBasicScenario-96395444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:03:30 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-cb1a8fb1-dcf1-4344-b9b3-20e071371836 tempest-TestMinimumBasicScenario-96395444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:03:30 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-cb1a8fb1-dcf1-4344-b9b3-20e071371836 tempest-TestMinimumBasicScenario-96395444 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:03:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1734060029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6153e5e-4f58-4344-b5ae-660bfc3686fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d750ac34f3d74a009830cb746cd39b5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:03:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:03:30Z,use_quota=True,user_id='ea1e80e817ce4ca48ab334f27a8029b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 22:03:30 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-cb1a8fb1-dcf1-4344-b9b3-20e071371836 tempest-TestMinimumBasicScenario-96395444 None] Creating volume d6153e5e-4f58-4344-b5ae-660bfc3686fa {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 22:03:30 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-cb1a8fb1-dcf1-4344-b9b3-20e071371836 tempest-TestMinimumBasicScenario-96395444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:03:30 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-cb1a8fb1-dcf1-4344-b9b3-20e071371836 tempest-TestMinimumBasicScenario-96395444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:03:30 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-cb1a8fb1-dcf1-4344-b9b3-20e071371836 tempest-TestMinimumBasicScenario-96395444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:03:30 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-cb1a8fb1-dcf1-4344-b9b3-20e071371836 tempest-TestMinimumBasicScenario-96395444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:03:30 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-cb1a8fb1-dcf1-4344-b9b3-20e071371836 tempest-TestMinimumBasicScenario-96395444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:03:30 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-cb1a8fb1-dcf1-4344-b9b3-20e071371836 tempest-TestMinimumBasicScenario-96395444 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 22:03:30 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-cb1a8fb1-dcf1-4344-b9b3-20e071371836 tempest-TestMinimumBasicScenario-96395444 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 22:03:30 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-cb1a8fb1-dcf1-4344-b9b3-20e071371836 tempest-TestMinimumBasicScenario-96395444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-d6153e5e-4f58-4344-b5ae-660bfc3686fa 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:03:30 devstack sudo[99397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-d6153e5e-4f58-4344-b5ae-660bfc3686fa 1073741824 Sep 17 22:03:30 devstack sudo[99397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:03:30 devstack sudo[99393]: pam_unix(sudo:session): session closed for user root Sep 17 22:03:30 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-c517ec59-3ae0-4fcb-9fdd-78997ea32abe tempest-VolumesTransfersTest-1017073277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.569s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:03:30 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-c517ec59-3ae0-4fcb-9fdd-78997ea32abe tempest-VolumesTransfersTest-1017073277 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:03:30 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-c517ec59-3ae0-4fcb-9fdd-78997ea32abe tempest-VolumesTransfersTest-1017073277 None] Deleted volume successfully. Sep 17 22:03:30 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-c517ec59-3ae0-4fcb-9fdd-78997ea32abe tempest-VolumesTransfersTest-1017073277 None] Lock "cinder-d4c7c020-140c-40d2-90ed-fc6dd11d2932-delete_volume" released by "delete_volume" :: held 2.091s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:03:31 devstack sudo[99397]: pam_unix(sudo:session): session closed for user root Sep 17 22:03:31 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-cb1a8fb1-dcf1-4344-b9b3-20e071371836 tempest-TestMinimumBasicScenario-96395444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-d6153e5e-4f58-4344-b5ae-660bfc3686fa 1073741824" returned: 0 in 0.774s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:03:31 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-cb1a8fb1-dcf1-4344-b9b3-20e071371836 tempest-TestMinimumBasicScenario-96395444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-d6153e5e-4f58-4344-b5ae-660bfc3686fa {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:03:31 devstack sudo[99410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-d6153e5e-4f58-4344-b5ae-660bfc3686fa Sep 17 22:03:31 devstack sudo[99410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:03:31 devstack sudo[99410]: pam_unix(sudo:session): session closed for user root Sep 17 22:03:31 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-cb1a8fb1-dcf1-4344-b9b3-20e071371836 tempest-TestMinimumBasicScenario-96395444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-d6153e5e-4f58-4344-b5ae-660bfc3686fa" returned: 0 in 0.487s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:03:31 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-cb1a8fb1-dcf1-4344-b9b3-20e071371836 tempest-TestMinimumBasicScenario-96395444 None] <== create_volume: return (1356ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 22:03:31 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-cb1a8fb1-dcf1-4344-b9b3-20e071371836 tempest-TestMinimumBasicScenario-96395444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.360s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:03:31 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-cb1a8fb1-dcf1-4344-b9b3-20e071371836 tempest-TestMinimumBasicScenario-96395444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3644e51-9175-4b53-804b-eb0fdec19b40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6153e5e-4f58-4344-b5ae-660bfc3686fa', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:03:31 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-cb1a8fb1-dcf1-4344-b9b3-20e071371836 tempest-TestMinimumBasicScenario-96395444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (475a37b1-a9a7-4553-8a5e-c97aafc5df99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:03:31 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-cb1a8fb1-dcf1-4344-b9b3-20e071371836 tempest-TestMinimumBasicScenario-96395444 None] Volume volume-d6153e5e-4f58-4344-b5ae-660bfc3686fa (d6153e5e-4f58-4344-b5ae-660bfc3686fa): created successfully Sep 17 22:03:31 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-cb1a8fb1-dcf1-4344-b9b3-20e071371836 tempest-TestMinimumBasicScenario-96395444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (475a37b1-a9a7-4553-8a5e-c97aafc5df99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:03:31 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-cb1a8fb1-dcf1-4344-b9b3-20e071371836 tempest-TestMinimumBasicScenario-96395444 None] Flow 'volume_create_manager' (fc62e88b-d2b4-4f08-b3a3-83fbc17192b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:03:31 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-cb1a8fb1-dcf1-4344-b9b3-20e071371836 tempest-TestMinimumBasicScenario-96395444 None] Created volume successfully. Sep 17 22:03:32 devstack cinder-volume[85458]: INFO cinder.volume.manager [req-17f74809-0542-4aaa-ae00-8c34259dcd7c req-cdbbe5cc-817c-446e-8422-5436d3b3995e tempest-TestServerVolumeAttachmentScenario-586490087 None] Terminate volume connection completed successfully. Sep 17 22:03:32 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [req-17f74809-0542-4aaa-ae00-8c34259dcd7c req-cdbbe5cc-817c-446e-8422-5436d3b3995e tempest-TestServerVolumeAttachmentScenario-586490087 None] Deleting attachment d47af58b-3a43-442d-93a4-ea9fe0481473. {{(pid=85458) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 22:03:32 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-805d61ad-5565-4eec-83ad-ebb33094cfd0 tempest-VolumesNegativeTest-849504903 None] Acquiring lock "cinder-3ef567c1-f071-4201-b148-89df91cd8a50-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:03:32 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-805d61ad-5565-4eec-83ad-ebb33094cfd0 tempest-VolumesNegativeTest-849504903 None] Lock "cinder-3ef567c1-f071-4201-b148-89df91cd8a50-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:03:33 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-805d61ad-5565-4eec-83ad-ebb33094cfd0 tempest-VolumesNegativeTest-849504903 None] Acquiring lock "cinder-quobyte-3ef567c1-f071-4201-b148-89df91cd8a50" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:03:33 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-805d61ad-5565-4eec-83ad-ebb33094cfd0 tempest-VolumesNegativeTest-849504903 None] Lock "cinder-quobyte-3ef567c1-f071-4201-b148-89df91cd8a50" acquired by "delete_volume" :: waited 0.049s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:03:33 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b58d289-1dc3-4fa2-a281-30717a1ce3e6]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:03:33 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-805d61ad-5565-4eec-83ad-ebb33094cfd0 tempest-VolumesNegativeTest-849504903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-3ef567c1-f071-4201-b148-89df91cd8a50 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:03:33 devstack sudo[99443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-3ef567c1-f071-4201-b148-89df91cd8a50 Sep 17 22:03:33 devstack sudo[99443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:03:34 devstack sudo[99443]: pam_unix(sudo:session): session closed for user root Sep 17 22:03:34 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-805d61ad-5565-4eec-83ad-ebb33094cfd0 tempest-VolumesNegativeTest-849504903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-3ef567c1-f071-4201-b148-89df91cd8a50" returned: 0 in 1.009s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:03:34 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-805d61ad-5565-4eec-83ad-ebb33094cfd0 tempest-VolumesNegativeTest-849504903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-3ef567c1-f071-4201-b148-89df91cd8a50 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:03:34 devstack sudo[99475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-3ef567c1-f071-4201-b148-89df91cd8a50 Sep 17 22:03:34 devstack sudo[99475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:03:34 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [req-3a0bc777-1fc9-4c6c-aa0e-4a86bab011f3 req-5d345e08-04d1-40ec-8cbf-983af32e4eca tempest-TestMinimumBasicScenario-96395444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:03:34 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [req-3a0bc777-1fc9-4c6c-aa0e-4a86bab011f3 req-5d345e08-04d1-40ec-8cbf-983af32e4eca tempest-TestMinimumBasicScenario-96395444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:03:34 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [req-3a0bc777-1fc9-4c6c-aa0e-4a86bab011f3 req-5d345e08-04d1-40ec-8cbf-983af32e4eca tempest-TestMinimumBasicScenario-96395444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.048s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:03:34 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [req-3a0bc777-1fc9-4c6c-aa0e-4a86bab011f3 req-5d345e08-04d1-40ec-8cbf-983af32e4eca tempest-TestMinimumBasicScenario-96395444 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5', 'name': 'volume-d6153e5e-4f58-4344-b5ae-660bfc3686fa', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '90cba9aa-73d2-4c6f-9834-f9e7d95adb62', 'enforce_multipath': True} {{(pid=85458) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 22:03:34 devstack cinder-volume[85458]: INFO cinder.volume.manager [req-3a0bc777-1fc9-4c6c-aa0e-4a86bab011f3 req-5d345e08-04d1-40ec-8cbf-983af32e4eca tempest-TestMinimumBasicScenario-96395444 None] attachment_update completed successfully. Sep 17 22:03:34 devstack sudo[99475]: pam_unix(sudo:session): session closed for user root Sep 17 22:03:34 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-805d61ad-5565-4eec-83ad-ebb33094cfd0 tempest-VolumesNegativeTest-849504903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-3ef567c1-f071-4201-b148-89df91cd8a50" returned: 0 in 0.552s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:03:34 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-805d61ad-5565-4eec-83ad-ebb33094cfd0 tempest-VolumesNegativeTest-849504903 None] Lock "cinder-quobyte-3ef567c1-f071-4201-b148-89df91cd8a50" released by "delete_volume" :: held 1.685s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:03:34 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-805d61ad-5565-4eec-83ad-ebb33094cfd0 tempest-VolumesNegativeTest-849504903 None] Created reservations ['c372efe1-82f1-4e67-b0c0-5168c7b12e3c', '07674c6a-66c1-4920-9252-9671ff71171d', '7abc2de8-88bd-401e-9c94-4b34b5c97ed1', 'b10b9050-5a2d-4e69-be45-aaf4a6fe1e43'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:03:35 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-805d61ad-5565-4eec-83ad-ebb33094cfd0 tempest-VolumesNegativeTest-849504903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:03:35 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-805d61ad-5565-4eec-83ad-ebb33094cfd0 tempest-VolumesNegativeTest-849504903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:03:35 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-805d61ad-5565-4eec-83ad-ebb33094cfd0 tempest-VolumesNegativeTest-849504903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:03:35 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-805d61ad-5565-4eec-83ad-ebb33094cfd0 tempest-VolumesNegativeTest-849504903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:03:35 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-805d61ad-5565-4eec-83ad-ebb33094cfd0 tempest-VolumesNegativeTest-849504903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:03:35 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-805d61ad-5565-4eec-83ad-ebb33094cfd0 tempest-VolumesNegativeTest-849504903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:03:35 devstack sudo[99573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:03:35 devstack sudo[99573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:03:35 devstack sudo[99573]: pam_unix(sudo:session): session closed for user root Sep 17 22:03:35 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-805d61ad-5565-4eec-83ad-ebb33094cfd0 tempest-VolumesNegativeTest-849504903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.743s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:03:35 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-805d61ad-5565-4eec-83ad-ebb33094cfd0 tempest-VolumesNegativeTest-849504903 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:03:35 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-805d61ad-5565-4eec-83ad-ebb33094cfd0 tempest-VolumesNegativeTest-849504903 None] Deleted volume successfully. Sep 17 22:03:35 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-805d61ad-5565-4eec-83ad-ebb33094cfd0 tempest-VolumesNegativeTest-849504903 None] Lock "cinder-3ef567c1-f071-4201-b148-89df91cd8a50-delete_volume" released by "delete_volume" :: held 3.020s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:03:42 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-51aef395-a43f-42cd-bc2a-388c33bd49b3 tempest-TestServerVolumeAttachmentScenario-586490087 None] Acquiring lock "cinder-eff03be2-a889-4085-9fed-4fb591d03907-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:03:42 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-51aef395-a43f-42cd-bc2a-388c33bd49b3 tempest-TestServerVolumeAttachmentScenario-586490087 None] Lock "cinder-eff03be2-a889-4085-9fed-4fb591d03907-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:03:42 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-51aef395-a43f-42cd-bc2a-388c33bd49b3 tempest-TestServerVolumeAttachmentScenario-586490087 None] Acquiring lock "cinder-quobyte-eff03be2-a889-4085-9fed-4fb591d03907" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:03:42 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-51aef395-a43f-42cd-bc2a-388c33bd49b3 tempest-TestServerVolumeAttachmentScenario-586490087 None] Lock "cinder-quobyte-eff03be2-a889-4085-9fed-4fb591d03907" acquired by "delete_volume" :: waited 0.034s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:03:42 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2aff85e-a792-4b2b-add1-921d45920dba]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:03:42 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-51aef395-a43f-42cd-bc2a-388c33bd49b3 tempest-TestServerVolumeAttachmentScenario-586490087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-eff03be2-a889-4085-9fed-4fb591d03907 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:03:43 devstack sudo[99937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-eff03be2-a889-4085-9fed-4fb591d03907 Sep 17 22:03:43 devstack sudo[99937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:03:43 devstack sudo[99937]: pam_unix(sudo:session): session closed for user root Sep 17 22:03:43 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-51aef395-a43f-42cd-bc2a-388c33bd49b3 tempest-TestServerVolumeAttachmentScenario-586490087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-eff03be2-a889-4085-9fed-4fb591d03907" returned: 0 in 0.515s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:03:43 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-51aef395-a43f-42cd-bc2a-388c33bd49b3 tempest-TestServerVolumeAttachmentScenario-586490087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-eff03be2-a889-4085-9fed-4fb591d03907 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:03:43 devstack sudo[99943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-eff03be2-a889-4085-9fed-4fb591d03907 Sep 17 22:03:43 devstack sudo[99943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:03:43 devstack sudo[99943]: pam_unix(sudo:session): session closed for user root Sep 17 22:03:43 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-51aef395-a43f-42cd-bc2a-388c33bd49b3 tempest-TestServerVolumeAttachmentScenario-586490087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-eff03be2-a889-4085-9fed-4fb591d03907" returned: 0 in 0.307s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:03:43 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-51aef395-a43f-42cd-bc2a-388c33bd49b3 tempest-TestServerVolumeAttachmentScenario-586490087 None] Lock "cinder-quobyte-eff03be2-a889-4085-9fed-4fb591d03907" released by "delete_volume" :: held 0.891s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:03:43 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-51aef395-a43f-42cd-bc2a-388c33bd49b3 tempest-TestServerVolumeAttachmentScenario-586490087 None] Created reservations ['e2c4e75e-2eea-4e83-b337-89f5a2d66b09', 'c37c54ce-dcd9-4afd-bb1a-8da2a3952cd4', '41206826-13d6-4797-b8eb-3527862a68f1', 'f60f4676-52f1-4a97-a3da-3908a3c73ea2'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:03:43 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-51aef395-a43f-42cd-bc2a-388c33bd49b3 tempest-TestServerVolumeAttachmentScenario-586490087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:03:43 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-51aef395-a43f-42cd-bc2a-388c33bd49b3 tempest-TestServerVolumeAttachmentScenario-586490087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:03:43 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-51aef395-a43f-42cd-bc2a-388c33bd49b3 tempest-TestServerVolumeAttachmentScenario-586490087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:03:44 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-51aef395-a43f-42cd-bc2a-388c33bd49b3 tempest-TestServerVolumeAttachmentScenario-586490087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:03:44 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-51aef395-a43f-42cd-bc2a-388c33bd49b3 tempest-TestServerVolumeAttachmentScenario-586490087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:03:44 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-51aef395-a43f-42cd-bc2a-388c33bd49b3 tempest-TestServerVolumeAttachmentScenario-586490087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:03:44 devstack sudo[99946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:03:44 devstack sudo[99946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:03:44 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-f54a4d10-a44c-4d39-be8b-fccdcab7aa18 tempest-TestServerVolumeAttachmentScenario-586490087 None] Acquiring lock "cinder-d8376aea-d193-41b2-aa63-2f3d2218a42d-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:03:44 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-f54a4d10-a44c-4d39-be8b-fccdcab7aa18 tempest-TestServerVolumeAttachmentScenario-586490087 None] Lock "cinder-d8376aea-d193-41b2-aa63-2f3d2218a42d-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:03:44 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-f54a4d10-a44c-4d39-be8b-fccdcab7aa18 tempest-TestServerVolumeAttachmentScenario-586490087 None] Acquiring lock "cinder-quobyte-d8376aea-d193-41b2-aa63-2f3d2218a42d" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:03:44 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-f54a4d10-a44c-4d39-be8b-fccdcab7aa18 tempest-TestServerVolumeAttachmentScenario-586490087 None] Lock "cinder-quobyte-d8376aea-d193-41b2-aa63-2f3d2218a42d" acquired by "delete_volume" :: waited 0.027s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:03:44 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[b545565d-5c42-44d6-be5d-de08c9ee3202]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:03:44 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-f54a4d10-a44c-4d39-be8b-fccdcab7aa18 tempest-TestServerVolumeAttachmentScenario-586490087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-d8376aea-d193-41b2-aa63-2f3d2218a42d {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:03:44 devstack sudo[99946]: pam_unix(sudo:session): session closed for user root Sep 17 22:03:44 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-51aef395-a43f-42cd-bc2a-388c33bd49b3 tempest-TestServerVolumeAttachmentScenario-586490087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.415s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:03:44 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-51aef395-a43f-42cd-bc2a-388c33bd49b3 tempest-TestServerVolumeAttachmentScenario-586490087 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:03:44 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-51aef395-a43f-42cd-bc2a-388c33bd49b3 tempest-TestServerVolumeAttachmentScenario-586490087 None] Deleted volume successfully. Sep 17 22:03:44 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-51aef395-a43f-42cd-bc2a-388c33bd49b3 tempest-TestServerVolumeAttachmentScenario-586490087 None] Lock "cinder-eff03be2-a889-4085-9fed-4fb591d03907-delete_volume" released by "delete_volume" :: held 1.642s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:03:44 devstack sudo[99948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-d8376aea-d193-41b2-aa63-2f3d2218a42d Sep 17 22:03:44 devstack sudo[99948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:03:44 devstack sudo[99948]: pam_unix(sudo:session): session closed for user root Sep 17 22:03:44 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-f54a4d10-a44c-4d39-be8b-fccdcab7aa18 tempest-TestServerVolumeAttachmentScenario-586490087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-d8376aea-d193-41b2-aa63-2f3d2218a42d" returned: 0 in 0.527s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:03:44 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-f54a4d10-a44c-4d39-be8b-fccdcab7aa18 tempest-TestServerVolumeAttachmentScenario-586490087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-d8376aea-d193-41b2-aa63-2f3d2218a42d {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:03:44 devstack sudo[99955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-d8376aea-d193-41b2-aa63-2f3d2218a42d Sep 17 22:03:44 devstack sudo[99955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:03:45 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-b56f3461-ab3c-4e83-901f-7a9fd13c4490 tempest-VolumesSnapshotListTestJSON-444050519 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 22:03:45 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b56f3461-ab3c-4e83-901f-7a9fd13c4490 tempest-VolumesSnapshotListTestJSON-444050519 None] Flow 'volume_create_manager' (763f2b50-a010-44fc-b27f-838302db8e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:03:45 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b56f3461-ab3c-4e83-901f-7a9fd13c4490 tempest-VolumesSnapshotListTestJSON-444050519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3addae04-b826-401e-9bd4-e3bf4135cb7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:03:45 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b56f3461-ab3c-4e83-901f-7a9fd13c4490 tempest-VolumesSnapshotListTestJSON-444050519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3addae04-b826-401e-9bd4-e3bf4135cb7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:03:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-342686672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ff93e3f-42c4-4399-a4bc-3c9ae073e450,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='711de34a3bba44c987302e5a1efe3f62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:03:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:03:45Z,use_quota=True,user_id='7953c92fb5194d989c2fa580928ce550',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:03:45 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b56f3461-ab3c-4e83-901f-7a9fd13c4490 tempest-VolumesSnapshotListTestJSON-444050519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ce25d33-d399-4bda-82c8-a74a90bbe05b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:03:45 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b56f3461-ab3c-4e83-901f-7a9fd13c4490 tempest-VolumesSnapshotListTestJSON-444050519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ce25d33-d399-4bda-82c8-a74a90bbe05b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:03:45 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b56f3461-ab3c-4e83-901f-7a9fd13c4490 tempest-VolumesSnapshotListTestJSON-444050519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed5bdf3f-a793-4662-a952-398941cb718f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:03:45 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b56f3461-ab3c-4e83-901f-7a9fd13c4490 tempest-VolumesSnapshotListTestJSON-444050519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed5bdf3f-a793-4662-a952-398941cb718f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ff93e3f-42c4-4399-a4bc-3c9ae073e450', 'volume_name': 'volume-7ff93e3f-42c4-4399-a4bc-3c9ae073e450', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:03:45 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b56f3461-ab3c-4e83-901f-7a9fd13c4490 tempest-VolumesSnapshotListTestJSON-444050519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9640e3b-28a5-43a6-bce6-28bd0db39829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:03:45 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b56f3461-ab3c-4e83-901f-7a9fd13c4490 tempest-VolumesSnapshotListTestJSON-444050519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9640e3b-28a5-43a6-bce6-28bd0db39829) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:03:45 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b56f3461-ab3c-4e83-901f-7a9fd13c4490 tempest-VolumesSnapshotListTestJSON-444050519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e93f487-d645-4f29-8af1-b39f4931c2be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:03:45 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-b56f3461-ab3c-4e83-901f-7a9fd13c4490 tempest-VolumesSnapshotListTestJSON-444050519 None] Volume 7ff93e3f-42c4-4399-a4bc-3c9ae073e450: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ff93e3f-42c4-4399-a4bc-3c9ae073e450', 'volume_size': 1} Sep 17 22:03:45 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-b56f3461-ab3c-4e83-901f-7a9fd13c4490 tempest-VolumesSnapshotListTestJSON-444050519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:03:45 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-b56f3461-ab3c-4e83-901f-7a9fd13c4490 tempest-VolumesSnapshotListTestJSON-444050519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:03:45 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-b56f3461-ab3c-4e83-901f-7a9fd13c4490 tempest-VolumesSnapshotListTestJSON-444050519 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:03:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-342686672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ff93e3f-42c4-4399-a4bc-3c9ae073e450,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='711de34a3bba44c987302e5a1efe3f62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:03:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:03:45Z,use_quota=True,user_id='7953c92fb5194d989c2fa580928ce550',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 22:03:45 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-b56f3461-ab3c-4e83-901f-7a9fd13c4490 tempest-VolumesSnapshotListTestJSON-444050519 None] Creating volume 7ff93e3f-42c4-4399-a4bc-3c9ae073e450 {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 22:03:45 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-b56f3461-ab3c-4e83-901f-7a9fd13c4490 tempest-VolumesSnapshotListTestJSON-444050519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:03:45 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-b56f3461-ab3c-4e83-901f-7a9fd13c4490 tempest-VolumesSnapshotListTestJSON-444050519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:03:45 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-b56f3461-ab3c-4e83-901f-7a9fd13c4490 tempest-VolumesSnapshotListTestJSON-444050519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:03:45 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-b56f3461-ab3c-4e83-901f-7a9fd13c4490 tempest-VolumesSnapshotListTestJSON-444050519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:03:45 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-b56f3461-ab3c-4e83-901f-7a9fd13c4490 tempest-VolumesSnapshotListTestJSON-444050519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:03:45 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-b56f3461-ab3c-4e83-901f-7a9fd13c4490 tempest-VolumesSnapshotListTestJSON-444050519 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 22:03:45 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-b56f3461-ab3c-4e83-901f-7a9fd13c4490 tempest-VolumesSnapshotListTestJSON-444050519 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 22:03:45 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-b56f3461-ab3c-4e83-901f-7a9fd13c4490 tempest-VolumesSnapshotListTestJSON-444050519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7ff93e3f-42c4-4399-a4bc-3c9ae073e450 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:03:45 devstack sudo[99957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7ff93e3f-42c4-4399-a4bc-3c9ae073e450 1073741824 Sep 17 22:03:45 devstack sudo[99957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:03:45 devstack sudo[99955]: pam_unix(sudo:session): session closed for user root Sep 17 22:03:45 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-f54a4d10-a44c-4d39-be8b-fccdcab7aa18 tempest-TestServerVolumeAttachmentScenario-586490087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-d8376aea-d193-41b2-aa63-2f3d2218a42d" returned: 0 in 0.543s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:03:45 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-f54a4d10-a44c-4d39-be8b-fccdcab7aa18 tempest-TestServerVolumeAttachmentScenario-586490087 None] Lock "cinder-quobyte-d8376aea-d193-41b2-aa63-2f3d2218a42d" released by "delete_volume" :: held 1.155s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:03:45 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-f54a4d10-a44c-4d39-be8b-fccdcab7aa18 tempest-TestServerVolumeAttachmentScenario-586490087 None] Created reservations ['23f4267f-2ae1-4be4-b766-184ac31ba654', 'a8b31a4b-f7d3-409e-88f7-0b36ed01ea2e', '36a9a8c6-df7e-47c3-9e54-2295196267da', 'b9f7dc24-9f23-4e54-b075-2c69f428d285'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:03:45 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-f54a4d10-a44c-4d39-be8b-fccdcab7aa18 tempest-TestServerVolumeAttachmentScenario-586490087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:03:45 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-f54a4d10-a44c-4d39-be8b-fccdcab7aa18 tempest-TestServerVolumeAttachmentScenario-586490087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:03:45 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-f54a4d10-a44c-4d39-be8b-fccdcab7aa18 tempest-TestServerVolumeAttachmentScenario-586490087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:03:45 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-f54a4d10-a44c-4d39-be8b-fccdcab7aa18 tempest-TestServerVolumeAttachmentScenario-586490087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:03:45 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-f54a4d10-a44c-4d39-be8b-fccdcab7aa18 tempest-TestServerVolumeAttachmentScenario-586490087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:03:45 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-f54a4d10-a44c-4d39-be8b-fccdcab7aa18 tempest-TestServerVolumeAttachmentScenario-586490087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:03:45 devstack sudo[99964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:03:45 devstack sudo[99964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:03:45 devstack sudo[99957]: pam_unix(sudo:session): session closed for user root Sep 17 22:03:45 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-b56f3461-ab3c-4e83-901f-7a9fd13c4490 tempest-VolumesSnapshotListTestJSON-444050519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7ff93e3f-42c4-4399-a4bc-3c9ae073e450 1073741824" returned: 0 in 0.589s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:03:45 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-b56f3461-ab3c-4e83-901f-7a9fd13c4490 tempest-VolumesSnapshotListTestJSON-444050519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7ff93e3f-42c4-4399-a4bc-3c9ae073e450 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:03:45 devstack sudo[99966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7ff93e3f-42c4-4399-a4bc-3c9ae073e450 Sep 17 22:03:45 devstack sudo[99966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:03:45 devstack sudo[99964]: pam_unix(sudo:session): session closed for user root Sep 17 22:03:45 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-f54a4d10-a44c-4d39-be8b-fccdcab7aa18 tempest-TestServerVolumeAttachmentScenario-586490087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.320s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:03:45 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-f54a4d10-a44c-4d39-be8b-fccdcab7aa18 tempest-TestServerVolumeAttachmentScenario-586490087 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:03:45 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-f54a4d10-a44c-4d39-be8b-fccdcab7aa18 tempest-TestServerVolumeAttachmentScenario-586490087 None] Deleted volume successfully. Sep 17 22:03:46 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-f54a4d10-a44c-4d39-be8b-fccdcab7aa18 tempest-TestServerVolumeAttachmentScenario-586490087 None] Lock "cinder-d8376aea-d193-41b2-aa63-2f3d2218a42d-delete_volume" released by "delete_volume" :: held 1.884s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:03:46 devstack sudo[99966]: pam_unix(sudo:session): session closed for user root Sep 17 22:03:46 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-b56f3461-ab3c-4e83-901f-7a9fd13c4490 tempest-VolumesSnapshotListTestJSON-444050519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7ff93e3f-42c4-4399-a4bc-3c9ae073e450" returned: 0 in 0.364s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:03:46 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-b56f3461-ab3c-4e83-901f-7a9fd13c4490 tempest-VolumesSnapshotListTestJSON-444050519 None] <== create_volume: return (1019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 22:03:46 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-b56f3461-ab3c-4e83-901f-7a9fd13c4490 tempest-VolumesSnapshotListTestJSON-444050519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.023s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:03:46 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b56f3461-ab3c-4e83-901f-7a9fd13c4490 tempest-VolumesSnapshotListTestJSON-444050519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e93f487-d645-4f29-8af1-b39f4931c2be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ff93e3f-42c4-4399-a4bc-3c9ae073e450', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:03:46 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b56f3461-ab3c-4e83-901f-7a9fd13c4490 tempest-VolumesSnapshotListTestJSON-444050519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c06406e8-0181-45f1-a5d7-ab96b09b548f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:03:46 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-b56f3461-ab3c-4e83-901f-7a9fd13c4490 tempest-VolumesSnapshotListTestJSON-444050519 None] Volume volume-7ff93e3f-42c4-4399-a4bc-3c9ae073e450 (7ff93e3f-42c4-4399-a4bc-3c9ae073e450): created successfully Sep 17 22:03:46 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b56f3461-ab3c-4e83-901f-7a9fd13c4490 tempest-VolumesSnapshotListTestJSON-444050519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c06406e8-0181-45f1-a5d7-ab96b09b548f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:03:46 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b56f3461-ab3c-4e83-901f-7a9fd13c4490 tempest-VolumesSnapshotListTestJSON-444050519 None] Flow 'volume_create_manager' (763f2b50-a010-44fc-b27f-838302db8e2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:03:46 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-b56f3461-ab3c-4e83-901f-7a9fd13c4490 tempest-VolumesSnapshotListTestJSON-444050519 None] Created volume successfully. Sep 17 22:03:47 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-1da05e92-64ef-47da-b81a-4122a9609dba tempest-VolumesSnapshotListTestJSON-444050519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:03:47 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-1da05e92-64ef-47da-b81a-4122a9609dba tempest-VolumesSnapshotListTestJSON-444050519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:03:47 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-1da05e92-64ef-47da-b81a-4122a9609dba tempest-VolumesSnapshotListTestJSON-444050519 None] Creating offline snapshot 32e9696c-5dfd-4bb5-90d5-8f85dc96d6c5 of volume 7ff93e3f-42c4-4399-a4bc-3c9ae073e450 {{(pid=85458) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 22:03:47 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f60fffb-cdfc-4dde-ae5e-06b531979fe6]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:03:47 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-1da05e92-64ef-47da-b81a-4122a9609dba tempest-VolumesSnapshotListTestJSON-444050519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7ff93e3f-42c4-4399-a4bc-3c9ae073e450 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:03:47 devstack sudo[99970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7ff93e3f-42c4-4399-a4bc-3c9ae073e450 Sep 17 22:03:47 devstack sudo[99970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:03:47 devstack sudo[99970]: pam_unix(sudo:session): session closed for user root Sep 17 22:03:47 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-1da05e92-64ef-47da-b81a-4122a9609dba tempest-VolumesSnapshotListTestJSON-444050519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7ff93e3f-42c4-4399-a4bc-3c9ae073e450" returned: 0 in 0.429s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:03:47 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-1da05e92-64ef-47da-b81a-4122a9609dba tempest-VolumesSnapshotListTestJSON-444050519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7ff93e3f-42c4-4399-a4bc-3c9ae073e450,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7ff93e3f-42c4-4399-a4bc-3c9ae073e450.32e9696c-5dfd-4bb5-90d5-8f85dc96d6c5 1G {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:03:47 devstack sudo[99976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7ff93e3f-42c4-4399-a4bc-3c9ae073e450,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7ff93e3f-42c4-4399-a4bc-3c9ae073e450.32e9696c-5dfd-4bb5-90d5-8f85dc96d6c5 1G Sep 17 22:03:47 devstack sudo[99976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:03:48 devstack sudo[99976]: pam_unix(sudo:session): session closed for user root Sep 17 22:03:48 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-1da05e92-64ef-47da-b81a-4122a9609dba tempest-VolumesSnapshotListTestJSON-444050519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7ff93e3f-42c4-4399-a4bc-3c9ae073e450,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7ff93e3f-42c4-4399-a4bc-3c9ae073e450.32e9696c-5dfd-4bb5-90d5-8f85dc96d6c5 1G" returned: 0 in 0.518s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:03:48 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-1da05e92-64ef-47da-b81a-4122a9609dba tempest-VolumesSnapshotListTestJSON-444050519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ff93e3f-42c4-4399-a4bc-3c9ae073e450 -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7ff93e3f-42c4-4399-a4bc-3c9ae073e450.32e9696c-5dfd-4bb5-90d5-8f85dc96d6c5 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:03:48 devstack sudo[99983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ff93e3f-42c4-4399-a4bc-3c9ae073e450 -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7ff93e3f-42c4-4399-a4bc-3c9ae073e450.32e9696c-5dfd-4bb5-90d5-8f85dc96d6c5 Sep 17 22:03:48 devstack sudo[99983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:03:48 devstack sudo[99983]: pam_unix(sudo:session): session closed for user root Sep 17 22:03:48 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-1da05e92-64ef-47da-b81a-4122a9609dba tempest-VolumesSnapshotListTestJSON-444050519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ff93e3f-42c4-4399-a4bc-3c9ae073e450 -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7ff93e3f-42c4-4399-a4bc-3c9ae073e450.32e9696c-5dfd-4bb5-90d5-8f85dc96d6c5" returned: 0 in 0.415s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:03:48 devstack cinder-volume[85458]: WARNING cinder.volume.drivers.remotefs [None req-1da05e92-64ef-47da-b81a-4122a9609dba tempest-VolumesSnapshotListTestJSON-444050519 None] /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7ff93e3f-42c4-4399-a4bc-3c9ae073e450.32e9696c-5dfd-4bb5-90d5-8f85dc96d6c5 is being set with open permissions: ugo+rw Sep 17 22:03:48 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-1da05e92-64ef-47da-b81a-4122a9609dba tempest-VolumesSnapshotListTestJSON-444050519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7ff93e3f-42c4-4399-a4bc-3c9ae073e450.32e9696c-5dfd-4bb5-90d5-8f85dc96d6c5 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:03:48 devstack sudo[99988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7ff93e3f-42c4-4399-a4bc-3c9ae073e450.32e9696c-5dfd-4bb5-90d5-8f85dc96d6c5 Sep 17 22:03:48 devstack sudo[99988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:03:49 devstack sudo[99988]: pam_unix(sudo:session): session closed for user root Sep 17 22:03:49 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-1da05e92-64ef-47da-b81a-4122a9609dba tempest-VolumesSnapshotListTestJSON-444050519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7ff93e3f-42c4-4399-a4bc-3c9ae073e450.32e9696c-5dfd-4bb5-90d5-8f85dc96d6c5" returned: 0 in 0.342s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:03:49 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-1da05e92-64ef-47da-b81a-4122a9609dba tempest-VolumesSnapshotListTestJSON-444050519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7ff93e3f-42c4-4399-a4bc-3c9ae073e450.info {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:03:49 devstack sudo[99992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7ff93e3f-42c4-4399-a4bc-3c9ae073e450.info Sep 17 22:03:49 devstack sudo[99992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:03:49 devstack sudo[99992]: pam_unix(sudo:session): session closed for user root Sep 17 22:03:49 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-1da05e92-64ef-47da-b81a-4122a9609dba tempest-VolumesSnapshotListTestJSON-444050519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7ff93e3f-42c4-4399-a4bc-3c9ae073e450.info" returned: 0 in 0.289s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:03:49 devstack cinder-volume[85458]: WARNING cinder.volume.drivers.remotefs [None req-1da05e92-64ef-47da-b81a-4122a9609dba tempest-VolumesSnapshotListTestJSON-444050519 None] /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7ff93e3f-42c4-4399-a4bc-3c9ae073e450.info is being set with open permissions: ugo+rw Sep 17 22:03:49 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-1da05e92-64ef-47da-b81a-4122a9609dba tempest-VolumesSnapshotListTestJSON-444050519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7ff93e3f-42c4-4399-a4bc-3c9ae073e450.info {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:03:49 devstack sudo[99995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7ff93e3f-42c4-4399-a4bc-3c9ae073e450.info Sep 17 22:03:49 devstack sudo[99995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:03:49 devstack sudo[99995]: pam_unix(sudo:session): session closed for user root Sep 17 22:03:49 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-1da05e92-64ef-47da-b81a-4122a9609dba tempest-VolumesSnapshotListTestJSON-444050519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7ff93e3f-42c4-4399-a4bc-3c9ae073e450.info" returned: 0 in 0.264s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:03:49 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-1da05e92-64ef-47da-b81a-4122a9609dba tempest-VolumesSnapshotListTestJSON-444050519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.424s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:03:49 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-1da05e92-64ef-47da-b81a-4122a9609dba tempest-VolumesSnapshotListTestJSON-444050519 None] Create snapshot completed successfully Sep 17 22:03:50 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e72b9ac0-26e7-4788-916b-5fd443e91983 tempest-VolumesSnapshotListTestJSON-444050519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:03:50 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e72b9ac0-26e7-4788-916b-5fd443e91983 tempest-VolumesSnapshotListTestJSON-444050519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:03:50 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-e72b9ac0-26e7-4788-916b-5fd443e91983 tempest-VolumesSnapshotListTestJSON-444050519 None] Creating offline snapshot a5bbcf3c-1ff2-4e7a-9ba1-81cc3ac703d4 of volume 7ff93e3f-42c4-4399-a4bc-3c9ae073e450 {{(pid=85458) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 22:03:50 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b0ae534-8537-480d-b976-b3252a39de2f]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:03:50 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e72b9ac0-26e7-4788-916b-5fd443e91983 tempest-VolumesSnapshotListTestJSON-444050519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7ff93e3f-42c4-4399-a4bc-3c9ae073e450.32e9696c-5dfd-4bb5-90d5-8f85dc96d6c5 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:03:51 devstack sudo[99998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7ff93e3f-42c4-4399-a4bc-3c9ae073e450.32e9696c-5dfd-4bb5-90d5-8f85dc96d6c5 Sep 17 22:03:51 devstack sudo[99998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:03:51 devstack sudo[99998]: pam_unix(sudo:session): session closed for user root Sep 17 22:03:51 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e72b9ac0-26e7-4788-916b-5fd443e91983 tempest-VolumesSnapshotListTestJSON-444050519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7ff93e3f-42c4-4399-a4bc-3c9ae073e450.32e9696c-5dfd-4bb5-90d5-8f85dc96d6c5" returned: 0 in 0.500s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:03:51 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-e72b9ac0-26e7-4788-916b-5fd443e91983 tempest-VolumesSnapshotListTestJSON-444050519 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ff93e3f-42c4-4399-a4bc-3c9ae073e450(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85458) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 22:03:51 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e72b9ac0-26e7-4788-916b-5fd443e91983 tempest-VolumesSnapshotListTestJSON-444050519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7ff93e3f-42c4-4399-a4bc-3c9ae073e450.32e9696c-5dfd-4bb5-90d5-8f85dc96d6c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7ff93e3f-42c4-4399-a4bc-3c9ae073e450.a5bbcf3c-1ff2-4e7a-9ba1-81cc3ac703d4 1G {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:03:51 devstack sudo[100003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7ff93e3f-42c4-4399-a4bc-3c9ae073e450.32e9696c-5dfd-4bb5-90d5-8f85dc96d6c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7ff93e3f-42c4-4399-a4bc-3c9ae073e450.a5bbcf3c-1ff2-4e7a-9ba1-81cc3ac703d4 1G Sep 17 22:03:51 devstack sudo[100003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:03:51 devstack sudo[100003]: pam_unix(sudo:session): session closed for user root Sep 17 22:03:51 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e72b9ac0-26e7-4788-916b-5fd443e91983 tempest-VolumesSnapshotListTestJSON-444050519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7ff93e3f-42c4-4399-a4bc-3c9ae073e450.32e9696c-5dfd-4bb5-90d5-8f85dc96d6c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7ff93e3f-42c4-4399-a4bc-3c9ae073e450.a5bbcf3c-1ff2-4e7a-9ba1-81cc3ac703d4 1G" returned: 0 in 0.575s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:03:51 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e72b9ac0-26e7-4788-916b-5fd443e91983 tempest-VolumesSnapshotListTestJSON-444050519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ff93e3f-42c4-4399-a4bc-3c9ae073e450.32e9696c-5dfd-4bb5-90d5-8f85dc96d6c5 -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7ff93e3f-42c4-4399-a4bc-3c9ae073e450.a5bbcf3c-1ff2-4e7a-9ba1-81cc3ac703d4 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:03:52 devstack sudo[100010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ff93e3f-42c4-4399-a4bc-3c9ae073e450.32e9696c-5dfd-4bb5-90d5-8f85dc96d6c5 -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7ff93e3f-42c4-4399-a4bc-3c9ae073e450.a5bbcf3c-1ff2-4e7a-9ba1-81cc3ac703d4 Sep 17 22:03:52 devstack sudo[100010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:03:52 devstack sudo[100010]: pam_unix(sudo:session): session closed for user root Sep 17 22:03:52 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e72b9ac0-26e7-4788-916b-5fd443e91983 tempest-VolumesSnapshotListTestJSON-444050519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ff93e3f-42c4-4399-a4bc-3c9ae073e450.32e9696c-5dfd-4bb5-90d5-8f85dc96d6c5 -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7ff93e3f-42c4-4399-a4bc-3c9ae073e450.a5bbcf3c-1ff2-4e7a-9ba1-81cc3ac703d4" returned: 0 in 0.354s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:03:52 devstack cinder-volume[85458]: WARNING cinder.volume.drivers.remotefs [None req-e72b9ac0-26e7-4788-916b-5fd443e91983 tempest-VolumesSnapshotListTestJSON-444050519 None] /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7ff93e3f-42c4-4399-a4bc-3c9ae073e450.a5bbcf3c-1ff2-4e7a-9ba1-81cc3ac703d4 is being set with open permissions: ugo+rw Sep 17 22:03:52 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e72b9ac0-26e7-4788-916b-5fd443e91983 tempest-VolumesSnapshotListTestJSON-444050519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7ff93e3f-42c4-4399-a4bc-3c9ae073e450.a5bbcf3c-1ff2-4e7a-9ba1-81cc3ac703d4 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:03:52 devstack sudo[100016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7ff93e3f-42c4-4399-a4bc-3c9ae073e450.a5bbcf3c-1ff2-4e7a-9ba1-81cc3ac703d4 Sep 17 22:03:52 devstack sudo[100016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:03:52 devstack sudo[100016]: pam_unix(sudo:session): session closed for user root Sep 17 22:03:52 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e72b9ac0-26e7-4788-916b-5fd443e91983 tempest-VolumesSnapshotListTestJSON-444050519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7ff93e3f-42c4-4399-a4bc-3c9ae073e450.a5bbcf3c-1ff2-4e7a-9ba1-81cc3ac703d4" returned: 0 in 0.343s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:03:52 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e72b9ac0-26e7-4788-916b-5fd443e91983 tempest-VolumesSnapshotListTestJSON-444050519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.940s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:03:52 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-e72b9ac0-26e7-4788-916b-5fd443e91983 tempest-VolumesSnapshotListTestJSON-444050519 None] Create snapshot completed successfully Sep 17 22:03:53 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-3ee90493-1f18-42a1-9f81-64ea30e41641 tempest-VolumesSnapshotListTestJSON-444050519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:03:53 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-3ee90493-1f18-42a1-9f81-64ea30e41641 tempest-VolumesSnapshotListTestJSON-444050519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:03:53 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-3ee90493-1f18-42a1-9f81-64ea30e41641 tempest-VolumesSnapshotListTestJSON-444050519 None] Creating offline snapshot b7629eb1-b52c-4a16-969a-c34516a9fcfb of volume 7ff93e3f-42c4-4399-a4bc-3c9ae073e450 {{(pid=85458) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 22:03:53 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5fcbbcc-f5d0-482d-ac27-070b77a1c059]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:03:53 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-3ee90493-1f18-42a1-9f81-64ea30e41641 tempest-VolumesSnapshotListTestJSON-444050519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7ff93e3f-42c4-4399-a4bc-3c9ae073e450.a5bbcf3c-1ff2-4e7a-9ba1-81cc3ac703d4 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:03:53 devstack sudo[100021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7ff93e3f-42c4-4399-a4bc-3c9ae073e450.a5bbcf3c-1ff2-4e7a-9ba1-81cc3ac703d4 Sep 17 22:03:53 devstack sudo[100021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:03:54 devstack sudo[100021]: pam_unix(sudo:session): session closed for user root Sep 17 22:03:54 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-3ee90493-1f18-42a1-9f81-64ea30e41641 tempest-VolumesSnapshotListTestJSON-444050519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7ff93e3f-42c4-4399-a4bc-3c9ae073e450.a5bbcf3c-1ff2-4e7a-9ba1-81cc3ac703d4" returned: 0 in 0.680s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:03:54 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-3ee90493-1f18-42a1-9f81-64ea30e41641 tempest-VolumesSnapshotListTestJSON-444050519 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ff93e3f-42c4-4399-a4bc-3c9ae073e450(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85458) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 22:03:54 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-3ee90493-1f18-42a1-9f81-64ea30e41641 tempest-VolumesSnapshotListTestJSON-444050519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7ff93e3f-42c4-4399-a4bc-3c9ae073e450.a5bbcf3c-1ff2-4e7a-9ba1-81cc3ac703d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7ff93e3f-42c4-4399-a4bc-3c9ae073e450.b7629eb1-b52c-4a16-969a-c34516a9fcfb 1G {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:03:54 devstack sudo[100026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7ff93e3f-42c4-4399-a4bc-3c9ae073e450.a5bbcf3c-1ff2-4e7a-9ba1-81cc3ac703d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7ff93e3f-42c4-4399-a4bc-3c9ae073e450.b7629eb1-b52c-4a16-969a-c34516a9fcfb 1G Sep 17 22:03:54 devstack sudo[100026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:03:55 devstack sudo[100026]: pam_unix(sudo:session): session closed for user root Sep 17 22:03:55 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-3ee90493-1f18-42a1-9f81-64ea30e41641 tempest-VolumesSnapshotListTestJSON-444050519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7ff93e3f-42c4-4399-a4bc-3c9ae073e450.a5bbcf3c-1ff2-4e7a-9ba1-81cc3ac703d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7ff93e3f-42c4-4399-a4bc-3c9ae073e450.b7629eb1-b52c-4a16-969a-c34516a9fcfb 1G" returned: 0 in 0.927s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:03:55 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-3ee90493-1f18-42a1-9f81-64ea30e41641 tempest-VolumesSnapshotListTestJSON-444050519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ff93e3f-42c4-4399-a4bc-3c9ae073e450.a5bbcf3c-1ff2-4e7a-9ba1-81cc3ac703d4 -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7ff93e3f-42c4-4399-a4bc-3c9ae073e450.b7629eb1-b52c-4a16-969a-c34516a9fcfb {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:03:55 devstack sudo[100060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ff93e3f-42c4-4399-a4bc-3c9ae073e450.a5bbcf3c-1ff2-4e7a-9ba1-81cc3ac703d4 -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7ff93e3f-42c4-4399-a4bc-3c9ae073e450.b7629eb1-b52c-4a16-969a-c34516a9fcfb Sep 17 22:03:55 devstack sudo[100060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:03:55 devstack sudo[100060]: pam_unix(sudo:session): session closed for user root Sep 17 22:03:55 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-3ee90493-1f18-42a1-9f81-64ea30e41641 tempest-VolumesSnapshotListTestJSON-444050519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ff93e3f-42c4-4399-a4bc-3c9ae073e450.a5bbcf3c-1ff2-4e7a-9ba1-81cc3ac703d4 -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7ff93e3f-42c4-4399-a4bc-3c9ae073e450.b7629eb1-b52c-4a16-969a-c34516a9fcfb" returned: 0 in 0.342s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:03:55 devstack cinder-volume[85458]: WARNING cinder.volume.drivers.remotefs [None req-3ee90493-1f18-42a1-9f81-64ea30e41641 tempest-VolumesSnapshotListTestJSON-444050519 None] /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7ff93e3f-42c4-4399-a4bc-3c9ae073e450.b7629eb1-b52c-4a16-969a-c34516a9fcfb is being set with open permissions: ugo+rw Sep 17 22:03:55 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-3ee90493-1f18-42a1-9f81-64ea30e41641 tempest-VolumesSnapshotListTestJSON-444050519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7ff93e3f-42c4-4399-a4bc-3c9ae073e450.b7629eb1-b52c-4a16-969a-c34516a9fcfb {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:03:55 devstack sudo[100066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7ff93e3f-42c4-4399-a4bc-3c9ae073e450.b7629eb1-b52c-4a16-969a-c34516a9fcfb Sep 17 22:03:55 devstack sudo[100066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:03:55 devstack sudo[100066]: pam_unix(sudo:session): session closed for user root Sep 17 22:03:55 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-3ee90493-1f18-42a1-9f81-64ea30e41641 tempest-VolumesSnapshotListTestJSON-444050519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7ff93e3f-42c4-4399-a4bc-3c9ae073e450.b7629eb1-b52c-4a16-969a-c34516a9fcfb" returned: 0 in 0.287s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:03:55 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-3ee90493-1f18-42a1-9f81-64ea30e41641 tempest-VolumesSnapshotListTestJSON-444050519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.443s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:03:55 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-3ee90493-1f18-42a1-9f81-64ea30e41641 tempest-VolumesSnapshotListTestJSON-444050519 None] Create snapshot completed successfully Sep 17 22:03:56 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6e1a2e4-3711-47d4-9fec-18a4fd5893a6 tempest-VolumesSnapshotTestJSON-1092695371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 22:03:56 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-a6e1a2e4-3711-47d4-9fec-18a4fd5893a6 tempest-VolumesSnapshotTestJSON-1092695371 None] Flow 'volume_create_manager' (9fc26aa1-8f0c-4fd4-8d4f-fa5ee82d5fab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:03:56 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-a6e1a2e4-3711-47d4-9fec-18a4fd5893a6 tempest-VolumesSnapshotTestJSON-1092695371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e570e642-3681-48ca-826d-429e3bb2b9e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:03:56 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-a6e1a2e4-3711-47d4-9fec-18a4fd5893a6 tempest-VolumesSnapshotTestJSON-1092695371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e570e642-3681-48ca-826d-429e3bb2b9e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:03:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-215400020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db8e1a8f-f5f7-4a60-a0b0-c352da13d12c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06cd571a5b3a4923912443d726b16adb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:03:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:03:56Z,use_quota=True,user_id='53305d3d19814893af8139460c405901',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:03:56 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-a6e1a2e4-3711-47d4-9fec-18a4fd5893a6 tempest-VolumesSnapshotTestJSON-1092695371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (505e1041-0a4f-4082-b1a2-50c7738e7a6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:03:56 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-a6e1a2e4-3711-47d4-9fec-18a4fd5893a6 tempest-VolumesSnapshotTestJSON-1092695371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (505e1041-0a4f-4082-b1a2-50c7738e7a6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:03:56 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-a6e1a2e4-3711-47d4-9fec-18a4fd5893a6 tempest-VolumesSnapshotTestJSON-1092695371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2398633c-59a8-48bc-828c-0fac3383b305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:03:56 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-a6e1a2e4-3711-47d4-9fec-18a4fd5893a6 tempest-VolumesSnapshotTestJSON-1092695371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2398633c-59a8-48bc-828c-0fac3383b305) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db8e1a8f-f5f7-4a60-a0b0-c352da13d12c', 'volume_name': 'volume-db8e1a8f-f5f7-4a60-a0b0-c352da13d12c', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:03:56 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-a6e1a2e4-3711-47d4-9fec-18a4fd5893a6 tempest-VolumesSnapshotTestJSON-1092695371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (729fab27-c78c-409b-9d8b-9a35eee7205d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:03:56 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-a6e1a2e4-3711-47d4-9fec-18a4fd5893a6 tempest-VolumesSnapshotTestJSON-1092695371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (729fab27-c78c-409b-9d8b-9a35eee7205d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:03:56 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-a6e1a2e4-3711-47d4-9fec-18a4fd5893a6 tempest-VolumesSnapshotTestJSON-1092695371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8091c8f6-0744-4058-b3e1-5e0687d997f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:03:56 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-a6e1a2e4-3711-47d4-9fec-18a4fd5893a6 tempest-VolumesSnapshotTestJSON-1092695371 None] Volume db8e1a8f-f5f7-4a60-a0b0-c352da13d12c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db8e1a8f-f5f7-4a60-a0b0-c352da13d12c', 'volume_size': 1} Sep 17 22:03:56 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-a6e1a2e4-3711-47d4-9fec-18a4fd5893a6 tempest-VolumesSnapshotTestJSON-1092695371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:03:56 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-a6e1a2e4-3711-47d4-9fec-18a4fd5893a6 tempest-VolumesSnapshotTestJSON-1092695371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:03:56 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-a6e1a2e4-3711-47d4-9fec-18a4fd5893a6 tempest-VolumesSnapshotTestJSON-1092695371 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:03:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-215400020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db8e1a8f-f5f7-4a60-a0b0-c352da13d12c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06cd571a5b3a4923912443d726b16adb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:03:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:03:56Z,use_quota=True,user_id='53305d3d19814893af8139460c405901',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 22:03:56 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-a6e1a2e4-3711-47d4-9fec-18a4fd5893a6 tempest-VolumesSnapshotTestJSON-1092695371 None] Creating volume db8e1a8f-f5f7-4a60-a0b0-c352da13d12c {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 22:03:56 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-a6e1a2e4-3711-47d4-9fec-18a4fd5893a6 tempest-VolumesSnapshotTestJSON-1092695371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:03:56 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-a6e1a2e4-3711-47d4-9fec-18a4fd5893a6 tempest-VolumesSnapshotTestJSON-1092695371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:03:56 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-a6e1a2e4-3711-47d4-9fec-18a4fd5893a6 tempest-VolumesSnapshotTestJSON-1092695371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:03:56 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-a6e1a2e4-3711-47d4-9fec-18a4fd5893a6 tempest-VolumesSnapshotTestJSON-1092695371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:03:56 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-a6e1a2e4-3711-47d4-9fec-18a4fd5893a6 tempest-VolumesSnapshotTestJSON-1092695371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:03:56 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-a6e1a2e4-3711-47d4-9fec-18a4fd5893a6 tempest-VolumesSnapshotTestJSON-1092695371 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 22:03:56 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-a6e1a2e4-3711-47d4-9fec-18a4fd5893a6 tempest-VolumesSnapshotTestJSON-1092695371 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 22:03:56 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a6e1a2e4-3711-47d4-9fec-18a4fd5893a6 tempest-VolumesSnapshotTestJSON-1092695371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-db8e1a8f-f5f7-4a60-a0b0-c352da13d12c 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:03:56 devstack sudo[100070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-db8e1a8f-f5f7-4a60-a0b0-c352da13d12c 1073741824 Sep 17 22:03:56 devstack sudo[100070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:03:56 devstack sudo[100070]: pam_unix(sudo:session): session closed for user root Sep 17 22:03:56 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a6e1a2e4-3711-47d4-9fec-18a4fd5893a6 tempest-VolumesSnapshotTestJSON-1092695371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-db8e1a8f-f5f7-4a60-a0b0-c352da13d12c 1073741824" returned: 0 in 0.590s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:03:56 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a6e1a2e4-3711-47d4-9fec-18a4fd5893a6 tempest-VolumesSnapshotTestJSON-1092695371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-db8e1a8f-f5f7-4a60-a0b0-c352da13d12c {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:03:56 devstack sudo[100077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-db8e1a8f-f5f7-4a60-a0b0-c352da13d12c Sep 17 22:03:56 devstack sudo[100077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:03:57 devstack sudo[100077]: pam_unix(sudo:session): session closed for user root Sep 17 22:03:57 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a6e1a2e4-3711-47d4-9fec-18a4fd5893a6 tempest-VolumesSnapshotTestJSON-1092695371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-db8e1a8f-f5f7-4a60-a0b0-c352da13d12c" returned: 0 in 0.408s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:03:57 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-a6e1a2e4-3711-47d4-9fec-18a4fd5893a6 tempest-VolumesSnapshotTestJSON-1092695371 None] <== create_volume: return (1066ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 22:03:57 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-a6e1a2e4-3711-47d4-9fec-18a4fd5893a6 tempest-VolumesSnapshotTestJSON-1092695371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.070s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:03:57 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-a6e1a2e4-3711-47d4-9fec-18a4fd5893a6 tempest-VolumesSnapshotTestJSON-1092695371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8091c8f6-0744-4058-b3e1-5e0687d997f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db8e1a8f-f5f7-4a60-a0b0-c352da13d12c', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:03:57 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-a6e1a2e4-3711-47d4-9fec-18a4fd5893a6 tempest-VolumesSnapshotTestJSON-1092695371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0ad51d9-4e7f-4f81-aded-a0b009dd74be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:03:57 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-a6e1a2e4-3711-47d4-9fec-18a4fd5893a6 tempest-VolumesSnapshotTestJSON-1092695371 None] Volume volume-db8e1a8f-f5f7-4a60-a0b0-c352da13d12c (db8e1a8f-f5f7-4a60-a0b0-c352da13d12c): created successfully Sep 17 22:03:57 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-a6e1a2e4-3711-47d4-9fec-18a4fd5893a6 tempest-VolumesSnapshotTestJSON-1092695371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0ad51d9-4e7f-4f81-aded-a0b009dd74be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:03:57 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-a6e1a2e4-3711-47d4-9fec-18a4fd5893a6 tempest-VolumesSnapshotTestJSON-1092695371 None] Flow 'volume_create_manager' (9fc26aa1-8f0c-4fd4-8d4f-fa5ee82d5fab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:03:57 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-a6e1a2e4-3711-47d4-9fec-18a4fd5893a6 tempest-VolumesSnapshotTestJSON-1092695371 None] Created volume successfully. Sep 17 22:03:57 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-695c3e7e-d314-47ba-8fb9-6d2e8b06b6e0 tempest-VolumesSnapshotListTestJSON-444050519 None] Acquiring lock "cinder-b7629eb1-b52c-4a16-969a-c34516a9fcfb-delete_snapshot" by "delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:03:57 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-695c3e7e-d314-47ba-8fb9-6d2e8b06b6e0 tempest-VolumesSnapshotListTestJSON-444050519 None] Lock "cinder-b7629eb1-b52c-4a16-969a-c34516a9fcfb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:03:57 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-695c3e7e-d314-47ba-8fb9-6d2e8b06b6e0 tempest-VolumesSnapshotListTestJSON-444050519 None] Acquiring lock "cinder-quobyte-7ff93e3f-42c4-4399-a4bc-3c9ae073e450" by "delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:03:57 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-695c3e7e-d314-47ba-8fb9-6d2e8b06b6e0 tempest-VolumesSnapshotListTestJSON-444050519 None] Lock "cinder-quobyte-7ff93e3f-42c4-4399-a4bc-3c9ae073e450" acquired by "delete_snapshot" :: waited 0.014s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:03:57 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-695c3e7e-d314-47ba-8fb9-6d2e8b06b6e0 tempest-VolumesSnapshotListTestJSON-444050519 None] Acquiring lock "cinder-quobyte-b7629eb1-b52c-4a16-969a-c34516a9fcfb" by "_delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:03:57 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-695c3e7e-d314-47ba-8fb9-6d2e8b06b6e0 tempest-VolumesSnapshotListTestJSON-444050519 None] Lock "cinder-quobyte-b7629eb1-b52c-4a16-969a-c34516a9fcfb" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:03:57 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-695c3e7e-d314-47ba-8fb9-6d2e8b06b6e0 tempest-VolumesSnapshotListTestJSON-444050519 None] Deleting offline snapshot b7629eb1-b52c-4a16-969a-c34516a9fcfb of volume 7ff93e3f-42c4-4399-a4bc-3c9ae073e450 {{(pid=85458) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 22:03:57 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-695c3e7e-d314-47ba-8fb9-6d2e8b06b6e0 tempest-VolumesSnapshotListTestJSON-444050519 None] snapshot_file for this snap is: volume-7ff93e3f-42c4-4399-a4bc-3c9ae073e450.b7629eb1-b52c-4a16-969a-c34516a9fcfb {{(pid=85458) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 22:03:57 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae20bef7-097b-48af-833e-239a5cd5fd4c]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:03:57 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-695c3e7e-d314-47ba-8fb9-6d2e8b06b6e0 tempest-VolumesSnapshotListTestJSON-444050519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7ff93e3f-42c4-4399-a4bc-3c9ae073e450.b7629eb1-b52c-4a16-969a-c34516a9fcfb {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:03:57 devstack sudo[100080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7ff93e3f-42c4-4399-a4bc-3c9ae073e450.b7629eb1-b52c-4a16-969a-c34516a9fcfb Sep 17 22:03:57 devstack sudo[100080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:03:58 devstack sudo[100080]: pam_unix(sudo:session): session closed for user root Sep 17 22:03:58 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-695c3e7e-d314-47ba-8fb9-6d2e8b06b6e0 tempest-VolumesSnapshotListTestJSON-444050519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7ff93e3f-42c4-4399-a4bc-3c9ae073e450.b7629eb1-b52c-4a16-969a-c34516a9fcfb" returned: 0 in 0.448s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:03:58 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-695c3e7e-d314-47ba-8fb9-6d2e8b06b6e0 tempest-VolumesSnapshotListTestJSON-444050519 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ff93e3f-42c4-4399-a4bc-3c9ae073e450(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85458) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 22:03:58 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f22805b-4b0b-4e11-8c0e-105b8594b2cd]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:03:58 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-695c3e7e-d314-47ba-8fb9-6d2e8b06b6e0 tempest-VolumesSnapshotListTestJSON-444050519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7ff93e3f-42c4-4399-a4bc-3c9ae073e450.a5bbcf3c-1ff2-4e7a-9ba1-81cc3ac703d4 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:03:58 devstack sudo[100085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7ff93e3f-42c4-4399-a4bc-3c9ae073e450.a5bbcf3c-1ff2-4e7a-9ba1-81cc3ac703d4 Sep 17 22:03:58 devstack sudo[100085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:03:58 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-43174e47-1e11-4f68-a35a-138b20ffb87d tempest-VolumesSnapshotTestJSON-1092695371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:03:58 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-43174e47-1e11-4f68-a35a-138b20ffb87d tempest-VolumesSnapshotTestJSON-1092695371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:03:58 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-43174e47-1e11-4f68-a35a-138b20ffb87d tempest-VolumesSnapshotTestJSON-1092695371 None] Creating offline snapshot a73133c4-93c1-40fc-9ad9-444c7c1a2a2f of volume db8e1a8f-f5f7-4a60-a0b0-c352da13d12c {{(pid=85458) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 22:03:58 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f8c519d-1ce6-4427-8c4f-b8668dba5adf]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:03:58 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-43174e47-1e11-4f68-a35a-138b20ffb87d tempest-VolumesSnapshotTestJSON-1092695371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-db8e1a8f-f5f7-4a60-a0b0-c352da13d12c {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:03:58 devstack sudo[100087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-db8e1a8f-f5f7-4a60-a0b0-c352da13d12c Sep 17 22:03:58 devstack sudo[100087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:03:58 devstack sudo[100085]: pam_unix(sudo:session): session closed for user root Sep 17 22:03:58 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-695c3e7e-d314-47ba-8fb9-6d2e8b06b6e0 tempest-VolumesSnapshotListTestJSON-444050519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7ff93e3f-42c4-4399-a4bc-3c9ae073e450.a5bbcf3c-1ff2-4e7a-9ba1-81cc3ac703d4" returned: 0 in 0.542s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:03:58 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-695c3e7e-d314-47ba-8fb9-6d2e8b06b6e0 tempest-VolumesSnapshotListTestJSON-444050519 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ff93e3f-42c4-4399-a4bc-3c9ae073e450(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85458) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 22:03:58 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-695c3e7e-d314-47ba-8fb9-6d2e8b06b6e0 tempest-VolumesSnapshotListTestJSON-444050519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7ff93e3f-42c4-4399-a4bc-3c9ae073e450.b7629eb1-b52c-4a16-969a-c34516a9fcfb {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:03:58 devstack sudo[100093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7ff93e3f-42c4-4399-a4bc-3c9ae073e450.b7629eb1-b52c-4a16-969a-c34516a9fcfb Sep 17 22:03:58 devstack sudo[100093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:03:59 devstack sudo[100087]: pam_unix(sudo:session): session closed for user root Sep 17 22:03:59 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-43174e47-1e11-4f68-a35a-138b20ffb87d tempest-VolumesSnapshotTestJSON-1092695371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-db8e1a8f-f5f7-4a60-a0b0-c352da13d12c" returned: 0 in 0.443s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:03:59 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-43174e47-1e11-4f68-a35a-138b20ffb87d tempest-VolumesSnapshotTestJSON-1092695371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-db8e1a8f-f5f7-4a60-a0b0-c352da13d12c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-db8e1a8f-f5f7-4a60-a0b0-c352da13d12c.a73133c4-93c1-40fc-9ad9-444c7c1a2a2f 1G {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:03:59 devstack sudo[100098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-db8e1a8f-f5f7-4a60-a0b0-c352da13d12c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-db8e1a8f-f5f7-4a60-a0b0-c352da13d12c.a73133c4-93c1-40fc-9ad9-444c7c1a2a2f 1G Sep 17 22:03:59 devstack sudo[100098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:03:59 devstack sudo[100093]: pam_unix(sudo:session): session closed for user root Sep 17 22:03:59 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-695c3e7e-d314-47ba-8fb9-6d2e8b06b6e0 tempest-VolumesSnapshotListTestJSON-444050519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7ff93e3f-42c4-4399-a4bc-3c9ae073e450.b7629eb1-b52c-4a16-969a-c34516a9fcfb" returned: 0 in 0.475s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:03:59 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-695c3e7e-d314-47ba-8fb9-6d2e8b06b6e0 tempest-VolumesSnapshotListTestJSON-444050519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7ff93e3f-42c4-4399-a4bc-3c9ae073e450.b7629eb1-b52c-4a16-969a-c34516a9fcfb {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:03:59 devstack sudo[100107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7ff93e3f-42c4-4399-a4bc-3c9ae073e450.b7629eb1-b52c-4a16-969a-c34516a9fcfb Sep 17 22:03:59 devstack sudo[100107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:03:59 devstack sudo[100098]: pam_unix(sudo:session): session closed for user root Sep 17 22:03:59 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-43174e47-1e11-4f68-a35a-138b20ffb87d tempest-VolumesSnapshotTestJSON-1092695371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-db8e1a8f-f5f7-4a60-a0b0-c352da13d12c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-db8e1a8f-f5f7-4a60-a0b0-c352da13d12c.a73133c4-93c1-40fc-9ad9-444c7c1a2a2f 1G" returned: 0 in 0.587s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:03:59 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-43174e47-1e11-4f68-a35a-138b20ffb87d tempest-VolumesSnapshotTestJSON-1092695371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db8e1a8f-f5f7-4a60-a0b0-c352da13d12c -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-db8e1a8f-f5f7-4a60-a0b0-c352da13d12c.a73133c4-93c1-40fc-9ad9-444c7c1a2a2f {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:03:59 devstack sudo[100112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db8e1a8f-f5f7-4a60-a0b0-c352da13d12c -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-db8e1a8f-f5f7-4a60-a0b0-c352da13d12c.a73133c4-93c1-40fc-9ad9-444c7c1a2a2f Sep 17 22:03:59 devstack sudo[100112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:03:59 devstack sudo[100107]: pam_unix(sudo:session): session closed for user root Sep 17 22:03:59 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-695c3e7e-d314-47ba-8fb9-6d2e8b06b6e0 tempest-VolumesSnapshotListTestJSON-444050519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7ff93e3f-42c4-4399-a4bc-3c9ae073e450.b7629eb1-b52c-4a16-969a-c34516a9fcfb" returned: 0 in 0.378s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:03:59 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-695c3e7e-d314-47ba-8fb9-6d2e8b06b6e0 tempest-VolumesSnapshotListTestJSON-444050519 None] Lock "cinder-quobyte-b7629eb1-b52c-4a16-969a-c34516a9fcfb" released by "_delete_snapshot" :: held 1.971s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:03:59 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-695c3e7e-d314-47ba-8fb9-6d2e8b06b6e0 tempest-VolumesSnapshotListTestJSON-444050519 None] Lock "cinder-quobyte-7ff93e3f-42c4-4399-a4bc-3c9ae073e450" released by "delete_snapshot" :: held 1.998s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:03:59 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-695c3e7e-d314-47ba-8fb9-6d2e8b06b6e0 tempest-VolumesSnapshotListTestJSON-444050519 None] Created reservations ['b40fc65c-1af8-4a43-a034-858a8de8c264', 'f5b9b9ac-26ef-45a4-856c-751e84c3e98b', '4e71fece-c8c5-4c69-9546-35c5b7ce1463', '539b506b-faaa-4e5d-bd1e-6edbdcf86e59'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:03:59 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-695c3e7e-d314-47ba-8fb9-6d2e8b06b6e0 tempest-VolumesSnapshotListTestJSON-444050519 None] Delete snapshot completed successfully. Sep 17 22:03:59 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-695c3e7e-d314-47ba-8fb9-6d2e8b06b6e0 tempest-VolumesSnapshotListTestJSON-444050519 None] Lock "cinder-b7629eb1-b52c-4a16-969a-c34516a9fcfb-delete_snapshot" released by "delete_snapshot" :: held 2.209s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:03:59 devstack sudo[100112]: pam_unix(sudo:session): session closed for user root Sep 17 22:03:59 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-43174e47-1e11-4f68-a35a-138b20ffb87d tempest-VolumesSnapshotTestJSON-1092695371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db8e1a8f-f5f7-4a60-a0b0-c352da13d12c -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-db8e1a8f-f5f7-4a60-a0b0-c352da13d12c.a73133c4-93c1-40fc-9ad9-444c7c1a2a2f" returned: 0 in 0.372s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:03:59 devstack cinder-volume[85458]: WARNING cinder.volume.drivers.remotefs [None req-43174e47-1e11-4f68-a35a-138b20ffb87d tempest-VolumesSnapshotTestJSON-1092695371 None] /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-db8e1a8f-f5f7-4a60-a0b0-c352da13d12c.a73133c4-93c1-40fc-9ad9-444c7c1a2a2f is being set with open permissions: ugo+rw Sep 17 22:03:59 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-43174e47-1e11-4f68-a35a-138b20ffb87d tempest-VolumesSnapshotTestJSON-1092695371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-db8e1a8f-f5f7-4a60-a0b0-c352da13d12c.a73133c4-93c1-40fc-9ad9-444c7c1a2a2f {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:04:00 devstack sudo[100118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-db8e1a8f-f5f7-4a60-a0b0-c352da13d12c.a73133c4-93c1-40fc-9ad9-444c7c1a2a2f Sep 17 22:04:00 devstack sudo[100118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:04:00 devstack sudo[100118]: pam_unix(sudo:session): session closed for user root Sep 17 22:04:00 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-43174e47-1e11-4f68-a35a-138b20ffb87d tempest-VolumesSnapshotTestJSON-1092695371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-db8e1a8f-f5f7-4a60-a0b0-c352da13d12c.a73133c4-93c1-40fc-9ad9-444c7c1a2a2f" returned: 0 in 0.286s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:04:00 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-43174e47-1e11-4f68-a35a-138b20ffb87d tempest-VolumesSnapshotTestJSON-1092695371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-db8e1a8f-f5f7-4a60-a0b0-c352da13d12c.info {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:04:00 devstack sudo[100125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-db8e1a8f-f5f7-4a60-a0b0-c352da13d12c.info Sep 17 22:04:00 devstack sudo[100125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:04:00 devstack sudo[100125]: pam_unix(sudo:session): session closed for user root Sep 17 22:04:00 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-43174e47-1e11-4f68-a35a-138b20ffb87d tempest-VolumesSnapshotTestJSON-1092695371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-db8e1a8f-f5f7-4a60-a0b0-c352da13d12c.info" returned: 0 in 0.307s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:04:00 devstack cinder-volume[85458]: WARNING cinder.volume.drivers.remotefs [None req-43174e47-1e11-4f68-a35a-138b20ffb87d tempest-VolumesSnapshotTestJSON-1092695371 None] /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-db8e1a8f-f5f7-4a60-a0b0-c352da13d12c.info is being set with open permissions: ugo+rw Sep 17 22:04:00 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-43174e47-1e11-4f68-a35a-138b20ffb87d tempest-VolumesSnapshotTestJSON-1092695371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-db8e1a8f-f5f7-4a60-a0b0-c352da13d12c.info {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:04:00 devstack sudo[100128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-db8e1a8f-f5f7-4a60-a0b0-c352da13d12c.info Sep 17 22:04:00 devstack sudo[100128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:04:00 devstack sudo[100128]: pam_unix(sudo:session): session closed for user root Sep 17 22:04:00 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-43174e47-1e11-4f68-a35a-138b20ffb87d tempest-VolumesSnapshotTestJSON-1092695371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-db8e1a8f-f5f7-4a60-a0b0-c352da13d12c.info" returned: 0 in 0.334s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:04:00 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-43174e47-1e11-4f68-a35a-138b20ffb87d tempest-VolumesSnapshotTestJSON-1092695371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.434s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:04:00 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-eeca38d8-98e8-450c-837c-e1a17f29105f tempest-VolumesSnapshotListTestJSON-444050519 None] Acquiring lock "cinder-a5bbcf3c-1ff2-4e7a-9ba1-81cc3ac703d4-delete_snapshot" by "delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:04:01 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-eeca38d8-98e8-450c-837c-e1a17f29105f tempest-VolumesSnapshotListTestJSON-444050519 None] Lock "cinder-a5bbcf3c-1ff2-4e7a-9ba1-81cc3ac703d4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.049s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:04:01 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-eeca38d8-98e8-450c-837c-e1a17f29105f tempest-VolumesSnapshotListTestJSON-444050519 None] Acquiring lock "cinder-quobyte-7ff93e3f-42c4-4399-a4bc-3c9ae073e450" by "delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:04:01 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-eeca38d8-98e8-450c-837c-e1a17f29105f tempest-VolumesSnapshotListTestJSON-444050519 None] Lock "cinder-quobyte-7ff93e3f-42c4-4399-a4bc-3c9ae073e450" acquired by "delete_snapshot" :: waited 0.026s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:04:01 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-eeca38d8-98e8-450c-837c-e1a17f29105f tempest-VolumesSnapshotListTestJSON-444050519 None] Acquiring lock "cinder-quobyte-a5bbcf3c-1ff2-4e7a-9ba1-81cc3ac703d4" by "_delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:04:01 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-eeca38d8-98e8-450c-837c-e1a17f29105f tempest-VolumesSnapshotListTestJSON-444050519 None] Lock "cinder-quobyte-a5bbcf3c-1ff2-4e7a-9ba1-81cc3ac703d4" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:04:01 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-eeca38d8-98e8-450c-837c-e1a17f29105f tempest-VolumesSnapshotListTestJSON-444050519 None] Deleting offline snapshot a5bbcf3c-1ff2-4e7a-9ba1-81cc3ac703d4 of volume 7ff93e3f-42c4-4399-a4bc-3c9ae073e450 {{(pid=85458) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 22:04:01 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-eeca38d8-98e8-450c-837c-e1a17f29105f tempest-VolumesSnapshotListTestJSON-444050519 None] snapshot_file for this snap is: volume-7ff93e3f-42c4-4399-a4bc-3c9ae073e450.a5bbcf3c-1ff2-4e7a-9ba1-81cc3ac703d4 {{(pid=85458) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 22:04:01 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-43174e47-1e11-4f68-a35a-138b20ffb87d tempest-VolumesSnapshotTestJSON-1092695371 None] Create snapshot completed successfully Sep 17 22:04:01 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ea89dc6-ed67-4ce2-b15b-5b5659aaf0b9]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:04:01 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-eeca38d8-98e8-450c-837c-e1a17f29105f tempest-VolumesSnapshotListTestJSON-444050519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7ff93e3f-42c4-4399-a4bc-3c9ae073e450.a5bbcf3c-1ff2-4e7a-9ba1-81cc3ac703d4 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:04:01 devstack sudo[100147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7ff93e3f-42c4-4399-a4bc-3c9ae073e450.a5bbcf3c-1ff2-4e7a-9ba1-81cc3ac703d4 Sep 17 22:04:01 devstack sudo[100147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:04:01 devstack sudo[100147]: pam_unix(sudo:session): session closed for user root Sep 17 22:04:01 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-eeca38d8-98e8-450c-837c-e1a17f29105f tempest-VolumesSnapshotListTestJSON-444050519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7ff93e3f-42c4-4399-a4bc-3c9ae073e450.a5bbcf3c-1ff2-4e7a-9ba1-81cc3ac703d4" returned: 0 in 0.445s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:04:01 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-eeca38d8-98e8-450c-837c-e1a17f29105f tempest-VolumesSnapshotListTestJSON-444050519 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ff93e3f-42c4-4399-a4bc-3c9ae073e450(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85458) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 22:04:01 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[86e7382e-c6f2-47f6-8394-7f0062647463]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:04:01 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-eeca38d8-98e8-450c-837c-e1a17f29105f tempest-VolumesSnapshotListTestJSON-444050519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7ff93e3f-42c4-4399-a4bc-3c9ae073e450.32e9696c-5dfd-4bb5-90d5-8f85dc96d6c5 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:04:01 devstack sudo[100157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7ff93e3f-42c4-4399-a4bc-3c9ae073e450.32e9696c-5dfd-4bb5-90d5-8f85dc96d6c5 Sep 17 22:04:01 devstack sudo[100157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:04:01 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-6681fb01-682a-4a70-bf4a-07bf0b8f5895 tempest-VolumesSnapshotTestJSON-1092695371 None] Acquiring lock "cinder-a73133c4-93c1-40fc-9ad9-444c7c1a2a2f-delete_snapshot" by "delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:04:01 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-6681fb01-682a-4a70-bf4a-07bf0b8f5895 tempest-VolumesSnapshotTestJSON-1092695371 None] Lock "cinder-a73133c4-93c1-40fc-9ad9-444c7c1a2a2f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:04:01 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-6681fb01-682a-4a70-bf4a-07bf0b8f5895 tempest-VolumesSnapshotTestJSON-1092695371 None] Acquiring lock "cinder-quobyte-db8e1a8f-f5f7-4a60-a0b0-c352da13d12c" by "delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:04:01 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-6681fb01-682a-4a70-bf4a-07bf0b8f5895 tempest-VolumesSnapshotTestJSON-1092695371 None] Lock "cinder-quobyte-db8e1a8f-f5f7-4a60-a0b0-c352da13d12c" acquired by "delete_snapshot" :: waited 0.019s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:04:01 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-6681fb01-682a-4a70-bf4a-07bf0b8f5895 tempest-VolumesSnapshotTestJSON-1092695371 None] Acquiring lock "cinder-quobyte-a73133c4-93c1-40fc-9ad9-444c7c1a2a2f" by "_delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:04:01 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-6681fb01-682a-4a70-bf4a-07bf0b8f5895 tempest-VolumesSnapshotTestJSON-1092695371 None] Lock "cinder-quobyte-a73133c4-93c1-40fc-9ad9-444c7c1a2a2f" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:04:01 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-6681fb01-682a-4a70-bf4a-07bf0b8f5895 tempest-VolumesSnapshotTestJSON-1092695371 None] Deleting offline snapshot a73133c4-93c1-40fc-9ad9-444c7c1a2a2f of volume db8e1a8f-f5f7-4a60-a0b0-c352da13d12c {{(pid=85458) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 22:04:02 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-6681fb01-682a-4a70-bf4a-07bf0b8f5895 tempest-VolumesSnapshotTestJSON-1092695371 None] snapshot_file for this snap is: volume-db8e1a8f-f5f7-4a60-a0b0-c352da13d12c.a73133c4-93c1-40fc-9ad9-444c7c1a2a2f {{(pid=85458) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 22:04:02 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3be317f-d12c-4562-84b1-7b2a271c0495]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:04:02 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-6681fb01-682a-4a70-bf4a-07bf0b8f5895 tempest-VolumesSnapshotTestJSON-1092695371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-db8e1a8f-f5f7-4a60-a0b0-c352da13d12c.a73133c4-93c1-40fc-9ad9-444c7c1a2a2f {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:04:02 devstack sudo[100157]: pam_unix(sudo:session): session closed for user root Sep 17 22:04:02 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-eeca38d8-98e8-450c-837c-e1a17f29105f tempest-VolumesSnapshotListTestJSON-444050519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7ff93e3f-42c4-4399-a4bc-3c9ae073e450.32e9696c-5dfd-4bb5-90d5-8f85dc96d6c5" returned: 0 in 0.526s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:04:02 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-eeca38d8-98e8-450c-837c-e1a17f29105f tempest-VolumesSnapshotListTestJSON-444050519 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ff93e3f-42c4-4399-a4bc-3c9ae073e450(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85458) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 22:04:02 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-eeca38d8-98e8-450c-837c-e1a17f29105f tempest-VolumesSnapshotListTestJSON-444050519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7ff93e3f-42c4-4399-a4bc-3c9ae073e450.a5bbcf3c-1ff2-4e7a-9ba1-81cc3ac703d4 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:04:02 devstack sudo[100165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7ff93e3f-42c4-4399-a4bc-3c9ae073e450.a5bbcf3c-1ff2-4e7a-9ba1-81cc3ac703d4 Sep 17 22:04:02 devstack sudo[100165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:04:02 devstack sudo[100161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-db8e1a8f-f5f7-4a60-a0b0-c352da13d12c.a73133c4-93c1-40fc-9ad9-444c7c1a2a2f Sep 17 22:04:02 devstack sudo[100161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:04:02 devstack sudo[100161]: pam_unix(sudo:session): session closed for user root Sep 17 22:04:02 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-6681fb01-682a-4a70-bf4a-07bf0b8f5895 tempest-VolumesSnapshotTestJSON-1092695371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-db8e1a8f-f5f7-4a60-a0b0-c352da13d12c.a73133c4-93c1-40fc-9ad9-444c7c1a2a2f" returned: 0 in 0.622s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:04:02 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-6681fb01-682a-4a70-bf4a-07bf0b8f5895 tempest-VolumesSnapshotTestJSON-1092695371 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-db8e1a8f-f5f7-4a60-a0b0-c352da13d12c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85458) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 22:04:02 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[c28bcda3-9bb3-4638-88a7-b080a11b5d8c]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:04:02 devstack sudo[100165]: pam_unix(sudo:session): session closed for user root Sep 17 22:04:02 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-6681fb01-682a-4a70-bf4a-07bf0b8f5895 tempest-VolumesSnapshotTestJSON-1092695371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-db8e1a8f-f5f7-4a60-a0b0-c352da13d12c {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:04:02 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-eeca38d8-98e8-450c-837c-e1a17f29105f tempest-VolumesSnapshotListTestJSON-444050519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7ff93e3f-42c4-4399-a4bc-3c9ae073e450.a5bbcf3c-1ff2-4e7a-9ba1-81cc3ac703d4" returned: 0 in 0.592s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:04:02 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-eeca38d8-98e8-450c-837c-e1a17f29105f tempest-VolumesSnapshotListTestJSON-444050519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7ff93e3f-42c4-4399-a4bc-3c9ae073e450.a5bbcf3c-1ff2-4e7a-9ba1-81cc3ac703d4 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:04:02 devstack sudo[100178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7ff93e3f-42c4-4399-a4bc-3c9ae073e450.a5bbcf3c-1ff2-4e7a-9ba1-81cc3ac703d4 Sep 17 22:04:02 devstack sudo[100178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:04:02 devstack sudo[100177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-db8e1a8f-f5f7-4a60-a0b0-c352da13d12c Sep 17 22:04:02 devstack sudo[100177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:04:03 devstack sudo[100178]: pam_unix(sudo:session): session closed for user root Sep 17 22:04:03 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-eeca38d8-98e8-450c-837c-e1a17f29105f tempest-VolumesSnapshotListTestJSON-444050519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7ff93e3f-42c4-4399-a4bc-3c9ae073e450.a5bbcf3c-1ff2-4e7a-9ba1-81cc3ac703d4" returned: 0 in 0.359s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:04:03 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-eeca38d8-98e8-450c-837c-e1a17f29105f tempest-VolumesSnapshotListTestJSON-444050519 None] Lock "cinder-quobyte-a5bbcf3c-1ff2-4e7a-9ba1-81cc3ac703d4" released by "_delete_snapshot" :: held 2.087s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:04:03 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-eeca38d8-98e8-450c-837c-e1a17f29105f tempest-VolumesSnapshotListTestJSON-444050519 None] Lock "cinder-quobyte-7ff93e3f-42c4-4399-a4bc-3c9ae073e450" released by "delete_snapshot" :: held 2.118s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:04:03 devstack sudo[100177]: pam_unix(sudo:session): session closed for user root Sep 17 22:04:03 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-6681fb01-682a-4a70-bf4a-07bf0b8f5895 tempest-VolumesSnapshotTestJSON-1092695371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-db8e1a8f-f5f7-4a60-a0b0-c352da13d12c" returned: 0 in 0.488s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:04:03 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-6681fb01-682a-4a70-bf4a-07bf0b8f5895 tempest-VolumesSnapshotTestJSON-1092695371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-db8e1a8f-f5f7-4a60-a0b0-c352da13d12c.a73133c4-93c1-40fc-9ad9-444c7c1a2a2f {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:04:03 devstack sudo[100185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-db8e1a8f-f5f7-4a60-a0b0-c352da13d12c.a73133c4-93c1-40fc-9ad9-444c7c1a2a2f Sep 17 22:04:03 devstack sudo[100185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:04:03 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-eeca38d8-98e8-450c-837c-e1a17f29105f tempest-VolumesSnapshotListTestJSON-444050519 None] Created reservations ['fae5bc5e-53a6-4ee0-8194-e5e1cf6f6e68', 'd92d87d0-0834-4456-8dc4-2d797e2ef593', 'f204348f-7e8b-4089-b702-c51e03acb52d', '1040ffbd-2f51-46b4-af6d-d5896c47d9e5'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:04:03 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-eeca38d8-98e8-450c-837c-e1a17f29105f tempest-VolumesSnapshotListTestJSON-444050519 None] Delete snapshot completed successfully. Sep 17 22:04:03 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-eeca38d8-98e8-450c-837c-e1a17f29105f tempest-VolumesSnapshotListTestJSON-444050519 None] Lock "cinder-a5bbcf3c-1ff2-4e7a-9ba1-81cc3ac703d4-delete_snapshot" released by "delete_snapshot" :: held 2.375s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:04:03 devstack sudo[100185]: pam_unix(sudo:session): session closed for user root Sep 17 22:04:03 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-6681fb01-682a-4a70-bf4a-07bf0b8f5895 tempest-VolumesSnapshotTestJSON-1092695371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-db8e1a8f-f5f7-4a60-a0b0-c352da13d12c.a73133c4-93c1-40fc-9ad9-444c7c1a2a2f" returned: 0 in 0.492s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:04:03 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-6681fb01-682a-4a70-bf4a-07bf0b8f5895 tempest-VolumesSnapshotTestJSON-1092695371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-db8e1a8f-f5f7-4a60-a0b0-c352da13d12c.a73133c4-93c1-40fc-9ad9-444c7c1a2a2f {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:04:03 devstack sudo[100191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-db8e1a8f-f5f7-4a60-a0b0-c352da13d12c.a73133c4-93c1-40fc-9ad9-444c7c1a2a2f Sep 17 22:04:03 devstack sudo[100191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:04:04 devstack sudo[100191]: pam_unix(sudo:session): session closed for user root Sep 17 22:04:04 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-6681fb01-682a-4a70-bf4a-07bf0b8f5895 tempest-VolumesSnapshotTestJSON-1092695371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-db8e1a8f-f5f7-4a60-a0b0-c352da13d12c.a73133c4-93c1-40fc-9ad9-444c7c1a2a2f" returned: 0 in 0.297s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:04:04 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-6681fb01-682a-4a70-bf4a-07bf0b8f5895 tempest-VolumesSnapshotTestJSON-1092695371 None] Lock "cinder-quobyte-a73133c4-93c1-40fc-9ad9-444c7c1a2a2f" released by "_delete_snapshot" :: held 2.098s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:04:04 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-6681fb01-682a-4a70-bf4a-07bf0b8f5895 tempest-VolumesSnapshotTestJSON-1092695371 None] Lock "cinder-quobyte-db8e1a8f-f5f7-4a60-a0b0-c352da13d12c" released by "delete_snapshot" :: held 2.130s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:04:04 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-6681fb01-682a-4a70-bf4a-07bf0b8f5895 tempest-VolumesSnapshotTestJSON-1092695371 None] Created reservations ['be6c43d7-9040-41e5-88d5-1c31610052c1', '034bd928-069b-4801-a08f-7e80916b73aa', '88802b0b-d29b-4b57-a75c-bf8802a0248c', '94f52aeb-119e-4d2c-a2a3-ec6765cae3e0'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:04:04 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-178d9bb3-0253-4a45-9d16-6c40bba257cd tempest-VolumesSnapshotListTestJSON-444050519 None] Acquiring lock "cinder-32e9696c-5dfd-4bb5-90d5-8f85dc96d6c5-delete_snapshot" by "delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:04:04 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-178d9bb3-0253-4a45-9d16-6c40bba257cd tempest-VolumesSnapshotListTestJSON-444050519 None] Lock "cinder-32e9696c-5dfd-4bb5-90d5-8f85dc96d6c5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:04:04 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-178d9bb3-0253-4a45-9d16-6c40bba257cd tempest-VolumesSnapshotListTestJSON-444050519 None] Acquiring lock "cinder-quobyte-7ff93e3f-42c4-4399-a4bc-3c9ae073e450" by "delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:04:04 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-6681fb01-682a-4a70-bf4a-07bf0b8f5895 tempest-VolumesSnapshotTestJSON-1092695371 None] Delete snapshot completed successfully. Sep 17 22:04:04 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-6681fb01-682a-4a70-bf4a-07bf0b8f5895 tempest-VolumesSnapshotTestJSON-1092695371 None] Lock "cinder-a73133c4-93c1-40fc-9ad9-444c7c1a2a2f-delete_snapshot" released by "delete_snapshot" :: held 2.400s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:04:04 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-178d9bb3-0253-4a45-9d16-6c40bba257cd tempest-VolumesSnapshotListTestJSON-444050519 None] Lock "cinder-quobyte-7ff93e3f-42c4-4399-a4bc-3c9ae073e450" acquired by "delete_snapshot" :: waited 0.033s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:04:04 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-178d9bb3-0253-4a45-9d16-6c40bba257cd tempest-VolumesSnapshotListTestJSON-444050519 None] Acquiring lock "cinder-quobyte-32e9696c-5dfd-4bb5-90d5-8f85dc96d6c5" by "_delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:04:04 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-178d9bb3-0253-4a45-9d16-6c40bba257cd tempest-VolumesSnapshotListTestJSON-444050519 None] Lock "cinder-quobyte-32e9696c-5dfd-4bb5-90d5-8f85dc96d6c5" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:04:04 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-178d9bb3-0253-4a45-9d16-6c40bba257cd tempest-VolumesSnapshotListTestJSON-444050519 None] Deleting offline snapshot 32e9696c-5dfd-4bb5-90d5-8f85dc96d6c5 of volume 7ff93e3f-42c4-4399-a4bc-3c9ae073e450 {{(pid=85458) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 22:04:04 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-178d9bb3-0253-4a45-9d16-6c40bba257cd tempest-VolumesSnapshotListTestJSON-444050519 None] snapshot_file for this snap is: volume-7ff93e3f-42c4-4399-a4bc-3c9ae073e450.32e9696c-5dfd-4bb5-90d5-8f85dc96d6c5 {{(pid=85458) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 22:04:04 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[8102ce81-004e-4488-bf31-8b0343313c31]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:04:04 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-178d9bb3-0253-4a45-9d16-6c40bba257cd tempest-VolumesSnapshotListTestJSON-444050519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7ff93e3f-42c4-4399-a4bc-3c9ae073e450.32e9696c-5dfd-4bb5-90d5-8f85dc96d6c5 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:04:04 devstack sudo[100194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7ff93e3f-42c4-4399-a4bc-3c9ae073e450.32e9696c-5dfd-4bb5-90d5-8f85dc96d6c5 Sep 17 22:04:04 devstack sudo[100194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:04:04 devstack sudo[100194]: pam_unix(sudo:session): session closed for user root Sep 17 22:04:04 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-178d9bb3-0253-4a45-9d16-6c40bba257cd tempest-VolumesSnapshotListTestJSON-444050519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7ff93e3f-42c4-4399-a4bc-3c9ae073e450.32e9696c-5dfd-4bb5-90d5-8f85dc96d6c5" returned: 0 in 0.528s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:04:04 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-178d9bb3-0253-4a45-9d16-6c40bba257cd tempest-VolumesSnapshotListTestJSON-444050519 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ff93e3f-42c4-4399-a4bc-3c9ae073e450(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85458) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 22:04:05 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[e19bc7eb-972b-4459-afb4-5dd61252989f]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:04:05 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-178d9bb3-0253-4a45-9d16-6c40bba257cd tempest-VolumesSnapshotListTestJSON-444050519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7ff93e3f-42c4-4399-a4bc-3c9ae073e450 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:04:05 devstack sudo[100199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7ff93e3f-42c4-4399-a4bc-3c9ae073e450 Sep 17 22:04:05 devstack sudo[100199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:04:05 devstack sudo[100199]: pam_unix(sudo:session): session closed for user root Sep 17 22:04:05 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-178d9bb3-0253-4a45-9d16-6c40bba257cd tempest-VolumesSnapshotListTestJSON-444050519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7ff93e3f-42c4-4399-a4bc-3c9ae073e450" returned: 0 in 0.582s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:04:05 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-178d9bb3-0253-4a45-9d16-6c40bba257cd tempest-VolumesSnapshotListTestJSON-444050519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7ff93e3f-42c4-4399-a4bc-3c9ae073e450.32e9696c-5dfd-4bb5-90d5-8f85dc96d6c5 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:04:05 devstack sudo[100204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7ff93e3f-42c4-4399-a4bc-3c9ae073e450.32e9696c-5dfd-4bb5-90d5-8f85dc96d6c5 Sep 17 22:04:05 devstack sudo[100204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:04:06 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-35c8d7c7-f646-4545-baaa-7371ab771985 tempest-VolumesSnapshotTestJSON-1092695371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 22:04:06 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-35c8d7c7-f646-4545-baaa-7371ab771985 tempest-VolumesSnapshotTestJSON-1092695371 None] Flow 'volume_create_manager' (d47dd32d-a44f-429b-8d94-6405481b8934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:04:06 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-35c8d7c7-f646-4545-baaa-7371ab771985 tempest-VolumesSnapshotTestJSON-1092695371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90ae4ea5-215b-48b6-bcdb-5c4a4550b9d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:04:06 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-35c8d7c7-f646-4545-baaa-7371ab771985 tempest-VolumesSnapshotTestJSON-1092695371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90ae4ea5-215b-48b6-bcdb-5c4a4550b9d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:04:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-559363663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c50689db-ee80-4498-83ea-3c3ffecb6aba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06cd571a5b3a4923912443d726b16adb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:04:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:04:06Z,use_quota=True,user_id='53305d3d19814893af8139460c405901',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:04:06 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-35c8d7c7-f646-4545-baaa-7371ab771985 tempest-VolumesSnapshotTestJSON-1092695371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3311a96-61af-4630-9337-9095d44d8a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:04:06 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-35c8d7c7-f646-4545-baaa-7371ab771985 tempest-VolumesSnapshotTestJSON-1092695371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3311a96-61af-4630-9337-9095d44d8a53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:04:06 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-35c8d7c7-f646-4545-baaa-7371ab771985 tempest-VolumesSnapshotTestJSON-1092695371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb56cf05-0a97-4c6e-8b88-4c0d2904d3bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:04:06 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-35c8d7c7-f646-4545-baaa-7371ab771985 tempest-VolumesSnapshotTestJSON-1092695371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb56cf05-0a97-4c6e-8b88-4c0d2904d3bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c50689db-ee80-4498-83ea-3c3ffecb6aba', 'volume_name': 'volume-c50689db-ee80-4498-83ea-3c3ffecb6aba', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:04:06 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-35c8d7c7-f646-4545-baaa-7371ab771985 tempest-VolumesSnapshotTestJSON-1092695371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16307f28-4b0c-457f-818a-fa7e91ba386a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:04:06 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-35c8d7c7-f646-4545-baaa-7371ab771985 tempest-VolumesSnapshotTestJSON-1092695371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16307f28-4b0c-457f-818a-fa7e91ba386a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:04:06 devstack sudo[100204]: pam_unix(sudo:session): session closed for user root Sep 17 22:04:06 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-35c8d7c7-f646-4545-baaa-7371ab771985 tempest-VolumesSnapshotTestJSON-1092695371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f1c183f-b7d3-4dae-85f1-1a646938aaf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:04:06 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-35c8d7c7-f646-4545-baaa-7371ab771985 tempest-VolumesSnapshotTestJSON-1092695371 None] Volume c50689db-ee80-4498-83ea-3c3ffecb6aba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c50689db-ee80-4498-83ea-3c3ffecb6aba', 'volume_size': 1} Sep 17 22:04:06 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-35c8d7c7-f646-4545-baaa-7371ab771985 tempest-VolumesSnapshotTestJSON-1092695371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:04:06 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-35c8d7c7-f646-4545-baaa-7371ab771985 tempest-VolumesSnapshotTestJSON-1092695371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:04:06 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-35c8d7c7-f646-4545-baaa-7371ab771985 tempest-VolumesSnapshotTestJSON-1092695371 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:04:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-559363663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c50689db-ee80-4498-83ea-3c3ffecb6aba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06cd571a5b3a4923912443d726b16adb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:04:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:04:06Z,use_quota=True,user_id='53305d3d19814893af8139460c405901',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 22:04:06 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-35c8d7c7-f646-4545-baaa-7371ab771985 tempest-VolumesSnapshotTestJSON-1092695371 None] Creating volume c50689db-ee80-4498-83ea-3c3ffecb6aba {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 22:04:06 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-35c8d7c7-f646-4545-baaa-7371ab771985 tempest-VolumesSnapshotTestJSON-1092695371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:04:06 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-35c8d7c7-f646-4545-baaa-7371ab771985 tempest-VolumesSnapshotTestJSON-1092695371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:04:06 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-35c8d7c7-f646-4545-baaa-7371ab771985 tempest-VolumesSnapshotTestJSON-1092695371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:04:06 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-35c8d7c7-f646-4545-baaa-7371ab771985 tempest-VolumesSnapshotTestJSON-1092695371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:04:06 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-35c8d7c7-f646-4545-baaa-7371ab771985 tempest-VolumesSnapshotTestJSON-1092695371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:04:06 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-35c8d7c7-f646-4545-baaa-7371ab771985 tempest-VolumesSnapshotTestJSON-1092695371 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 22:04:06 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-35c8d7c7-f646-4545-baaa-7371ab771985 tempest-VolumesSnapshotTestJSON-1092695371 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 22:04:06 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-35c8d7c7-f646-4545-baaa-7371ab771985 tempest-VolumesSnapshotTestJSON-1092695371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c50689db-ee80-4498-83ea-3c3ffecb6aba 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:04:06 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-178d9bb3-0253-4a45-9d16-6c40bba257cd tempest-VolumesSnapshotListTestJSON-444050519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7ff93e3f-42c4-4399-a4bc-3c9ae073e450.32e9696c-5dfd-4bb5-90d5-8f85dc96d6c5" returned: 0 in 0.726s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:04:06 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-178d9bb3-0253-4a45-9d16-6c40bba257cd tempest-VolumesSnapshotListTestJSON-444050519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7ff93e3f-42c4-4399-a4bc-3c9ae073e450.32e9696c-5dfd-4bb5-90d5-8f85dc96d6c5 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:04:06 devstack sudo[100209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c50689db-ee80-4498-83ea-3c3ffecb6aba 1073741824 Sep 17 22:04:06 devstack sudo[100209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:04:06 devstack sudo[100210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7ff93e3f-42c4-4399-a4bc-3c9ae073e450.32e9696c-5dfd-4bb5-90d5-8f85dc96d6c5 Sep 17 22:04:06 devstack sudo[100210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:04:06 devstack sudo[100210]: pam_unix(sudo:session): session closed for user root Sep 17 22:04:06 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-178d9bb3-0253-4a45-9d16-6c40bba257cd tempest-VolumesSnapshotListTestJSON-444050519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7ff93e3f-42c4-4399-a4bc-3c9ae073e450.32e9696c-5dfd-4bb5-90d5-8f85dc96d6c5" returned: 0 in 0.472s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:04:06 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-178d9bb3-0253-4a45-9d16-6c40bba257cd tempest-VolumesSnapshotListTestJSON-444050519 None] Lock "cinder-quobyte-32e9696c-5dfd-4bb5-90d5-8f85dc96d6c5" released by "_delete_snapshot" :: held 2.537s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:04:06 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-178d9bb3-0253-4a45-9d16-6c40bba257cd tempest-VolumesSnapshotListTestJSON-444050519 None] Lock "cinder-quobyte-7ff93e3f-42c4-4399-a4bc-3c9ae073e450" released by "delete_snapshot" :: held 2.577s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:04:06 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-178d9bb3-0253-4a45-9d16-6c40bba257cd tempest-VolumesSnapshotListTestJSON-444050519 None] Created reservations ['a0ca5fb6-4ee3-46fa-a354-695ec1990c64', 'e96b3416-c6c1-4877-983f-79729a8bff9b', 'c52811cb-32ef-4ec4-ac7e-37bd9882c505', '4f734a81-0a42-416d-8a5f-4230f3aa5cdb'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:04:07 devstack sudo[100209]: pam_unix(sudo:session): session closed for user root Sep 17 22:04:07 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-35c8d7c7-f646-4545-baaa-7371ab771985 tempest-VolumesSnapshotTestJSON-1092695371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c50689db-ee80-4498-83ea-3c3ffecb6aba 1073741824" returned: 0 in 0.736s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:04:07 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-178d9bb3-0253-4a45-9d16-6c40bba257cd tempest-VolumesSnapshotListTestJSON-444050519 None] Delete snapshot completed successfully. Sep 17 22:04:07 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-35c8d7c7-f646-4545-baaa-7371ab771985 tempest-VolumesSnapshotTestJSON-1092695371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c50689db-ee80-4498-83ea-3c3ffecb6aba {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:04:07 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-178d9bb3-0253-4a45-9d16-6c40bba257cd tempest-VolumesSnapshotListTestJSON-444050519 None] Lock "cinder-32e9696c-5dfd-4bb5-90d5-8f85dc96d6c5-delete_snapshot" released by "delete_snapshot" :: held 2.877s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:04:07 devstack sudo[100218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c50689db-ee80-4498-83ea-3c3ffecb6aba Sep 17 22:04:07 devstack sudo[100218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:04:07 devstack sudo[100218]: pam_unix(sudo:session): session closed for user root Sep 17 22:04:07 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-35c8d7c7-f646-4545-baaa-7371ab771985 tempest-VolumesSnapshotTestJSON-1092695371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c50689db-ee80-4498-83ea-3c3ffecb6aba" returned: 0 in 0.278s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:04:07 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-35c8d7c7-f646-4545-baaa-7371ab771985 tempest-VolumesSnapshotTestJSON-1092695371 None] <== create_volume: return (1095ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 22:04:07 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-35c8d7c7-f646-4545-baaa-7371ab771985 tempest-VolumesSnapshotTestJSON-1092695371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.098s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:04:07 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-35c8d7c7-f646-4545-baaa-7371ab771985 tempest-VolumesSnapshotTestJSON-1092695371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f1c183f-b7d3-4dae-85f1-1a646938aaf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c50689db-ee80-4498-83ea-3c3ffecb6aba', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:04:07 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-35c8d7c7-f646-4545-baaa-7371ab771985 tempest-VolumesSnapshotTestJSON-1092695371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (306e3278-4a16-432d-9f7a-3a67436f41a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:04:07 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-35c8d7c7-f646-4545-baaa-7371ab771985 tempest-VolumesSnapshotTestJSON-1092695371 None] Volume volume-c50689db-ee80-4498-83ea-3c3ffecb6aba (c50689db-ee80-4498-83ea-3c3ffecb6aba): created successfully Sep 17 22:04:07 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-35c8d7c7-f646-4545-baaa-7371ab771985 tempest-VolumesSnapshotTestJSON-1092695371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (306e3278-4a16-432d-9f7a-3a67436f41a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:04:07 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-35c8d7c7-f646-4545-baaa-7371ab771985 tempest-VolumesSnapshotTestJSON-1092695371 None] Flow 'volume_create_manager' (d47dd32d-a44f-429b-8d94-6405481b8934) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:04:07 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-35c8d7c7-f646-4545-baaa-7371ab771985 tempest-VolumesSnapshotTestJSON-1092695371 None] Created volume successfully. Sep 17 22:04:07 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-1dbacd2d-60f4-4011-a7ea-352014658247 tempest-VolumesSnapshotListTestJSON-444050519 None] Acquiring lock "cinder-7ff93e3f-42c4-4399-a4bc-3c9ae073e450-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:04:07 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-1dbacd2d-60f4-4011-a7ea-352014658247 tempest-VolumesSnapshotListTestJSON-444050519 None] Lock "cinder-7ff93e3f-42c4-4399-a4bc-3c9ae073e450-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:04:07 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-1dbacd2d-60f4-4011-a7ea-352014658247 tempest-VolumesSnapshotListTestJSON-444050519 None] Acquiring lock "cinder-quobyte-7ff93e3f-42c4-4399-a4bc-3c9ae073e450" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:04:07 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-1dbacd2d-60f4-4011-a7ea-352014658247 tempest-VolumesSnapshotListTestJSON-444050519 None] Lock "cinder-quobyte-7ff93e3f-42c4-4399-a4bc-3c9ae073e450" acquired by "delete_volume" :: waited 0.022s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:04:07 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[f31e44c8-8b60-4041-8ec6-3d730125a73d]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:04:07 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-1dbacd2d-60f4-4011-a7ea-352014658247 tempest-VolumesSnapshotListTestJSON-444050519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7ff93e3f-42c4-4399-a4bc-3c9ae073e450 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:04:07 devstack sudo[100221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7ff93e3f-42c4-4399-a4bc-3c9ae073e450 Sep 17 22:04:07 devstack sudo[100221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:04:08 devstack sudo[100221]: pam_unix(sudo:session): session closed for user root Sep 17 22:04:08 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-1dbacd2d-60f4-4011-a7ea-352014658247 tempest-VolumesSnapshotListTestJSON-444050519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7ff93e3f-42c4-4399-a4bc-3c9ae073e450" returned: 0 in 0.423s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:04:08 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-1dbacd2d-60f4-4011-a7ea-352014658247 tempest-VolumesSnapshotListTestJSON-444050519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7ff93e3f-42c4-4399-a4bc-3c9ae073e450 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:04:08 devstack sudo[100227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7ff93e3f-42c4-4399-a4bc-3c9ae073e450 Sep 17 22:04:08 devstack sudo[100227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:04:08 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-80c08f1e-5580-4392-b1a4-76857c4a2034 tempest-VolumesSnapshotTestJSON-1092695371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:04:08 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-80c08f1e-5580-4392-b1a4-76857c4a2034 tempest-VolumesSnapshotTestJSON-1092695371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:04:08 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-80c08f1e-5580-4392-b1a4-76857c4a2034 tempest-VolumesSnapshotTestJSON-1092695371 None] Creating offline snapshot f5e8364c-b262-4223-9a84-57778b3188a7 of volume c50689db-ee80-4498-83ea-3c3ffecb6aba {{(pid=85458) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 22:04:08 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9fd1b40-62af-4be9-abb4-002dacd188b1]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:04:08 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-80c08f1e-5580-4392-b1a4-76857c4a2034 tempest-VolumesSnapshotTestJSON-1092695371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c50689db-ee80-4498-83ea-3c3ffecb6aba {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:04:08 devstack sudo[100227]: pam_unix(sudo:session): session closed for user root Sep 17 22:04:08 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-1dbacd2d-60f4-4011-a7ea-352014658247 tempest-VolumesSnapshotListTestJSON-444050519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7ff93e3f-42c4-4399-a4bc-3c9ae073e450" returned: 0 in 0.389s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:04:08 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-1dbacd2d-60f4-4011-a7ea-352014658247 tempest-VolumesSnapshotListTestJSON-444050519 None] Lock "cinder-quobyte-7ff93e3f-42c4-4399-a4bc-3c9ae073e450" released by "delete_volume" :: held 0.910s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:04:08 devstack sudo[100230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c50689db-ee80-4498-83ea-3c3ffecb6aba Sep 17 22:04:08 devstack sudo[100230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:04:08 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-1dbacd2d-60f4-4011-a7ea-352014658247 tempest-VolumesSnapshotListTestJSON-444050519 None] Created reservations ['3481d2a6-d75d-4828-ba87-cb1f71cc833c', 'bd8d06c4-a034-4ba9-93de-329f30200740', '8edfa6e8-f72f-45d3-ae5f-81853153c7b7', 'cca8821b-4c12-4418-abcb-4d3850ebbd87'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:04:08 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-46bf2a82-252e-46c7-b615-540535cca953 tempest-VolumeAndVolumeTypeFromImageTest-891514539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 22:04:08 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-46bf2a82-252e-46c7-b615-540535cca953 tempest-VolumeAndVolumeTypeFromImageTest-891514539 None] Flow 'volume_create_manager' (7908425c-8829-4e94-b446-d94fb166dce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:04:08 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-46bf2a82-252e-46c7-b615-540535cca953 tempest-VolumeAndVolumeTypeFromImageTest-891514539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a7810aa-1c9a-4045-b9be-1405a53ed266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:04:08 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-46bf2a82-252e-46c7-b615-540535cca953 tempest-VolumeAndVolumeTypeFromImageTest-891514539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a7810aa-1c9a-4045-b9be-1405a53ed266) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:04:08Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f3c33fd-0f0a-4ef3-bc80-1bbf5092b2c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='827a1743c94e412388f919e9a4df21ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:04:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:04:09Z,use_quota=True,user_id='6a92ebacb6094e6ea9031b6531fea68e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0bdcde9a-5f84-47bd-8036-e0519aebad6d),volume_type_id=0bdcde9a-5f84-47bd-8036-e0519aebad6d)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:04:08 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-46bf2a82-252e-46c7-b615-540535cca953 tempest-VolumeAndVolumeTypeFromImageTest-891514539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (185bc6aa-9f80-4ea8-8fdb-4a02d2b2bf2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:04:08 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-46bf2a82-252e-46c7-b615-540535cca953 tempest-VolumeAndVolumeTypeFromImageTest-891514539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (185bc6aa-9f80-4ea8-8fdb-4a02d2b2bf2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:04:08 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-46bf2a82-252e-46c7-b615-540535cca953 tempest-VolumeAndVolumeTypeFromImageTest-891514539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05f07976-e441-4205-b871-1c1cd76735cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:04:08 devstack cinder-volume[85458]: DEBUG cinder.image.glance [None req-46bf2a82-252e-46c7-b615-540535cca953 tempest-VolumeAndVolumeTypeFromImageTest-891514539 None] Creating Keystone auth plugin from conf {{(pid=85458) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 17 22:04:08 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-1dbacd2d-60f4-4011-a7ea-352014658247 tempest-VolumesSnapshotListTestJSON-444050519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:04:08 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-1dbacd2d-60f4-4011-a7ea-352014658247 tempest-VolumesSnapshotListTestJSON-444050519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:04:08 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-1dbacd2d-60f4-4011-a7ea-352014658247 tempest-VolumesSnapshotListTestJSON-444050519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:04:08 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-1dbacd2d-60f4-4011-a7ea-352014658247 tempest-VolumesSnapshotListTestJSON-444050519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:04:08 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-1dbacd2d-60f4-4011-a7ea-352014658247 tempest-VolumesSnapshotListTestJSON-444050519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:04:08 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-1dbacd2d-60f4-4011-a7ea-352014658247 tempest-VolumesSnapshotListTestJSON-444050519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:04:08 devstack sudo[100235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:04:08 devstack sudo[100235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:04:08 devstack sudo[100230]: pam_unix(sudo:session): session closed for user root Sep 17 22:04:08 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-80c08f1e-5580-4392-b1a4-76857c4a2034 tempest-VolumesSnapshotTestJSON-1092695371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c50689db-ee80-4498-83ea-3c3ffecb6aba" returned: 0 in 0.479s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:04:08 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-80c08f1e-5580-4392-b1a4-76857c4a2034 tempest-VolumesSnapshotTestJSON-1092695371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c50689db-ee80-4498-83ea-3c3ffecb6aba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c50689db-ee80-4498-83ea-3c3ffecb6aba.f5e8364c-b262-4223-9a84-57778b3188a7 1G {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:04:08 devstack sudo[100237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c50689db-ee80-4498-83ea-3c3ffecb6aba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c50689db-ee80-4498-83ea-3c3ffecb6aba.f5e8364c-b262-4223-9a84-57778b3188a7 1G Sep 17 22:04:08 devstack sudo[100237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:04:09 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-46bf2a82-252e-46c7-b615-540535cca953 tempest-VolumeAndVolumeTypeFromImageTest-891514539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05f07976-e441-4205-b871-1c1cd76735cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3f3c33fd-0f0a-4ef3-bc80-1bbf5092b2c0', 'volume_name': 'volume-3f3c33fd-0f0a-4ef3-bc80-1bbf5092b2c0', 'volume_size': 1, 'image_id': 'e83a1f9a-2dff-486c-9a0d-e319f678bf77', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e83a1f9a-2dff-486c-9a0d-e319f678bf77', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b342f4fbcafa985cf041d804708f1097', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '827a1743c94e412388f919e9a4df21ec', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '079c8e1382884ae2c545be7e81a5d9629d7e32e8f9e54a75cfad52883f2fc4ecf77fe19134c8ce3c42818189556bc66499f42ba02e5a7aab0fe51d3b0c73794d', 'id': 'e83a1f9a-2dff-486c-9a0d-e319f678bf77', 'created_at': datetime.datetime(2026, 9, 17, 20, 4, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 20, 4, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e83a1f9a-2dff-486c-9a0d-e319f678bf77/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:04:09 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-46bf2a82-252e-46c7-b615-540535cca953 tempest-VolumeAndVolumeTypeFromImageTest-891514539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60ccf9ff-6ff6-4e04-a744-5576690f3395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:04:09 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-46bf2a82-252e-46c7-b615-540535cca953 tempest-VolumeAndVolumeTypeFromImageTest-891514539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60ccf9ff-6ff6-4e04-a744-5576690f3395) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:04:09 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-46bf2a82-252e-46c7-b615-540535cca953 tempest-VolumeAndVolumeTypeFromImageTest-891514539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dce079b3-7462-44c8-8adc-307391107cc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:04:09 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-46bf2a82-252e-46c7-b615-540535cca953 tempest-VolumeAndVolumeTypeFromImageTest-891514539 None] Volume 3f3c33fd-0f0a-4ef3-bc80-1bbf5092b2c0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3f3c33fd-0f0a-4ef3-bc80-1bbf5092b2c0', 'volume_size': 1, 'image_id': 'e83a1f9a-2dff-486c-9a0d-e319f678bf77', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e83a1f9a-2dff-486c-9a0d-e319f678bf77', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b342f4fbcafa985cf041d804708f1097', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '827a1743c94e412388f919e9a4df21ec', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '079c8e1382884ae2c545be7e81a5d9629d7e32e8f9e54a75cfad52883f2fc4ecf77fe19134c8ce3c42818189556bc66499f42ba02e5a7aab0fe51d3b0c73794d', 'id': 'e83a1f9a-2dff-486c-9a0d-e319f678bf77', 'created_at': datetime.datetime(2026, 9, 17, 20, 4, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 20, 4, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e83a1f9a-2dff-486c-9a0d-e319f678bf77/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 17 22:04:09 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-46bf2a82-252e-46c7-b615-540535cca953 tempest-VolumeAndVolumeTypeFromImageTest-891514539 None] Trying to clone 3f3c33fd-0f0a-4ef3-bc80-1bbf5092b2c0 from image e83a1f9a-2dff-486c-9a0d-e319f678bf77 at location (None, [{'url': 'file:///opt/stack/data/glance/images/e83a1f9a-2dff-486c-9a0d-e319f678bf77', 'metadata': {}}]). {{(pid=85458) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 17 22:04:09 devstack sudo[100235]: pam_unix(sudo:session): session closed for user root Sep 17 22:04:09 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-1dbacd2d-60f4-4011-a7ea-352014658247 tempest-VolumesSnapshotListTestJSON-444050519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.364s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:04:09 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-1dbacd2d-60f4-4011-a7ea-352014658247 tempest-VolumesSnapshotListTestJSON-444050519 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:04:09 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-1dbacd2d-60f4-4011-a7ea-352014658247 tempest-VolumesSnapshotListTestJSON-444050519 None] Deleted volume successfully. Sep 17 22:04:09 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-1dbacd2d-60f4-4011-a7ea-352014658247 tempest-VolumesSnapshotListTestJSON-444050519 None] Lock "cinder-7ff93e3f-42c4-4399-a4bc-3c9ae073e450-delete_volume" released by "delete_volume" :: held 1.696s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:04:09 devstack cinder-volume[85458]: DEBUG cinder.image.image_utils [None req-46bf2a82-252e-46c7-b615-540535cca953 tempest-VolumeAndVolumeTypeFromImageTest-891514539 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e83a1f9a-2dff-486c-9a0d-e319f678bf77_4ajbq6i1devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=85458) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 17 22:04:09 devstack cinder-volume[85458]: INFO cinder.image.image_utils [None req-46bf2a82-252e-46c7-b615-540535cca953 tempest-VolumeAndVolumeTypeFromImageTest-891514539 None] Image download 0.00 MB at 0.00 MB/s Sep 17 22:04:09 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[65209153-e293-4706-b69e-470865d5b6d7]: (4, 'raw') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:04:09 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-46bf2a82-252e-46c7-b615-540535cca953 tempest-VolumeAndVolumeTypeFromImageTest-891514539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e83a1f9a-2dff-486c-9a0d-e319f678bf77_4ajbq6i1devstack@QuobyteHD {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:04:09 devstack sudo[100237]: pam_unix(sudo:session): session closed for user root Sep 17 22:04:09 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-80c08f1e-5580-4392-b1a4-76857c4a2034 tempest-VolumesSnapshotTestJSON-1092695371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c50689db-ee80-4498-83ea-3c3ffecb6aba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c50689db-ee80-4498-83ea-3c3ffecb6aba.f5e8364c-b262-4223-9a84-57778b3188a7 1G" returned: 0 in 0.511s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:04:09 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-80c08f1e-5580-4392-b1a4-76857c4a2034 tempest-VolumesSnapshotTestJSON-1092695371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c50689db-ee80-4498-83ea-3c3ffecb6aba -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c50689db-ee80-4498-83ea-3c3ffecb6aba.f5e8364c-b262-4223-9a84-57778b3188a7 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:04:09 devstack sudo[100247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c50689db-ee80-4498-83ea-3c3ffecb6aba -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c50689db-ee80-4498-83ea-3c3ffecb6aba.f5e8364c-b262-4223-9a84-57778b3188a7 Sep 17 22:04:09 devstack sudo[100247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:04:09 devstack sudo[100246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e83a1f9a-2dff-486c-9a0d-e319f678bf77_4ajbq6i1devstack@QuobyteHD Sep 17 22:04:09 devstack sudo[100246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:04:09 devstack sudo[100247]: pam_unix(sudo:session): session closed for user root Sep 17 22:04:09 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-80c08f1e-5580-4392-b1a4-76857c4a2034 tempest-VolumesSnapshotTestJSON-1092695371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c50689db-ee80-4498-83ea-3c3ffecb6aba -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c50689db-ee80-4498-83ea-3c3ffecb6aba.f5e8364c-b262-4223-9a84-57778b3188a7" returned: 0 in 0.335s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:04:09 devstack cinder-volume[85458]: WARNING cinder.volume.drivers.remotefs [None req-80c08f1e-5580-4392-b1a4-76857c4a2034 tempest-VolumesSnapshotTestJSON-1092695371 None] /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c50689db-ee80-4498-83ea-3c3ffecb6aba.f5e8364c-b262-4223-9a84-57778b3188a7 is being set with open permissions: ugo+rw Sep 17 22:04:09 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-80c08f1e-5580-4392-b1a4-76857c4a2034 tempest-VolumesSnapshotTestJSON-1092695371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c50689db-ee80-4498-83ea-3c3ffecb6aba.f5e8364c-b262-4223-9a84-57778b3188a7 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:04:09 devstack sudo[100246]: pam_unix(sudo:session): session closed for user root Sep 17 22:04:09 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-46bf2a82-252e-46c7-b615-540535cca953 tempest-VolumeAndVolumeTypeFromImageTest-891514539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e83a1f9a-2dff-486c-9a0d-e319f678bf77_4ajbq6i1devstack@QuobyteHD" returned: 0 in 0.400s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:04:09 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-46bf2a82-252e-46c7-b615-540535cca953 tempest-VolumeAndVolumeTypeFromImageTest-891514539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e83a1f9a-2dff-486c-9a0d-e319f678bf77_4ajbq6i1devstack@QuobyteHD {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:04:09 devstack sudo[100255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c50689db-ee80-4498-83ea-3c3ffecb6aba.f5e8364c-b262-4223-9a84-57778b3188a7 Sep 17 22:04:09 devstack sudo[100255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:04:09 devstack sudo[100256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e83a1f9a-2dff-486c-9a0d-e319f678bf77_4ajbq6i1devstack@QuobyteHD Sep 17 22:04:09 devstack sudo[100256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:04:10 devstack sudo[100255]: pam_unix(sudo:session): session closed for user root Sep 17 22:04:10 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-80c08f1e-5580-4392-b1a4-76857c4a2034 tempest-VolumesSnapshotTestJSON-1092695371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c50689db-ee80-4498-83ea-3c3ffecb6aba.f5e8364c-b262-4223-9a84-57778b3188a7" returned: 0 in 0.298s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:04:10 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-80c08f1e-5580-4392-b1a4-76857c4a2034 tempest-VolumesSnapshotTestJSON-1092695371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c50689db-ee80-4498-83ea-3c3ffecb6aba.info {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:04:10 devstack sudo[100260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c50689db-ee80-4498-83ea-3c3ffecb6aba.info Sep 17 22:04:10 devstack sudo[100260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:04:10 devstack sudo[100256]: pam_unix(sudo:session): session closed for user root Sep 17 22:04:10 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-46bf2a82-252e-46c7-b615-540535cca953 tempest-VolumeAndVolumeTypeFromImageTest-891514539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e83a1f9a-2dff-486c-9a0d-e319f678bf77_4ajbq6i1devstack@QuobyteHD" returned: 1 in 0.425s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:04:10 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-46bf2a82-252e-46c7-b615-540535cca953 tempest-VolumeAndVolumeTypeFromImageTest-891514539 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e83a1f9a-2dff-486c-9a0d-e319f678bf77_4ajbq6i1devstack@QuobyteHD' failed. Not Retrying. {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 22:04:10 devstack cinder-volume[85458]: DEBUG cinder.image.image_utils [None req-46bf2a82-252e-46c7-b615-540535cca953 tempest-VolumeAndVolumeTypeFromImageTest-891514539 None] Temporary image e83a1f9a-2dff-486c-9a0d-e319f678bf77 is fetched for user 6a92ebacb6094e6ea9031b6531fea68e. {{(pid=85458) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 17 22:04:10 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7c141ee-2453-4f18-a55e-efe6a6055370]: (4, 'raw') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:04:10 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-46bf2a82-252e-46c7-b615-540535cca953 tempest-VolumeAndVolumeTypeFromImageTest-891514539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e83a1f9a-2dff-486c-9a0d-e319f678bf77_4ajbq6i1devstack@QuobyteHD {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:04:10 devstack sudo[100260]: pam_unix(sudo:session): session closed for user root Sep 17 22:04:10 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-80c08f1e-5580-4392-b1a4-76857c4a2034 tempest-VolumesSnapshotTestJSON-1092695371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c50689db-ee80-4498-83ea-3c3ffecb6aba.info" returned: 0 in 0.321s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:04:10 devstack cinder-volume[85458]: WARNING cinder.volume.drivers.remotefs [None req-80c08f1e-5580-4392-b1a4-76857c4a2034 tempest-VolumesSnapshotTestJSON-1092695371 None] /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c50689db-ee80-4498-83ea-3c3ffecb6aba.info is being set with open permissions: ugo+rw Sep 17 22:04:10 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-80c08f1e-5580-4392-b1a4-76857c4a2034 tempest-VolumesSnapshotTestJSON-1092695371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c50689db-ee80-4498-83ea-3c3ffecb6aba.info {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:04:10 devstack sudo[100265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e83a1f9a-2dff-486c-9a0d-e319f678bf77_4ajbq6i1devstack@QuobyteHD Sep 17 22:04:10 devstack sudo[100265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:04:10 devstack sudo[100267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c50689db-ee80-4498-83ea-3c3ffecb6aba.info Sep 17 22:04:10 devstack sudo[100267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:04:10 devstack sudo[100265]: pam_unix(sudo:session): session closed for user root Sep 17 22:04:10 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-46bf2a82-252e-46c7-b615-540535cca953 tempest-VolumeAndVolumeTypeFromImageTest-891514539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e83a1f9a-2dff-486c-9a0d-e319f678bf77_4ajbq6i1devstack@QuobyteHD" returned: 0 in 0.514s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:04:10 devstack sudo[100267]: pam_unix(sudo:session): session closed for user root Sep 17 22:04:10 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-46bf2a82-252e-46c7-b615-540535cca953 tempest-VolumeAndVolumeTypeFromImageTest-891514539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e83a1f9a-2dff-486c-9a0d-e319f678bf77_4ajbq6i1devstack@QuobyteHD {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:04:10 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-80c08f1e-5580-4392-b1a4-76857c4a2034 tempest-VolumesSnapshotTestJSON-1092695371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c50689db-ee80-4498-83ea-3c3ffecb6aba.info" returned: 0 in 0.420s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:04:10 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-80c08f1e-5580-4392-b1a4-76857c4a2034 tempest-VolumesSnapshotTestJSON-1092695371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.519s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:04:10 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-80c08f1e-5580-4392-b1a4-76857c4a2034 tempest-VolumesSnapshotTestJSON-1092695371 None] Create snapshot completed successfully Sep 17 22:04:11 devstack sudo[100273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e83a1f9a-2dff-486c-9a0d-e319f678bf77_4ajbq6i1devstack@QuobyteHD Sep 17 22:04:11 devstack sudo[100273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:04:11 devstack sudo[100273]: pam_unix(sudo:session): session closed for user root Sep 17 22:04:11 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-46bf2a82-252e-46c7-b615-540535cca953 tempest-VolumeAndVolumeTypeFromImageTest-891514539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e83a1f9a-2dff-486c-9a0d-e319f678bf77_4ajbq6i1devstack@QuobyteHD" returned: 1 in 0.425s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:04:11 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-46bf2a82-252e-46c7-b615-540535cca953 tempest-VolumeAndVolumeTypeFromImageTest-891514539 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e83a1f9a-2dff-486c-9a0d-e319f678bf77_4ajbq6i1devstack@QuobyteHD' failed. Not Retrying. {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 22:04:11 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-46bf2a82-252e-46c7-b615-540535cca953 tempest-VolumeAndVolumeTypeFromImageTest-891514539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:04:11 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-46bf2a82-252e-46c7-b615-540535cca953 tempest-VolumeAndVolumeTypeFromImageTest-891514539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:04:11 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-46bf2a82-252e-46c7-b615-540535cca953 tempest-VolumeAndVolumeTypeFromImageTest-891514539 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:04:08Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f3c33fd-0f0a-4ef3-bc80-1bbf5092b2c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='827a1743c94e412388f919e9a4df21ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:04:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:04:09Z,use_quota=True,user_id='6a92ebacb6094e6ea9031b6531fea68e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0bdcde9a-5f84-47bd-8036-e0519aebad6d),volume_type_id=0bdcde9a-5f84-47bd-8036-e0519aebad6d)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 22:04:11 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-46bf2a82-252e-46c7-b615-540535cca953 tempest-VolumeAndVolumeTypeFromImageTest-891514539 None] Creating volume 3f3c33fd-0f0a-4ef3-bc80-1bbf5092b2c0 {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 22:04:11 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-46bf2a82-252e-46c7-b615-540535cca953 tempest-VolumeAndVolumeTypeFromImageTest-891514539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:04:11 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-46bf2a82-252e-46c7-b615-540535cca953 tempest-VolumeAndVolumeTypeFromImageTest-891514539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:04:11 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-46bf2a82-252e-46c7-b615-540535cca953 tempest-VolumeAndVolumeTypeFromImageTest-891514539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:04:11 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-46bf2a82-252e-46c7-b615-540535cca953 tempest-VolumeAndVolumeTypeFromImageTest-891514539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:04:11 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-46bf2a82-252e-46c7-b615-540535cca953 tempest-VolumeAndVolumeTypeFromImageTest-891514539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:04:11 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-46bf2a82-252e-46c7-b615-540535cca953 tempest-VolumeAndVolumeTypeFromImageTest-891514539 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 22:04:11 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-46bf2a82-252e-46c7-b615-540535cca953 tempest-VolumeAndVolumeTypeFromImageTest-891514539 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 22:04:11 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-46bf2a82-252e-46c7-b615-540535cca953 tempest-VolumeAndVolumeTypeFromImageTest-891514539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-3f3c33fd-0f0a-4ef3-bc80-1bbf5092b2c0 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:04:11 devstack sudo[100278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-3f3c33fd-0f0a-4ef3-bc80-1bbf5092b2c0 1073741824 Sep 17 22:04:11 devstack sudo[100278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:04:11 devstack sudo[100278]: pam_unix(sudo:session): session closed for user root Sep 17 22:04:11 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-46bf2a82-252e-46c7-b615-540535cca953 tempest-VolumeAndVolumeTypeFromImageTest-891514539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-3f3c33fd-0f0a-4ef3-bc80-1bbf5092b2c0 1073741824" returned: 0 in 0.577s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:04:11 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-46bf2a82-252e-46c7-b615-540535cca953 tempest-VolumeAndVolumeTypeFromImageTest-891514539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-3f3c33fd-0f0a-4ef3-bc80-1bbf5092b2c0 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:04:12 devstack sudo[100284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-3f3c33fd-0f0a-4ef3-bc80-1bbf5092b2c0 Sep 17 22:04:12 devstack sudo[100284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:04:12 devstack sudo[100284]: pam_unix(sudo:session): session closed for user root Sep 17 22:04:12 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce2d0bed-18f7-4755-bae1-6dbeb8c86dc7 tempest-VolumesSnapshotTestJSON-1092695371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 22:04:12 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-46bf2a82-252e-46c7-b615-540535cca953 tempest-VolumeAndVolumeTypeFromImageTest-891514539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-3f3c33fd-0f0a-4ef3-bc80-1bbf5092b2c0" returned: 0 in 0.413s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:04:12 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-46bf2a82-252e-46c7-b615-540535cca953 tempest-VolumeAndVolumeTypeFromImageTest-891514539 None] <== create_volume: return (1052ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 22:04:12 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-46bf2a82-252e-46c7-b615-540535cca953 tempest-VolumeAndVolumeTypeFromImageTest-891514539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.058s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:04:12 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-ce2d0bed-18f7-4755-bae1-6dbeb8c86dc7 tempest-VolumesSnapshotTestJSON-1092695371 None] Flow 'volume_create_manager' (5b9c6970-ed2d-46ba-86f5-d14c26b94fc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:04:12 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-ce2d0bed-18f7-4755-bae1-6dbeb8c86dc7 tempest-VolumesSnapshotTestJSON-1092695371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (955c2361-8430-447e-97b3-cb8572637363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:04:12 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-ce2d0bed-18f7-4755-bae1-6dbeb8c86dc7 tempest-VolumesSnapshotTestJSON-1092695371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (955c2361-8430-447e-97b3-cb8572637363) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:04:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-79427174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ee4fb42-ed1e-4c84-a27d-4ec6d595ef61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06cd571a5b3a4923912443d726b16adb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:04:12Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=f5e8364c-b262-4223-9a84-57778b3188a7,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:04:12Z,use_quota=True,user_id='53305d3d19814893af8139460c405901',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:04:12 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-ce2d0bed-18f7-4755-bae1-6dbeb8c86dc7 tempest-VolumesSnapshotTestJSON-1092695371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (553cd174-5174-4411-acba-1cde4f541362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:04:12 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-ce2d0bed-18f7-4755-bae1-6dbeb8c86dc7 tempest-VolumesSnapshotTestJSON-1092695371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (553cd174-5174-4411-acba-1cde4f541362) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:04:12 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-ce2d0bed-18f7-4755-bae1-6dbeb8c86dc7 tempest-VolumesSnapshotTestJSON-1092695371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2debf641-d768-4088-b416-f76c60d4ee1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:04:12 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-ce2d0bed-18f7-4755-bae1-6dbeb8c86dc7 tempest-VolumesSnapshotTestJSON-1092695371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2debf641-d768-4088-b416-f76c60d4ee1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1ee4fb42-ed1e-4c84-a27d-4ec6d595ef61', 'volume_name': 'volume-1ee4fb42-ed1e-4c84-a27d-4ec6d595ef61', 'volume_size': 2, 'snapshot_id': 'f5e8364c-b262-4223-9a84-57778b3188a7'}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:04:12 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-ce2d0bed-18f7-4755-bae1-6dbeb8c86dc7 tempest-VolumesSnapshotTestJSON-1092695371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee27dc9e-803c-46c0-b9d7-02ad906cdcac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:04:12 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-ce2d0bed-18f7-4755-bae1-6dbeb8c86dc7 tempest-VolumesSnapshotTestJSON-1092695371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee27dc9e-803c-46c0-b9d7-02ad906cdcac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:04:12 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-ce2d0bed-18f7-4755-bae1-6dbeb8c86dc7 tempest-VolumesSnapshotTestJSON-1092695371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (394b24e2-6b54-4bfe-950d-d7b1cf350643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:04:12 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-ce2d0bed-18f7-4755-bae1-6dbeb8c86dc7 tempest-VolumesSnapshotTestJSON-1092695371 None] Volume 1ee4fb42-ed1e-4c84-a27d-4ec6d595ef61: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1ee4fb42-ed1e-4c84-a27d-4ec6d595ef61', 'volume_size': 2, 'snapshot_id': 'f5e8364c-b262-4223-9a84-57778b3188a7'} Sep 17 22:04:12 devstack cinder-volume[85458]: DEBUG cinder.volume.volume_utils [None req-46bf2a82-252e-46c7-b615-540535cca953 tempest-VolumeAndVolumeTypeFromImageTest-891514539 None] Attempting download of e83a1f9a-2dff-486c-9a0d-e319f678bf77 ((None, [{'url': 'file:///opt/stack/data/glance/images/e83a1f9a-2dff-486c-9a0d-e319f678bf77', 'metadata': {}}])) to volume 3f3c33fd-0f0a-4ef3-bc80-1bbf5092b2c0. {{(pid=85458) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 17 22:04:12 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-ce2d0bed-18f7-4755-bae1-6dbeb8c86dc7 tempest-VolumesSnapshotTestJSON-1092695371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:04:12 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-ce2d0bed-18f7-4755-bae1-6dbeb8c86dc7 tempest-VolumesSnapshotTestJSON-1092695371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:04:12 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-ce2d0bed-18f7-4755-bae1-6dbeb8c86dc7 tempest-VolumesSnapshotTestJSON-1092695371 None] Acquiring lock "cinder-quobyte-f5e8364c-b262-4223-9a84-57778b3188a7-1ee4fb42-ed1e-4c84-a27d-4ec6d595ef61" by "_create_volume_from_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:04:12 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-ce2d0bed-18f7-4755-bae1-6dbeb8c86dc7 tempest-VolumesSnapshotTestJSON-1092695371 None] Lock "cinder-quobyte-f5e8364c-b262-4223-9a84-57778b3188a7-1ee4fb42-ed1e-4c84-a27d-4ec6d595ef61" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:04:12 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-ce2d0bed-18f7-4755-bae1-6dbeb8c86dc7 tempest-VolumesSnapshotTestJSON-1092695371 None] Creating volume 1ee4fb42-ed1e-4c84-a27d-4ec6d595ef61 from snapshot f5e8364c-b262-4223-9a84-57778b3188a7 {{(pid=85458) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 17 22:04:12 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-ce2d0bed-18f7-4755-bae1-6dbeb8c86dc7 tempest-VolumesSnapshotTestJSON-1092695371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:04:12 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-ce2d0bed-18f7-4755-bae1-6dbeb8c86dc7 tempest-VolumesSnapshotTestJSON-1092695371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:04:12 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-ce2d0bed-18f7-4755-bae1-6dbeb8c86dc7 tempest-VolumesSnapshotTestJSON-1092695371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:04:12 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-ce2d0bed-18f7-4755-bae1-6dbeb8c86dc7 tempest-VolumesSnapshotTestJSON-1092695371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:04:12 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-ce2d0bed-18f7-4755-bae1-6dbeb8c86dc7 tempest-VolumesSnapshotTestJSON-1092695371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:04:12 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-ce2d0bed-18f7-4755-bae1-6dbeb8c86dc7 tempest-VolumesSnapshotTestJSON-1092695371 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 22:04:12 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-ce2d0bed-18f7-4755-bae1-6dbeb8c86dc7 tempest-VolumesSnapshotTestJSON-1092695371 None] Acquiring lock "cinder-quobyte-1ee4fb42-ed1e-4c84-a27d-4ec6d595ef61" by "_copy_volume_from_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:04:12 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-ce2d0bed-18f7-4755-bae1-6dbeb8c86dc7 tempest-VolumesSnapshotTestJSON-1092695371 None] Lock "cinder-quobyte-1ee4fb42-ed1e-4c84-a27d-4ec6d595ef61" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:04:12 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-ce2d0bed-18f7-4755-bae1-6dbeb8c86dc7 tempest-VolumesSnapshotTestJSON-1092695371 None] snapshot: f5e8364c-b262-4223-9a84-57778b3188a7, volume: 1ee4fb42-ed1e-4c84-a27d-4ec6d595ef61, {{(pid=85458) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 17 22:04:12 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-ce2d0bed-18f7-4755-bae1-6dbeb8c86dc7 tempest-VolumesSnapshotTestJSON-1092695371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:04:12 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-ce2d0bed-18f7-4755-bae1-6dbeb8c86dc7 tempest-VolumesSnapshotTestJSON-1092695371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:04:12 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-ce2d0bed-18f7-4755-bae1-6dbeb8c86dc7 tempest-VolumesSnapshotTestJSON-1092695371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:04:12 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-ce2d0bed-18f7-4755-bae1-6dbeb8c86dc7 tempest-VolumesSnapshotTestJSON-1092695371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:04:12 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-ce2d0bed-18f7-4755-bae1-6dbeb8c86dc7 tempest-VolumesSnapshotTestJSON-1092695371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:04:12 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[a55a0b54-383e-46da-8439-5c71ff2d54a0]: (4, 'raw') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:04:12 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-46bf2a82-252e-46c7-b615-540535cca953 tempest-VolumeAndVolumeTypeFromImageTest-891514539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e83a1f9a-2dff-486c-9a0d-e319f678bf77_6966w369 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:04:12 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[1767bee7-6849-458b-9ab5-9e21baefb4ad]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:04:12 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-ce2d0bed-18f7-4755-bae1-6dbeb8c86dc7 tempest-VolumesSnapshotTestJSON-1092695371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c50689db-ee80-4498-83ea-3c3ffecb6aba.f5e8364c-b262-4223-9a84-57778b3188a7 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:04:12 devstack sudo[100288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e83a1f9a-2dff-486c-9a0d-e319f678bf77_6966w369 Sep 17 22:04:12 devstack sudo[100288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:04:12 devstack sudo[100289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c50689db-ee80-4498-83ea-3c3ffecb6aba.f5e8364c-b262-4223-9a84-57778b3188a7 Sep 17 22:04:12 devstack sudo[100289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:04:13 devstack sudo[100289]: pam_unix(sudo:session): session closed for user root Sep 17 22:04:13 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-ce2d0bed-18f7-4755-bae1-6dbeb8c86dc7 tempest-VolumesSnapshotTestJSON-1092695371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c50689db-ee80-4498-83ea-3c3ffecb6aba.f5e8364c-b262-4223-9a84-57778b3188a7" returned: 0 in 0.463s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:04:13 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-ce2d0bed-18f7-4755-bae1-6dbeb8c86dc7 tempest-VolumesSnapshotTestJSON-1092695371 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c50689db-ee80-4498-83ea-3c3ffecb6aba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85458) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 22:04:13 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[99b801bb-fa78-48e4-83ae-d869fcad7718]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:04:13 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-ce2d0bed-18f7-4755-bae1-6dbeb8c86dc7 tempest-VolumesSnapshotTestJSON-1092695371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c50689db-ee80-4498-83ea-3c3ffecb6aba {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:04:13 devstack sudo[100288]: pam_unix(sudo:session): session closed for user root Sep 17 22:04:13 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-46bf2a82-252e-46c7-b615-540535cca953 tempest-VolumeAndVolumeTypeFromImageTest-891514539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e83a1f9a-2dff-486c-9a0d-e319f678bf77_6966w369" returned: 0 in 0.513s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:04:13 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-46bf2a82-252e-46c7-b615-540535cca953 tempest-VolumeAndVolumeTypeFromImageTest-891514539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e83a1f9a-2dff-486c-9a0d-e319f678bf77_6966w369 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:04:13 devstack sudo[100298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c50689db-ee80-4498-83ea-3c3ffecb6aba Sep 17 22:04:13 devstack sudo[100298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:04:13 devstack sudo[100299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e83a1f9a-2dff-486c-9a0d-e319f678bf77_6966w369 Sep 17 22:04:13 devstack sudo[100299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:04:13 devstack sudo[100299]: pam_unix(sudo:session): session closed for user root Sep 17 22:04:13 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-46bf2a82-252e-46c7-b615-540535cca953 tempest-VolumeAndVolumeTypeFromImageTest-891514539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e83a1f9a-2dff-486c-9a0d-e319f678bf77_6966w369" returned: 1 in 0.414s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:04:13 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-46bf2a82-252e-46c7-b615-540535cca953 tempest-VolumeAndVolumeTypeFromImageTest-891514539 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e83a1f9a-2dff-486c-9a0d-e319f678bf77_6966w369' failed. Not Retrying. {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 22:04:13 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dd552d9-0fc3-4779-b95a-0dcff1688b69]: (4, 'raw') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:04:13 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-46bf2a82-252e-46c7-b615-540535cca953 tempest-VolumeAndVolumeTypeFromImageTest-891514539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e83a1f9a-2dff-486c-9a0d-e319f678bf77_4ajbq6i1devstack@QuobyteHD {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:04:13 devstack sudo[100298]: pam_unix(sudo:session): session closed for user root Sep 17 22:04:13 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-ce2d0bed-18f7-4755-bae1-6dbeb8c86dc7 tempest-VolumesSnapshotTestJSON-1092695371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c50689db-ee80-4498-83ea-3c3ffecb6aba" returned: 0 in 0.544s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:04:13 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-ce2d0bed-18f7-4755-bae1-6dbeb8c86dc7 tempest-VolumesSnapshotTestJSON-1092695371 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c50689db-ee80-4498-83ea-3c3ffecb6aba {{(pid=85458) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 17 22:04:13 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-ce2d0bed-18f7-4755-bae1-6dbeb8c86dc7 tempest-VolumesSnapshotTestJSON-1092695371 None] Creating direct copy from snapshot {{(pid=85458) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 17 22:04:13 devstack cinder-volume[85458]: DEBUG cinder.utils [None req-ce2d0bed-18f7-4755-bae1-6dbeb8c86dc7 tempest-VolumesSnapshotTestJSON-1092695371 None] Path /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-1ee4fb42-ed1e-4c84-a27d-4ec6d595ef61 not found in is_blk_device check {{(pid=85458) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 17 22:04:13 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-ce2d0bed-18f7-4755-bae1-6dbeb8c86dc7 tempest-VolumesSnapshotTestJSON-1092695371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c50689db-ee80-4498-83ea-3c3ffecb6aba /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-1ee4fb42-ed1e-4c84-a27d-4ec6d595ef61 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:04:13 devstack sudo[100309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c50689db-ee80-4498-83ea-3c3ffecb6aba /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-1ee4fb42-ed1e-4c84-a27d-4ec6d595ef61 Sep 17 22:04:13 devstack sudo[100309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:04:13 devstack sudo[100308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e83a1f9a-2dff-486c-9a0d-e319f678bf77_4ajbq6i1devstack@QuobyteHD Sep 17 22:04:13 devstack sudo[100308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:04:14 devstack sudo[100308]: pam_unix(sudo:session): session closed for user root Sep 17 22:04:14 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-46bf2a82-252e-46c7-b615-540535cca953 tempest-VolumeAndVolumeTypeFromImageTest-891514539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e83a1f9a-2dff-486c-9a0d-e319f678bf77_4ajbq6i1devstack@QuobyteHD" returned: 0 in 0.520s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:04:14 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-46bf2a82-252e-46c7-b615-540535cca953 tempest-VolumeAndVolumeTypeFromImageTest-891514539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e83a1f9a-2dff-486c-9a0d-e319f678bf77_4ajbq6i1devstack@QuobyteHD {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:04:14 devstack sudo[100317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e83a1f9a-2dff-486c-9a0d-e319f678bf77_4ajbq6i1devstack@QuobyteHD Sep 17 22:04:14 devstack sudo[100317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:04:14 devstack sudo[100317]: pam_unix(sudo:session): session closed for user root Sep 17 22:04:14 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-46bf2a82-252e-46c7-b615-540535cca953 tempest-VolumeAndVolumeTypeFromImageTest-891514539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e83a1f9a-2dff-486c-9a0d-e319f678bf77_4ajbq6i1devstack@QuobyteHD" returned: 1 in 0.789s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:04:14 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-46bf2a82-252e-46c7-b615-540535cca953 tempest-VolumeAndVolumeTypeFromImageTest-891514539 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e83a1f9a-2dff-486c-9a0d-e319f678bf77_4ajbq6i1devstack@QuobyteHD' failed. Not Retrying. {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 22:04:14 devstack cinder-volume[85458]: DEBUG cinder.image.image_utils [None req-46bf2a82-252e-46c7-b615-540535cca953 tempest-VolumeAndVolumeTypeFromImageTest-891514539 None] e83a1f9a-2dff-486c-9a0d-e319f678bf77 was raw, converting to qcow2 {{(pid=85458) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 17 22:04:14 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-46bf2a82-252e-46c7-b615-540535cca953 tempest-VolumeAndVolumeTypeFromImageTest-891514539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e83a1f9a-2dff-486c-9a0d-e319f678bf77_4ajbq6i1devstack@QuobyteHD /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-3f3c33fd-0f0a-4ef3-bc80-1bbf5092b2c0 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:04:14 devstack sudo[100329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e83a1f9a-2dff-486c-9a0d-e319f678bf77_4ajbq6i1devstack@QuobyteHD /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-3f3c33fd-0f0a-4ef3-bc80-1bbf5092b2c0 Sep 17 22:04:14 devstack sudo[100329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:04:16 devstack sudo[100329]: pam_unix(sudo:session): session closed for user root Sep 17 22:04:16 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-46bf2a82-252e-46c7-b615-540535cca953 tempest-VolumeAndVolumeTypeFromImageTest-891514539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e83a1f9a-2dff-486c-9a0d-e319f678bf77_4ajbq6i1devstack@QuobyteHD /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-3f3c33fd-0f0a-4ef3-bc80-1bbf5092b2c0" returned: 0 in 1.376s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:04:16 devstack cinder-volume[85458]: DEBUG cinder.image.image_utils [None req-46bf2a82-252e-46c7-b615-540535cca953 tempest-VolumeAndVolumeTypeFromImageTest-891514539 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e83a1f9a-2dff-486c-9a0d-e319f678bf77_4ajbq6i1devstack@QuobyteHD, size 0.00 MB, duration 1.39 sec, destination /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-3f3c33fd-0f0a-4ef3-bc80-1bbf5092b2c0 {{(pid=85458) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 17 22:04:16 devstack cinder-volume[85458]: INFO cinder.image.image_utils [None req-46bf2a82-252e-46c7-b615-540535cca953 tempest-VolumeAndVolumeTypeFromImageTest-891514539 None] Converted 0.00 MB image at 0.00 MB/s Sep 17 22:04:16 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-46bf2a82-252e-46c7-b615-540535cca953 tempest-VolumeAndVolumeTypeFromImageTest-891514539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-3f3c33fd-0f0a-4ef3-bc80-1bbf5092b2c0 1G {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:04:16 devstack sudo[100346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-3f3c33fd-0f0a-4ef3-bc80-1bbf5092b2c0 1G Sep 17 22:04:16 devstack sudo[100346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:04:16 devstack sudo[100346]: pam_unix(sudo:session): session closed for user root Sep 17 22:04:16 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-46bf2a82-252e-46c7-b615-540535cca953 tempest-VolumeAndVolumeTypeFromImageTest-891514539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-3f3c33fd-0f0a-4ef3-bc80-1bbf5092b2c0 1G" returned: 0 in 0.662s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:04:16 devstack cinder-volume[85458]: DEBUG cinder.volume.volume_utils [None req-46bf2a82-252e-46c7-b615-540535cca953 tempest-VolumeAndVolumeTypeFromImageTest-891514539 None] Downloaded image e83a1f9a-2dff-486c-9a0d-e319f678bf77 ((None, [{'url': 'file:///opt/stack/data/glance/images/e83a1f9a-2dff-486c-9a0d-e319f678bf77', 'metadata': {}}])) to volume 3f3c33fd-0f0a-4ef3-bc80-1bbf5092b2c0 successfully. {{(pid=85458) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 17 22:04:16 devstack cinder-volume[85458]: DEBUG cinder.image.image_utils [None req-46bf2a82-252e-46c7-b615-540535cca953 tempest-VolumeAndVolumeTypeFromImageTest-891514539 None] Temporary image e83a1f9a-2dff-486c-9a0d-e319f678bf77 for user 6a92ebacb6094e6ea9031b6531fea68e is deleted. {{(pid=85458) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 17 22:04:16 devstack cinder-volume[85458]: DEBUG cinder.volume.volume_utils [None req-46bf2a82-252e-46c7-b615-540535cca953 tempest-VolumeAndVolumeTypeFromImageTest-891514539 None] Marking volume 3f3c33fd-0f0a-4ef3-bc80-1bbf5092b2c0 as bootable. {{(pid=85458) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 17 22:04:16 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-46bf2a82-252e-46c7-b615-540535cca953 tempest-VolumeAndVolumeTypeFromImageTest-891514539 None] Copying metadata from image e83a1f9a-2dff-486c-9a0d-e319f678bf77 to 3f3c33fd-0f0a-4ef3-bc80-1bbf5092b2c0. {{(pid=85458) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 17 22:04:16 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-46bf2a82-252e-46c7-b615-540535cca953 tempest-VolumeAndVolumeTypeFromImageTest-891514539 None] Creating volume glance metadata for volume 3f3c33fd-0f0a-4ef3-bc80-1bbf5092b2c0 backed by image e83a1f9a-2dff-486c-9a0d-e319f678bf77 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'e83a1f9a-2dff-486c-9a0d-e319f678bf77', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'b342f4fbcafa985cf041d804708f1097', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=85458) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 17 22:04:17 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-46bf2a82-252e-46c7-b615-540535cca953 tempest-VolumeAndVolumeTypeFromImageTest-891514539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dce079b3-7462-44c8-8adc-307391107cc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f3c33fd-0f0a-4ef3-bc80-1bbf5092b2c0', 'volume_size': 1, 'image_id': 'e83a1f9a-2dff-486c-9a0d-e319f678bf77', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e83a1f9a-2dff-486c-9a0d-e319f678bf77', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b342f4fbcafa985cf041d804708f1097', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '827a1743c94e412388f919e9a4df21ec', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '079c8e1382884ae2c545be7e81a5d9629d7e32e8f9e54a75cfad52883f2fc4ecf77fe19134c8ce3c42818189556bc66499f42ba02e5a7aab0fe51d3b0c73794d', 'id': 'e83a1f9a-2dff-486c-9a0d-e319f678bf77', 'created_at': datetime.datetime(2026, 9, 17, 20, 4, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 20, 4, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e83a1f9a-2dff-486c-9a0d-e319f678bf77/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:04:17 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-46bf2a82-252e-46c7-b615-540535cca953 tempest-VolumeAndVolumeTypeFromImageTest-891514539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (950471ef-1cd6-4ebb-86a8-c5586cbd5454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:04:17 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-46bf2a82-252e-46c7-b615-540535cca953 tempest-VolumeAndVolumeTypeFromImageTest-891514539 None] Volume volume-3f3c33fd-0f0a-4ef3-bc80-1bbf5092b2c0 (3f3c33fd-0f0a-4ef3-bc80-1bbf5092b2c0): created successfully Sep 17 22:04:17 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-46bf2a82-252e-46c7-b615-540535cca953 tempest-VolumeAndVolumeTypeFromImageTest-891514539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (950471ef-1cd6-4ebb-86a8-c5586cbd5454) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:04:17 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-46bf2a82-252e-46c7-b615-540535cca953 tempest-VolumeAndVolumeTypeFromImageTest-891514539 None] Flow 'volume_create_manager' (7908425c-8829-4e94-b446-d94fb166dce8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:04:17 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-46bf2a82-252e-46c7-b615-540535cca953 tempest-VolumeAndVolumeTypeFromImageTest-891514539 None] Created volume successfully. Sep 17 22:04:17 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-907117ef-7c96-47a6-9e68-d83f4b7f9e41 tempest-VolumeAndVolumeTypeFromImageTest-891514539 None] Acquiring lock "cinder-3f3c33fd-0f0a-4ef3-bc80-1bbf5092b2c0-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:04:17 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-907117ef-7c96-47a6-9e68-d83f4b7f9e41 tempest-VolumeAndVolumeTypeFromImageTest-891514539 None] Lock "cinder-3f3c33fd-0f0a-4ef3-bc80-1bbf5092b2c0-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:04:17 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-907117ef-7c96-47a6-9e68-d83f4b7f9e41 tempest-VolumeAndVolumeTypeFromImageTest-891514539 None] Acquiring lock "cinder-quobyte-3f3c33fd-0f0a-4ef3-bc80-1bbf5092b2c0" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:04:17 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-907117ef-7c96-47a6-9e68-d83f4b7f9e41 tempest-VolumeAndVolumeTypeFromImageTest-891514539 None] Lock "cinder-quobyte-3f3c33fd-0f0a-4ef3-bc80-1bbf5092b2c0" acquired by "delete_volume" :: waited 0.027s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:04:17 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[c036a9cf-0bc1-4ec9-9321-34284f8a6566]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:04:17 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-907117ef-7c96-47a6-9e68-d83f4b7f9e41 tempest-VolumeAndVolumeTypeFromImageTest-891514539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-3f3c33fd-0f0a-4ef3-bc80-1bbf5092b2c0 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:04:18 devstack sudo[100352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-3f3c33fd-0f0a-4ef3-bc80-1bbf5092b2c0 Sep 17 22:04:18 devstack sudo[100352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:04:18 devstack sudo[100352]: pam_unix(sudo:session): session closed for user root Sep 17 22:04:18 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-907117ef-7c96-47a6-9e68-d83f4b7f9e41 tempest-VolumeAndVolumeTypeFromImageTest-891514539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-3f3c33fd-0f0a-4ef3-bc80-1bbf5092b2c0" returned: 0 in 0.543s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:04:18 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-907117ef-7c96-47a6-9e68-d83f4b7f9e41 tempest-VolumeAndVolumeTypeFromImageTest-891514539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-3f3c33fd-0f0a-4ef3-bc80-1bbf5092b2c0 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:04:18 devstack sudo[100358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-3f3c33fd-0f0a-4ef3-bc80-1bbf5092b2c0 Sep 17 22:04:18 devstack sudo[100358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:04:18 devstack sudo[100358]: pam_unix(sudo:session): session closed for user root Sep 17 22:04:18 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-907117ef-7c96-47a6-9e68-d83f4b7f9e41 tempest-VolumeAndVolumeTypeFromImageTest-891514539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-3f3c33fd-0f0a-4ef3-bc80-1bbf5092b2c0" returned: 0 in 0.351s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:04:18 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-907117ef-7c96-47a6-9e68-d83f4b7f9e41 tempest-VolumeAndVolumeTypeFromImageTest-891514539 None] Lock "cinder-quobyte-3f3c33fd-0f0a-4ef3-bc80-1bbf5092b2c0" released by "delete_volume" :: held 1.004s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:04:18 devstack cinder-volume[85458]: WARNING cinder.quota [None req-907117ef-7c96-47a6-9e68-d83f4b7f9e41 tempest-VolumeAndVolumeTypeFromImageTest-891514539 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 17 22:04:19 devstack cinder-volume[85458]: WARNING cinder.quota [None req-907117ef-7c96-47a6-9e68-d83f4b7f9e41 tempest-VolumeAndVolumeTypeFromImageTest-891514539 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 17 22:04:19 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-907117ef-7c96-47a6-9e68-d83f4b7f9e41 tempest-VolumeAndVolumeTypeFromImageTest-891514539 None] Created reservations ['f627932d-cca2-4400-9c80-5e86afdd4e8b', '4d1f587c-3b61-4521-bb0e-657a3aa66024', '89cdca03-a166-460b-aa28-01474379d260', '0dc5a625-e9da-4a9c-af44-a05909cf4815'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:04:19 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-907117ef-7c96-47a6-9e68-d83f4b7f9e41 tempest-VolumeAndVolumeTypeFromImageTest-891514539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:04:19 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-907117ef-7c96-47a6-9e68-d83f4b7f9e41 tempest-VolumeAndVolumeTypeFromImageTest-891514539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:04:19 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-907117ef-7c96-47a6-9e68-d83f4b7f9e41 tempest-VolumeAndVolumeTypeFromImageTest-891514539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:04:19 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-907117ef-7c96-47a6-9e68-d83f4b7f9e41 tempest-VolumeAndVolumeTypeFromImageTest-891514539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:04:19 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-907117ef-7c96-47a6-9e68-d83f4b7f9e41 tempest-VolumeAndVolumeTypeFromImageTest-891514539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:04:19 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-907117ef-7c96-47a6-9e68-d83f4b7f9e41 tempest-VolumeAndVolumeTypeFromImageTest-891514539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:04:19 devstack sudo[100362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:04:19 devstack sudo[100362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:04:19 devstack sudo[100362]: pam_unix(sudo:session): session closed for user root Sep 17 22:04:19 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-907117ef-7c96-47a6-9e68-d83f4b7f9e41 tempest-VolumeAndVolumeTypeFromImageTest-891514539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.564s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:04:19 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-907117ef-7c96-47a6-9e68-d83f4b7f9e41 tempest-VolumeAndVolumeTypeFromImageTest-891514539 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:04:19 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-907117ef-7c96-47a6-9e68-d83f4b7f9e41 tempest-VolumeAndVolumeTypeFromImageTest-891514539 None] Deleted volume successfully. Sep 17 22:04:19 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-907117ef-7c96-47a6-9e68-d83f4b7f9e41 tempest-VolumeAndVolumeTypeFromImageTest-891514539 None] Lock "cinder-3f3c33fd-0f0a-4ef3-bc80-1bbf5092b2c0-delete_volume" released by "delete_volume" :: held 2.113s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:04:22 devstack sudo[100309]: pam_unix(sudo:session): session closed for user root Sep 17 22:04:22 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-ce2d0bed-18f7-4755-bae1-6dbeb8c86dc7 tempest-VolumesSnapshotTestJSON-1092695371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c50689db-ee80-4498-83ea-3c3ffecb6aba /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-1ee4fb42-ed1e-4c84-a27d-4ec6d595ef61" returned: 0 in 8.891s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:04:22 devstack cinder-volume[85458]: DEBUG cinder.image.image_utils [None req-ce2d0bed-18f7-4755-bae1-6dbeb8c86dc7 tempest-VolumesSnapshotTestJSON-1092695371 None] Image conversion details: src /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c50689db-ee80-4498-83ea-3c3ffecb6aba, size 1024.00 MB, duration 8.89 sec, destination /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-1ee4fb42-ed1e-4c84-a27d-4ec6d595ef61 {{(pid=85458) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 17 22:04:22 devstack cinder-volume[85458]: INFO cinder.image.image_utils [None req-ce2d0bed-18f7-4755-bae1-6dbeb8c86dc7 tempest-VolumesSnapshotTestJSON-1092695371 None] Converted 1024.00 MB image at 115.16 MB/s Sep 17 22:04:22 devstack cinder-volume[85458]: WARNING cinder.volume.drivers.remotefs [None req-ce2d0bed-18f7-4755-bae1-6dbeb8c86dc7 tempest-VolumesSnapshotTestJSON-1092695371 None] /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-1ee4fb42-ed1e-4c84-a27d-4ec6d595ef61 is being set with open permissions: ugo+rw Sep 17 22:04:22 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-ce2d0bed-18f7-4755-bae1-6dbeb8c86dc7 tempest-VolumesSnapshotTestJSON-1092695371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-1ee4fb42-ed1e-4c84-a27d-4ec6d595ef61 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:04:22 devstack sudo[100401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-1ee4fb42-ed1e-4c84-a27d-4ec6d595ef61 Sep 17 22:04:22 devstack sudo[100401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:04:22 devstack sudo[100401]: pam_unix(sudo:session): session closed for user root Sep 17 22:04:22 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-ce2d0bed-18f7-4755-bae1-6dbeb8c86dc7 tempest-VolumesSnapshotTestJSON-1092695371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-1ee4fb42-ed1e-4c84-a27d-4ec6d595ef61" returned: 0 in 0.355s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:04:22 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-ce2d0bed-18f7-4755-bae1-6dbeb8c86dc7 tempest-VolumesSnapshotTestJSON-1092695371 None] Lock "cinder-quobyte-1ee4fb42-ed1e-4c84-a27d-4ec6d595ef61" released by "_copy_volume_from_snapshot" :: held 10.369s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:04:22 devstack cinder-volume[85458]: DEBUG dbcounter [-] [85458] Writing DB stats cinder:SELECT=122,cinder:INSERT=29,cinder:UPDATE=109,cinder:DELETE=8 {{(pid=85458) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 22:04:22 devstack cinder-volume[85458]: DEBUG dbcounter [-] [85458] Writing DB stats cinder:SELECT=101,cinder:INSERT=34,cinder:UPDATE=107,cinder:DELETE=10 {{(pid=85458) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 22:04:22 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-ce2d0bed-18f7-4755-bae1-6dbeb8c86dc7 tempest-VolumesSnapshotTestJSON-1092695371 None] Lock "cinder-quobyte-f5e8364c-b262-4223-9a84-57778b3188a7-1ee4fb42-ed1e-4c84-a27d-4ec6d595ef61" released by "_create_volume_from_snapshot" :: held 10.457s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:04:22 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-ce2d0bed-18f7-4755-bae1-6dbeb8c86dc7 tempest-VolumesSnapshotTestJSON-1092695371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.480s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:04:23 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-ce2d0bed-18f7-4755-bae1-6dbeb8c86dc7 tempest-VolumesSnapshotTestJSON-1092695371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (394b24e2-6b54-4bfe-950d-d7b1cf350643) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ee4fb42-ed1e-4c84-a27d-4ec6d595ef61', 'volume_size': 2, 'snapshot_id': 'f5e8364c-b262-4223-9a84-57778b3188a7'}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:04:23 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-ce2d0bed-18f7-4755-bae1-6dbeb8c86dc7 tempest-VolumesSnapshotTestJSON-1092695371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdf3bcc3-4412-4d37-ae92-b32226da43fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:04:23 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-ce2d0bed-18f7-4755-bae1-6dbeb8c86dc7 tempest-VolumesSnapshotTestJSON-1092695371 None] Volume volume-1ee4fb42-ed1e-4c84-a27d-4ec6d595ef61 (1ee4fb42-ed1e-4c84-a27d-4ec6d595ef61): created successfully Sep 17 22:04:23 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-ce2d0bed-18f7-4755-bae1-6dbeb8c86dc7 tempest-VolumesSnapshotTestJSON-1092695371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdf3bcc3-4412-4d37-ae92-b32226da43fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:04:23 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-ce2d0bed-18f7-4755-bae1-6dbeb8c86dc7 tempest-VolumesSnapshotTestJSON-1092695371 None] Flow 'volume_create_manager' (5b9c6970-ed2d-46ba-86f5-d14c26b94fc2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:04:23 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-ce2d0bed-18f7-4755-bae1-6dbeb8c86dc7 tempest-VolumesSnapshotTestJSON-1092695371 None] Created volume successfully. Sep 17 22:04:23 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-6999695f-9037-4e9b-8da7-979623b7e5f5 tempest-VolumesSnapshotTestJSON-1092695371 None] Acquiring lock "cinder-1ee4fb42-ed1e-4c84-a27d-4ec6d595ef61-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:04:23 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-6999695f-9037-4e9b-8da7-979623b7e5f5 tempest-VolumesSnapshotTestJSON-1092695371 None] Lock "cinder-1ee4fb42-ed1e-4c84-a27d-4ec6d595ef61-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:04:23 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-6999695f-9037-4e9b-8da7-979623b7e5f5 tempest-VolumesSnapshotTestJSON-1092695371 None] Acquiring lock "cinder-quobyte-1ee4fb42-ed1e-4c84-a27d-4ec6d595ef61" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:04:23 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-6999695f-9037-4e9b-8da7-979623b7e5f5 tempest-VolumesSnapshotTestJSON-1092695371 None] Lock "cinder-quobyte-1ee4fb42-ed1e-4c84-a27d-4ec6d595ef61" acquired by "delete_volume" :: waited 0.033s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:04:23 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[a74e11b3-903d-48e8-9aba-a127e2692f0f]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:04:23 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-6999695f-9037-4e9b-8da7-979623b7e5f5 tempest-VolumesSnapshotTestJSON-1092695371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-1ee4fb42-ed1e-4c84-a27d-4ec6d595ef61 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:04:24 devstack sudo[100404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-1ee4fb42-ed1e-4c84-a27d-4ec6d595ef61 Sep 17 22:04:24 devstack sudo[100404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:04:24 devstack sudo[100404]: pam_unix(sudo:session): session closed for user root Sep 17 22:04:24 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-6999695f-9037-4e9b-8da7-979623b7e5f5 tempest-VolumesSnapshotTestJSON-1092695371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-1ee4fb42-ed1e-4c84-a27d-4ec6d595ef61" returned: 0 in 0.585s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:04:24 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-6999695f-9037-4e9b-8da7-979623b7e5f5 tempest-VolumesSnapshotTestJSON-1092695371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-1ee4fb42-ed1e-4c84-a27d-4ec6d595ef61 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:04:24 devstack sudo[100409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-1ee4fb42-ed1e-4c84-a27d-4ec6d595ef61 Sep 17 22:04:24 devstack sudo[100409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:04:24 devstack sudo[100409]: pam_unix(sudo:session): session closed for user root Sep 17 22:04:24 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-6999695f-9037-4e9b-8da7-979623b7e5f5 tempest-VolumesSnapshotTestJSON-1092695371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-1ee4fb42-ed1e-4c84-a27d-4ec6d595ef61" returned: 0 in 0.331s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:04:24 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-6999695f-9037-4e9b-8da7-979623b7e5f5 tempest-VolumesSnapshotTestJSON-1092695371 None] Lock "cinder-quobyte-1ee4fb42-ed1e-4c84-a27d-4ec6d595ef61" released by "delete_volume" :: held 0.993s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:04:24 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-6999695f-9037-4e9b-8da7-979623b7e5f5 tempest-VolumesSnapshotTestJSON-1092695371 None] Created reservations ['c1e36b38-8b58-41e4-86d6-6f36fca2978d', '2b4b84a9-460b-42fb-a414-bad222b6c84b', '5d2b8210-8f69-44a2-8a54-d275f845eaed', '162efd54-26e2-452b-9234-875b95d10c3f'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:04:25 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-6999695f-9037-4e9b-8da7-979623b7e5f5 tempest-VolumesSnapshotTestJSON-1092695371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:04:25 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-6999695f-9037-4e9b-8da7-979623b7e5f5 tempest-VolumesSnapshotTestJSON-1092695371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:04:25 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-6999695f-9037-4e9b-8da7-979623b7e5f5 tempest-VolumesSnapshotTestJSON-1092695371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:04:25 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-6999695f-9037-4e9b-8da7-979623b7e5f5 tempest-VolumesSnapshotTestJSON-1092695371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:04:25 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-6999695f-9037-4e9b-8da7-979623b7e5f5 tempest-VolumesSnapshotTestJSON-1092695371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:04:25 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-6999695f-9037-4e9b-8da7-979623b7e5f5 tempest-VolumesSnapshotTestJSON-1092695371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:04:25 devstack sudo[100412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:04:25 devstack sudo[100412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:04:25 devstack sudo[100412]: pam_unix(sudo:session): session closed for user root Sep 17 22:04:25 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-6999695f-9037-4e9b-8da7-979623b7e5f5 tempest-VolumesSnapshotTestJSON-1092695371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.277s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:04:25 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-6999695f-9037-4e9b-8da7-979623b7e5f5 tempest-VolumesSnapshotTestJSON-1092695371 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:04:25 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-6999695f-9037-4e9b-8da7-979623b7e5f5 tempest-VolumesSnapshotTestJSON-1092695371 None] Deleted volume successfully. Sep 17 22:04:25 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-6999695f-9037-4e9b-8da7-979623b7e5f5 tempest-VolumesSnapshotTestJSON-1092695371 None] Lock "cinder-1ee4fb42-ed1e-4c84-a27d-4ec6d595ef61-delete_volume" released by "delete_volume" :: held 1.607s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:04:26 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-1801f6cc-29dc-4806-8f1b-62e456c1d1e5 tempest-VolumesSnapshotTestJSON-1092695371 None] Acquiring lock "cinder-f5e8364c-b262-4223-9a84-57778b3188a7-delete_snapshot" by "delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:04:26 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-1801f6cc-29dc-4806-8f1b-62e456c1d1e5 tempest-VolumesSnapshotTestJSON-1092695371 None] Lock "cinder-f5e8364c-b262-4223-9a84-57778b3188a7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:04:26 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-1801f6cc-29dc-4806-8f1b-62e456c1d1e5 tempest-VolumesSnapshotTestJSON-1092695371 None] Acquiring lock "cinder-quobyte-c50689db-ee80-4498-83ea-3c3ffecb6aba" by "delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:04:26 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-1801f6cc-29dc-4806-8f1b-62e456c1d1e5 tempest-VolumesSnapshotTestJSON-1092695371 None] Lock "cinder-quobyte-c50689db-ee80-4498-83ea-3c3ffecb6aba" acquired by "delete_snapshot" :: waited 0.036s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:04:26 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-1801f6cc-29dc-4806-8f1b-62e456c1d1e5 tempest-VolumesSnapshotTestJSON-1092695371 None] Acquiring lock "cinder-quobyte-f5e8364c-b262-4223-9a84-57778b3188a7" by "_delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:04:26 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-1801f6cc-29dc-4806-8f1b-62e456c1d1e5 tempest-VolumesSnapshotTestJSON-1092695371 None] Lock "cinder-quobyte-f5e8364c-b262-4223-9a84-57778b3188a7" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:04:26 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-1801f6cc-29dc-4806-8f1b-62e456c1d1e5 tempest-VolumesSnapshotTestJSON-1092695371 None] Deleting offline snapshot f5e8364c-b262-4223-9a84-57778b3188a7 of volume c50689db-ee80-4498-83ea-3c3ffecb6aba {{(pid=85458) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 22:04:26 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-1801f6cc-29dc-4806-8f1b-62e456c1d1e5 tempest-VolumesSnapshotTestJSON-1092695371 None] snapshot_file for this snap is: volume-c50689db-ee80-4498-83ea-3c3ffecb6aba.f5e8364c-b262-4223-9a84-57778b3188a7 {{(pid=85458) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 22:04:26 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dd8711a-73ca-4215-a593-51ae3900d918]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:04:26 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-1801f6cc-29dc-4806-8f1b-62e456c1d1e5 tempest-VolumesSnapshotTestJSON-1092695371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c50689db-ee80-4498-83ea-3c3ffecb6aba.f5e8364c-b262-4223-9a84-57778b3188a7 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:04:26 devstack sudo[100419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c50689db-ee80-4498-83ea-3c3ffecb6aba.f5e8364c-b262-4223-9a84-57778b3188a7 Sep 17 22:04:26 devstack sudo[100419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:04:26 devstack sudo[100419]: pam_unix(sudo:session): session closed for user root Sep 17 22:04:26 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-1801f6cc-29dc-4806-8f1b-62e456c1d1e5 tempest-VolumesSnapshotTestJSON-1092695371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c50689db-ee80-4498-83ea-3c3ffecb6aba.f5e8364c-b262-4223-9a84-57778b3188a7" returned: 0 in 0.529s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:04:26 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-1801f6cc-29dc-4806-8f1b-62e456c1d1e5 tempest-VolumesSnapshotTestJSON-1092695371 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c50689db-ee80-4498-83ea-3c3ffecb6aba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85458) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 22:04:26 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec64a50c-a0d2-4139-a475-d91ea14d2af0]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:04:26 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-1801f6cc-29dc-4806-8f1b-62e456c1d1e5 tempest-VolumesSnapshotTestJSON-1092695371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c50689db-ee80-4498-83ea-3c3ffecb6aba {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:04:27 devstack sudo[100424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c50689db-ee80-4498-83ea-3c3ffecb6aba Sep 17 22:04:27 devstack sudo[100424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:04:27 devstack sudo[100424]: pam_unix(sudo:session): session closed for user root Sep 17 22:04:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-1801f6cc-29dc-4806-8f1b-62e456c1d1e5 tempest-VolumesSnapshotTestJSON-1092695371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c50689db-ee80-4498-83ea-3c3ffecb6aba" returned: 0 in 0.761s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:04:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-1801f6cc-29dc-4806-8f1b-62e456c1d1e5 tempest-VolumesSnapshotTestJSON-1092695371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c50689db-ee80-4498-83ea-3c3ffecb6aba.f5e8364c-b262-4223-9a84-57778b3188a7 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:04:27 devstack sudo[100429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c50689db-ee80-4498-83ea-3c3ffecb6aba.f5e8364c-b262-4223-9a84-57778b3188a7 Sep 17 22:04:27 devstack sudo[100429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:04:27 devstack cinder-volume[85458]: DEBUG oslo_service.periodic_task [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85458) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 22:04:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:04:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:04:27 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:04:27 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:04:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:04:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:04:27 devstack sudo[100432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:04:27 devstack sudo[100432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:04:28 devstack sudo[100432]: pam_unix(sudo:session): session closed for user root Sep 17 22:04:28 devstack sudo[100429]: pam_unix(sudo:session): session closed for user root Sep 17 22:04:28 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.521s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:04:28 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:04:28 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-1801f6cc-29dc-4806-8f1b-62e456c1d1e5 tempest-VolumesSnapshotTestJSON-1092695371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c50689db-ee80-4498-83ea-3c3ffecb6aba.f5e8364c-b262-4223-9a84-57778b3188a7" returned: 0 in 0.641s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:04:28 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-1801f6cc-29dc-4806-8f1b-62e456c1d1e5 tempest-VolumesSnapshotTestJSON-1092695371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c50689db-ee80-4498-83ea-3c3ffecb6aba.f5e8364c-b262-4223-9a84-57778b3188a7 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:04:28 devstack cinder-volume[85458]: DEBUG oslo_service.periodic_task [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Running periodic task VolumeManager._thread_info {{(pid=85458) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 22:04:28 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] thread count: 28 {{(pid=85458) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 22:04:28 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] thread info: [<_MainThread(MainThread, started 127546830999680)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85458) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 22:04:28 devstack sudo[100439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c50689db-ee80-4498-83ea-3c3ffecb6aba.f5e8364c-b262-4223-9a84-57778b3188a7 Sep 17 22:04:28 devstack sudo[100439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:04:28 devstack sudo[100439]: pam_unix(sudo:session): session closed for user root Sep 17 22:04:28 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-1801f6cc-29dc-4806-8f1b-62e456c1d1e5 tempest-VolumesSnapshotTestJSON-1092695371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c50689db-ee80-4498-83ea-3c3ffecb6aba.f5e8364c-b262-4223-9a84-57778b3188a7" returned: 0 in 0.351s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:04:28 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-1801f6cc-29dc-4806-8f1b-62e456c1d1e5 tempest-VolumesSnapshotTestJSON-1092695371 None] Lock "cinder-quobyte-f5e8364c-b262-4223-9a84-57778b3188a7" released by "_delete_snapshot" :: held 2.460s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:04:28 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-1801f6cc-29dc-4806-8f1b-62e456c1d1e5 tempest-VolumesSnapshotTestJSON-1092695371 None] Lock "cinder-quobyte-c50689db-ee80-4498-83ea-3c3ffecb6aba" released by "delete_snapshot" :: held 2.493s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:04:28 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-1801f6cc-29dc-4806-8f1b-62e456c1d1e5 tempest-VolumesSnapshotTestJSON-1092695371 None] Created reservations ['1f4719f1-1823-4491-a6ca-2a036038d08f', '00c650f7-dd70-445f-a1d7-f0f512bc858b', '6d76295e-f246-49a2-adaf-483348590a3d', 'ef4c27f7-c1ff-4661-a6fd-f4918fd62ca4'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:04:28 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-1801f6cc-29dc-4806-8f1b-62e456c1d1e5 tempest-VolumesSnapshotTestJSON-1092695371 None] Delete snapshot completed successfully. Sep 17 22:04:28 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-1801f6cc-29dc-4806-8f1b-62e456c1d1e5 tempest-VolumesSnapshotTestJSON-1092695371 None] Lock "cinder-f5e8364c-b262-4223-9a84-57778b3188a7-delete_snapshot" released by "delete_snapshot" :: held 2.715s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:04:29 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-4c3e0962-d652-4185-a11d-87314b4ef65e tempest-VolumesSnapshotTestJSON-1092695371 None] Acquiring lock "cinder-c50689db-ee80-4498-83ea-3c3ffecb6aba-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:04:29 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-4c3e0962-d652-4185-a11d-87314b4ef65e tempest-VolumesSnapshotTestJSON-1092695371 None] Lock "cinder-c50689db-ee80-4498-83ea-3c3ffecb6aba-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:04:29 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-4c3e0962-d652-4185-a11d-87314b4ef65e tempest-VolumesSnapshotTestJSON-1092695371 None] Acquiring lock "cinder-quobyte-c50689db-ee80-4498-83ea-3c3ffecb6aba" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:04:29 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-4c3e0962-d652-4185-a11d-87314b4ef65e tempest-VolumesSnapshotTestJSON-1092695371 None] Lock "cinder-quobyte-c50689db-ee80-4498-83ea-3c3ffecb6aba" acquired by "delete_volume" :: waited 0.024s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:04:29 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bcc54b2-4903-444a-a022-04327e408ab3]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:04:29 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-4c3e0962-d652-4185-a11d-87314b4ef65e tempest-VolumesSnapshotTestJSON-1092695371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c50689db-ee80-4498-83ea-3c3ffecb6aba {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:04:30 devstack sudo[100444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c50689db-ee80-4498-83ea-3c3ffecb6aba Sep 17 22:04:30 devstack sudo[100444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:04:30 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e3f2984-ea6a-41d1-87cd-72e240bea790 tempest-ProjectReaderTests-175105665 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 22:04:30 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-5e3f2984-ea6a-41d1-87cd-72e240bea790 tempest-ProjectReaderTests-175105665 None] Flow 'volume_create_manager' (ec838610-58e8-4848-b5f9-f3b9658980a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:04:30 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-5e3f2984-ea6a-41d1-87cd-72e240bea790 tempest-ProjectReaderTests-175105665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c71743ee-a606-410e-b4f2-d1fde202aeb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:04:30 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-5e3f2984-ea6a-41d1-87cd-72e240bea790 tempest-ProjectReaderTests-175105665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c71743ee-a606-410e-b4f2-d1fde202aeb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:04:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1438920047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b007343e-7f26-4edf-8098-7a072ac57124,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1418d283606644b18a40060d970a6492',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:04:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:04:30Z,use_quota=True,user_id='646b61c416c54d229245c2fae0e5d260',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:04:30 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-5e3f2984-ea6a-41d1-87cd-72e240bea790 tempest-ProjectReaderTests-175105665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56b3fda5-8ac1-4e48-9a08-3c417816e3c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:04:30 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-5e3f2984-ea6a-41d1-87cd-72e240bea790 tempest-ProjectReaderTests-175105665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56b3fda5-8ac1-4e48-9a08-3c417816e3c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:04:30 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-5e3f2984-ea6a-41d1-87cd-72e240bea790 tempest-ProjectReaderTests-175105665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4829c5ac-b0ce-4226-a4e0-b0fe84b1d509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:04:30 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-5e3f2984-ea6a-41d1-87cd-72e240bea790 tempest-ProjectReaderTests-175105665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4829c5ac-b0ce-4226-a4e0-b0fe84b1d509) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b007343e-7f26-4edf-8098-7a072ac57124', 'volume_name': 'volume-b007343e-7f26-4edf-8098-7a072ac57124', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:04:30 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-5e3f2984-ea6a-41d1-87cd-72e240bea790 tempest-ProjectReaderTests-175105665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49fc7803-ff9d-4e5d-b264-bcce9d48c4a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:04:30 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-5e3f2984-ea6a-41d1-87cd-72e240bea790 tempest-ProjectReaderTests-175105665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49fc7803-ff9d-4e5d-b264-bcce9d48c4a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:04:30 devstack sudo[100444]: pam_unix(sudo:session): session closed for user root Sep 17 22:04:30 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-5e3f2984-ea6a-41d1-87cd-72e240bea790 tempest-ProjectReaderTests-175105665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebdcd9aa-d1b3-43a3-9fc8-898644528600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:04:30 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-5e3f2984-ea6a-41d1-87cd-72e240bea790 tempest-ProjectReaderTests-175105665 None] Volume b007343e-7f26-4edf-8098-7a072ac57124: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b007343e-7f26-4edf-8098-7a072ac57124', 'volume_size': 1} Sep 17 22:04:30 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-5e3f2984-ea6a-41d1-87cd-72e240bea790 tempest-ProjectReaderTests-175105665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:04:30 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-5e3f2984-ea6a-41d1-87cd-72e240bea790 tempest-ProjectReaderTests-175105665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:04:30 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-5e3f2984-ea6a-41d1-87cd-72e240bea790 tempest-ProjectReaderTests-175105665 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:04:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1438920047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b007343e-7f26-4edf-8098-7a072ac57124,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1418d283606644b18a40060d970a6492',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:04:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:04:30Z,use_quota=True,user_id='646b61c416c54d229245c2fae0e5d260',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 22:04:30 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-5e3f2984-ea6a-41d1-87cd-72e240bea790 tempest-ProjectReaderTests-175105665 None] Creating volume b007343e-7f26-4edf-8098-7a072ac57124 {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 22:04:30 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-5e3f2984-ea6a-41d1-87cd-72e240bea790 tempest-ProjectReaderTests-175105665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:04:30 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-5e3f2984-ea6a-41d1-87cd-72e240bea790 tempest-ProjectReaderTests-175105665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:04:30 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-5e3f2984-ea6a-41d1-87cd-72e240bea790 tempest-ProjectReaderTests-175105665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:04:30 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-5e3f2984-ea6a-41d1-87cd-72e240bea790 tempest-ProjectReaderTests-175105665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:04:30 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-5e3f2984-ea6a-41d1-87cd-72e240bea790 tempest-ProjectReaderTests-175105665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:04:30 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-5e3f2984-ea6a-41d1-87cd-72e240bea790 tempest-ProjectReaderTests-175105665 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 22:04:30 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-5e3f2984-ea6a-41d1-87cd-72e240bea790 tempest-ProjectReaderTests-175105665 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 22:04:30 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-5e3f2984-ea6a-41d1-87cd-72e240bea790 tempest-ProjectReaderTests-175105665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b007343e-7f26-4edf-8098-7a072ac57124 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:04:30 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-4c3e0962-d652-4185-a11d-87314b4ef65e tempest-VolumesSnapshotTestJSON-1092695371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c50689db-ee80-4498-83ea-3c3ffecb6aba" returned: 0 in 0.718s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:04:30 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-4c3e0962-d652-4185-a11d-87314b4ef65e tempest-VolumesSnapshotTestJSON-1092695371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c50689db-ee80-4498-83ea-3c3ffecb6aba {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:04:30 devstack sudo[100454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b007343e-7f26-4edf-8098-7a072ac57124 1073741824 Sep 17 22:04:30 devstack sudo[100454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:04:30 devstack sudo[100455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c50689db-ee80-4498-83ea-3c3ffecb6aba Sep 17 22:04:30 devstack sudo[100455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:04:30 devstack cinder-volume[85458]: INFO cinder.volume.manager [req-128d244a-6ceb-416e-b603-be10098fafbd req-71abdb15-15f2-4bb6-9a37-97187a2b0557 tempest-TestMinimumBasicScenario-96395444 None] Terminate volume connection completed successfully. Sep 17 22:04:30 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [req-128d244a-6ceb-416e-b603-be10098fafbd req-71abdb15-15f2-4bb6-9a37-97187a2b0557 tempest-TestMinimumBasicScenario-96395444 None] Deleting attachment 90cba9aa-73d2-4c6f-9834-f9e7d95adb62. {{(pid=85458) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 22:04:30 devstack sudo[100455]: pam_unix(sudo:session): session closed for user root Sep 17 22:04:30 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-4c3e0962-d652-4185-a11d-87314b4ef65e tempest-VolumesSnapshotTestJSON-1092695371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c50689db-ee80-4498-83ea-3c3ffecb6aba" returned: 0 in 0.390s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:04:30 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-4c3e0962-d652-4185-a11d-87314b4ef65e tempest-VolumesSnapshotTestJSON-1092695371 None] Lock "cinder-quobyte-c50689db-ee80-4498-83ea-3c3ffecb6aba" released by "delete_volume" :: held 1.256s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:04:31 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-4c3e0962-d652-4185-a11d-87314b4ef65e tempest-VolumesSnapshotTestJSON-1092695371 None] Created reservations ['2d80b870-a1a9-4cd7-befd-96dfeb0cc17f', 'c7319cc5-555c-4998-9b88-a70a449d616e', 'dde4fe54-daa9-4171-a1e1-d3f4dd26ba79', 'af36a048-e6a8-4491-ab22-cedd777cd10c'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:04:31 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-4c3e0962-d652-4185-a11d-87314b4ef65e tempest-VolumesSnapshotTestJSON-1092695371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:04:31 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-4c3e0962-d652-4185-a11d-87314b4ef65e tempest-VolumesSnapshotTestJSON-1092695371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:04:31 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-4c3e0962-d652-4185-a11d-87314b4ef65e tempest-VolumesSnapshotTestJSON-1092695371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:04:31 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-4c3e0962-d652-4185-a11d-87314b4ef65e tempest-VolumesSnapshotTestJSON-1092695371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:04:31 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-4c3e0962-d652-4185-a11d-87314b4ef65e tempest-VolumesSnapshotTestJSON-1092695371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:04:31 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-4c3e0962-d652-4185-a11d-87314b4ef65e tempest-VolumesSnapshotTestJSON-1092695371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:04:31 devstack sudo[100470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:04:31 devstack sudo[100470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:04:31 devstack sudo[100454]: pam_unix(sudo:session): session closed for user root Sep 17 22:04:31 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-5e3f2984-ea6a-41d1-87cd-72e240bea790 tempest-ProjectReaderTests-175105665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b007343e-7f26-4edf-8098-7a072ac57124 1073741824" returned: 0 in 0.833s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:04:31 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-5e3f2984-ea6a-41d1-87cd-72e240bea790 tempest-ProjectReaderTests-175105665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b007343e-7f26-4edf-8098-7a072ac57124 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:04:31 devstack sudo[100473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b007343e-7f26-4edf-8098-7a072ac57124 Sep 17 22:04:31 devstack sudo[100473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:04:31 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-caae92f1-d99c-4cb1-8af3-7586c2617f5a tempest-TestMinimumBasicScenario-96395444 None] Acquiring lock "cinder-d6153e5e-4f58-4344-b5ae-660bfc3686fa-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:04:31 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-caae92f1-d99c-4cb1-8af3-7586c2617f5a tempest-TestMinimumBasicScenario-96395444 None] Lock "cinder-d6153e5e-4f58-4344-b5ae-660bfc3686fa-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:04:31 devstack sudo[100470]: pam_unix(sudo:session): session closed for user root Sep 17 22:04:31 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-4c3e0962-d652-4185-a11d-87314b4ef65e tempest-VolumesSnapshotTestJSON-1092695371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.378s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:04:31 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-4c3e0962-d652-4185-a11d-87314b4ef65e tempest-VolumesSnapshotTestJSON-1092695371 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:04:31 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-4c3e0962-d652-4185-a11d-87314b4ef65e tempest-VolumesSnapshotTestJSON-1092695371 None] Deleted volume successfully. Sep 17 22:04:31 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-caae92f1-d99c-4cb1-8af3-7586c2617f5a tempest-TestMinimumBasicScenario-96395444 None] Acquiring lock "cinder-quobyte-d6153e5e-4f58-4344-b5ae-660bfc3686fa" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:04:31 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-caae92f1-d99c-4cb1-8af3-7586c2617f5a tempest-TestMinimumBasicScenario-96395444 None] Lock "cinder-quobyte-d6153e5e-4f58-4344-b5ae-660bfc3686fa" acquired by "delete_volume" :: waited 0.023s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:04:31 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-4c3e0962-d652-4185-a11d-87314b4ef65e tempest-VolumesSnapshotTestJSON-1092695371 None] Lock "cinder-c50689db-ee80-4498-83ea-3c3ffecb6aba-delete_volume" released by "delete_volume" :: held 2.077s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:04:31 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba2f574b-9a4c-428c-96e7-331e3a3bafd9]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:04:31 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-caae92f1-d99c-4cb1-8af3-7586c2617f5a tempest-TestMinimumBasicScenario-96395444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-d6153e5e-4f58-4344-b5ae-660bfc3686fa {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:04:31 devstack sudo[100473]: pam_unix(sudo:session): session closed for user root Sep 17 22:04:31 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-5e3f2984-ea6a-41d1-87cd-72e240bea790 tempest-ProjectReaderTests-175105665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b007343e-7f26-4edf-8098-7a072ac57124" returned: 0 in 0.354s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:04:31 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-5e3f2984-ea6a-41d1-87cd-72e240bea790 tempest-ProjectReaderTests-175105665 None] <== create_volume: return (1251ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 22:04:31 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-5e3f2984-ea6a-41d1-87cd-72e240bea790 tempest-ProjectReaderTests-175105665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.255s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:04:31 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-5e3f2984-ea6a-41d1-87cd-72e240bea790 tempest-ProjectReaderTests-175105665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebdcd9aa-d1b3-43a3-9fc8-898644528600) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b007343e-7f26-4edf-8098-7a072ac57124', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:04:31 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-5e3f2984-ea6a-41d1-87cd-72e240bea790 tempest-ProjectReaderTests-175105665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ed0f6b9-8892-4bf7-9da0-c0865895d20b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:04:31 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-5e3f2984-ea6a-41d1-87cd-72e240bea790 tempest-ProjectReaderTests-175105665 None] Volume volume-b007343e-7f26-4edf-8098-7a072ac57124 (b007343e-7f26-4edf-8098-7a072ac57124): created successfully Sep 17 22:04:31 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-5e3f2984-ea6a-41d1-87cd-72e240bea790 tempest-ProjectReaderTests-175105665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ed0f6b9-8892-4bf7-9da0-c0865895d20b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:04:31 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-5e3f2984-ea6a-41d1-87cd-72e240bea790 tempest-ProjectReaderTests-175105665 None] Flow 'volume_create_manager' (ec838610-58e8-4848-b5f9-f3b9658980a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:04:31 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-5e3f2984-ea6a-41d1-87cd-72e240bea790 tempest-ProjectReaderTests-175105665 None] Created volume successfully. Sep 17 22:04:31 devstack sudo[100477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-d6153e5e-4f58-4344-b5ae-660bfc3686fa Sep 17 22:04:31 devstack sudo[100477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:04:32 devstack sudo[100477]: pam_unix(sudo:session): session closed for user root Sep 17 22:04:32 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-caae92f1-d99c-4cb1-8af3-7586c2617f5a tempest-TestMinimumBasicScenario-96395444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-d6153e5e-4f58-4344-b5ae-660bfc3686fa" returned: 0 in 0.485s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:04:32 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-caae92f1-d99c-4cb1-8af3-7586c2617f5a tempest-TestMinimumBasicScenario-96395444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-d6153e5e-4f58-4344-b5ae-660bfc3686fa {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:04:32 devstack sudo[100482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-d6153e5e-4f58-4344-b5ae-660bfc3686fa Sep 17 22:04:32 devstack sudo[100482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:04:32 devstack sudo[100482]: pam_unix(sudo:session): session closed for user root Sep 17 22:04:32 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-caae92f1-d99c-4cb1-8af3-7586c2617f5a tempest-TestMinimumBasicScenario-96395444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-d6153e5e-4f58-4344-b5ae-660bfc3686fa" returned: 0 in 0.292s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:04:32 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-caae92f1-d99c-4cb1-8af3-7586c2617f5a tempest-TestMinimumBasicScenario-96395444 None] Lock "cinder-quobyte-d6153e5e-4f58-4344-b5ae-660bfc3686fa" released by "delete_volume" :: held 0.835s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:04:32 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-caae92f1-d99c-4cb1-8af3-7586c2617f5a tempest-TestMinimumBasicScenario-96395444 None] Created reservations ['3ef9badc-a3c5-49b8-9354-3b6d54803fef', '29e96a61-bfbd-45e7-aedd-ca96900a525d', 'b74415cd-361d-4187-a335-5b0efbb70f03', '320eedf3-fa8c-4b39-b735-5c282536f46b'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:04:32 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-caae92f1-d99c-4cb1-8af3-7586c2617f5a tempest-TestMinimumBasicScenario-96395444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:04:32 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-caae92f1-d99c-4cb1-8af3-7586c2617f5a tempest-TestMinimumBasicScenario-96395444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:04:32 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-caae92f1-d99c-4cb1-8af3-7586c2617f5a tempest-TestMinimumBasicScenario-96395444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:04:32 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-caae92f1-d99c-4cb1-8af3-7586c2617f5a tempest-TestMinimumBasicScenario-96395444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:04:32 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-caae92f1-d99c-4cb1-8af3-7586c2617f5a tempest-TestMinimumBasicScenario-96395444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:04:32 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-caae92f1-d99c-4cb1-8af3-7586c2617f5a tempest-TestMinimumBasicScenario-96395444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:04:32 devstack sudo[100485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:04:32 devstack sudo[100485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:04:32 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-65dcde74-6fdb-46e1-85ae-de1fffdfccca tempest-VolumesSnapshotTestJSON-1092695371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 22:04:32 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-65dcde74-6fdb-46e1-85ae-de1fffdfccca tempest-VolumesSnapshotTestJSON-1092695371 None] Flow 'volume_create_manager' (152f8db6-7544-4a84-b587-d27ae900233a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:04:32 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-65dcde74-6fdb-46e1-85ae-de1fffdfccca tempest-VolumesSnapshotTestJSON-1092695371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3320bb49-9ba6-4111-89d4-9e11752b6112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:04:32 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-594def2e-84a2-413a-8fb3-dd3bcedc6195 tempest-ProjectReaderTests-175105665 None] Acquiring lock "cinder-b007343e-7f26-4edf-8098-7a072ac57124-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:04:32 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-65dcde74-6fdb-46e1-85ae-de1fffdfccca tempest-VolumesSnapshotTestJSON-1092695371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3320bb49-9ba6-4111-89d4-9e11752b6112) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:04:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1451056709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe4fb451-3297-4fc6-a9a0-40abf22adfdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06cd571a5b3a4923912443d726b16adb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:04:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:04:33Z,use_quota=True,user_id='53305d3d19814893af8139460c405901',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:04:32 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-65dcde74-6fdb-46e1-85ae-de1fffdfccca tempest-VolumesSnapshotTestJSON-1092695371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f85e0619-ed29-466e-b287-be51e4f4da9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:04:32 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-65dcde74-6fdb-46e1-85ae-de1fffdfccca tempest-VolumesSnapshotTestJSON-1092695371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f85e0619-ed29-466e-b287-be51e4f4da9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:04:32 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-65dcde74-6fdb-46e1-85ae-de1fffdfccca tempest-VolumesSnapshotTestJSON-1092695371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (529ab62d-e2ad-4048-8e08-72a8d55dbb4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:04:32 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-65dcde74-6fdb-46e1-85ae-de1fffdfccca tempest-VolumesSnapshotTestJSON-1092695371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (529ab62d-e2ad-4048-8e08-72a8d55dbb4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe4fb451-3297-4fc6-a9a0-40abf22adfdc', 'volume_name': 'volume-fe4fb451-3297-4fc6-a9a0-40abf22adfdc', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:04:32 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-65dcde74-6fdb-46e1-85ae-de1fffdfccca tempest-VolumesSnapshotTestJSON-1092695371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cee56ef5-b1ed-4790-a358-65385ade4dbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:04:32 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-65dcde74-6fdb-46e1-85ae-de1fffdfccca tempest-VolumesSnapshotTestJSON-1092695371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cee56ef5-b1ed-4790-a358-65385ade4dbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:04:32 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-65dcde74-6fdb-46e1-85ae-de1fffdfccca tempest-VolumesSnapshotTestJSON-1092695371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f46c7daf-6bc5-4fc2-8476-ddf7472f5635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:04:32 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-65dcde74-6fdb-46e1-85ae-de1fffdfccca tempest-VolumesSnapshotTestJSON-1092695371 None] Volume fe4fb451-3297-4fc6-a9a0-40abf22adfdc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe4fb451-3297-4fc6-a9a0-40abf22adfdc', 'volume_size': 1} Sep 17 22:04:32 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-65dcde74-6fdb-46e1-85ae-de1fffdfccca tempest-VolumesSnapshotTestJSON-1092695371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:04:32 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-65dcde74-6fdb-46e1-85ae-de1fffdfccca tempest-VolumesSnapshotTestJSON-1092695371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:04:32 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-65dcde74-6fdb-46e1-85ae-de1fffdfccca tempest-VolumesSnapshotTestJSON-1092695371 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:04:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1451056709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe4fb451-3297-4fc6-a9a0-40abf22adfdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06cd571a5b3a4923912443d726b16adb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:04:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:04:33Z,use_quota=True,user_id='53305d3d19814893af8139460c405901',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 22:04:32 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-65dcde74-6fdb-46e1-85ae-de1fffdfccca tempest-VolumesSnapshotTestJSON-1092695371 None] Creating volume fe4fb451-3297-4fc6-a9a0-40abf22adfdc {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 22:04:32 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-65dcde74-6fdb-46e1-85ae-de1fffdfccca tempest-VolumesSnapshotTestJSON-1092695371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:04:32 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-65dcde74-6fdb-46e1-85ae-de1fffdfccca tempest-VolumesSnapshotTestJSON-1092695371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:04:32 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-65dcde74-6fdb-46e1-85ae-de1fffdfccca tempest-VolumesSnapshotTestJSON-1092695371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:04:32 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-65dcde74-6fdb-46e1-85ae-de1fffdfccca tempest-VolumesSnapshotTestJSON-1092695371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:04:32 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-65dcde74-6fdb-46e1-85ae-de1fffdfccca tempest-VolumesSnapshotTestJSON-1092695371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:04:32 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-65dcde74-6fdb-46e1-85ae-de1fffdfccca tempest-VolumesSnapshotTestJSON-1092695371 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 22:04:32 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-65dcde74-6fdb-46e1-85ae-de1fffdfccca tempest-VolumesSnapshotTestJSON-1092695371 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 22:04:32 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-65dcde74-6fdb-46e1-85ae-de1fffdfccca tempest-VolumesSnapshotTestJSON-1092695371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-fe4fb451-3297-4fc6-a9a0-40abf22adfdc 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:04:33 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-594def2e-84a2-413a-8fb3-dd3bcedc6195 tempest-ProjectReaderTests-175105665 None] Lock "cinder-b007343e-7f26-4edf-8098-7a072ac57124-delete_volume" acquired by "delete_volume" :: waited 0.155s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:04:33 devstack sudo[100487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-fe4fb451-3297-4fc6-a9a0-40abf22adfdc 1073741824 Sep 17 22:04:33 devstack sudo[100487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:04:33 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-594def2e-84a2-413a-8fb3-dd3bcedc6195 tempest-ProjectReaderTests-175105665 None] Acquiring lock "cinder-quobyte-b007343e-7f26-4edf-8098-7a072ac57124" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:04:33 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-594def2e-84a2-413a-8fb3-dd3bcedc6195 tempest-ProjectReaderTests-175105665 None] Lock "cinder-quobyte-b007343e-7f26-4edf-8098-7a072ac57124" acquired by "delete_volume" :: waited 0.025s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:04:33 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cf09a0e-bf11-467a-9108-eafdece734b3]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:04:33 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-594def2e-84a2-413a-8fb3-dd3bcedc6195 tempest-ProjectReaderTests-175105665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b007343e-7f26-4edf-8098-7a072ac57124 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:04:33 devstack sudo[100485]: pam_unix(sudo:session): session closed for user root Sep 17 22:04:33 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-caae92f1-d99c-4cb1-8af3-7586c2617f5a tempest-TestMinimumBasicScenario-96395444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.521s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:04:33 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-caae92f1-d99c-4cb1-8af3-7586c2617f5a tempest-TestMinimumBasicScenario-96395444 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:04:33 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-caae92f1-d99c-4cb1-8af3-7586c2617f5a tempest-TestMinimumBasicScenario-96395444 None] Deleted volume successfully. Sep 17 22:04:33 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-caae92f1-d99c-4cb1-8af3-7586c2617f5a tempest-TestMinimumBasicScenario-96395444 None] Lock "cinder-d6153e5e-4f58-4344-b5ae-660bfc3686fa-delete_volume" released by "delete_volume" :: held 1.753s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:04:33 devstack sudo[100490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b007343e-7f26-4edf-8098-7a072ac57124 Sep 17 22:04:33 devstack sudo[100490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:04:33 devstack sudo[100490]: pam_unix(sudo:session): session closed for user root Sep 17 22:04:33 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-594def2e-84a2-413a-8fb3-dd3bcedc6195 tempest-ProjectReaderTests-175105665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b007343e-7f26-4edf-8098-7a072ac57124" returned: 0 in 0.600s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:04:33 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-594def2e-84a2-413a-8fb3-dd3bcedc6195 tempest-ProjectReaderTests-175105665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b007343e-7f26-4edf-8098-7a072ac57124 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:04:33 devstack sudo[100518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b007343e-7f26-4edf-8098-7a072ac57124 Sep 17 22:04:33 devstack sudo[100518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:04:33 devstack sudo[100487]: pam_unix(sudo:session): session closed for user root Sep 17 22:04:33 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-65dcde74-6fdb-46e1-85ae-de1fffdfccca tempest-VolumesSnapshotTestJSON-1092695371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-fe4fb451-3297-4fc6-a9a0-40abf22adfdc 1073741824" returned: 0 in 0.921s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:04:33 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-65dcde74-6fdb-46e1-85ae-de1fffdfccca tempest-VolumesSnapshotTestJSON-1092695371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-fe4fb451-3297-4fc6-a9a0-40abf22adfdc {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:04:33 devstack sudo[100520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-fe4fb451-3297-4fc6-a9a0-40abf22adfdc Sep 17 22:04:33 devstack sudo[100520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:04:34 devstack sudo[100518]: pam_unix(sudo:session): session closed for user root Sep 17 22:04:34 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-594def2e-84a2-413a-8fb3-dd3bcedc6195 tempest-ProjectReaderTests-175105665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b007343e-7f26-4edf-8098-7a072ac57124" returned: 0 in 0.426s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:04:34 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-594def2e-84a2-413a-8fb3-dd3bcedc6195 tempest-ProjectReaderTests-175105665 None] Lock "cinder-quobyte-b007343e-7f26-4edf-8098-7a072ac57124" released by "delete_volume" :: held 1.100s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:04:34 devstack sudo[100520]: pam_unix(sudo:session): session closed for user root Sep 17 22:04:34 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-65dcde74-6fdb-46e1-85ae-de1fffdfccca tempest-VolumesSnapshotTestJSON-1092695371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-fe4fb451-3297-4fc6-a9a0-40abf22adfdc" returned: 0 in 0.391s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:04:34 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-65dcde74-6fdb-46e1-85ae-de1fffdfccca tempest-VolumesSnapshotTestJSON-1092695371 None] <== create_volume: return (1381ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 22:04:34 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-65dcde74-6fdb-46e1-85ae-de1fffdfccca tempest-VolumesSnapshotTestJSON-1092695371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.385s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:04:34 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-65dcde74-6fdb-46e1-85ae-de1fffdfccca tempest-VolumesSnapshotTestJSON-1092695371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f46c7daf-6bc5-4fc2-8476-ddf7472f5635) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe4fb451-3297-4fc6-a9a0-40abf22adfdc', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:04:34 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-65dcde74-6fdb-46e1-85ae-de1fffdfccca tempest-VolumesSnapshotTestJSON-1092695371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79abb1c3-a00c-4705-8077-1e548e3dbefb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:04:34 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-594def2e-84a2-413a-8fb3-dd3bcedc6195 tempest-ProjectReaderTests-175105665 None] Created reservations ['8c771277-0bf7-4de7-b779-75fdcf70c4ac', '64e42690-c9f6-437b-a306-af5dfee4fd7e', 'a77f8f6a-e256-4032-985c-babd08f733b7', 'c4b5082c-6fdd-409a-bc3e-71e2b752626f'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:04:34 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-65dcde74-6fdb-46e1-85ae-de1fffdfccca tempest-VolumesSnapshotTestJSON-1092695371 None] Volume volume-fe4fb451-3297-4fc6-a9a0-40abf22adfdc (fe4fb451-3297-4fc6-a9a0-40abf22adfdc): created successfully Sep 17 22:04:34 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-65dcde74-6fdb-46e1-85ae-de1fffdfccca tempest-VolumesSnapshotTestJSON-1092695371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79abb1c3-a00c-4705-8077-1e548e3dbefb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:04:34 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-65dcde74-6fdb-46e1-85ae-de1fffdfccca tempest-VolumesSnapshotTestJSON-1092695371 None] Flow 'volume_create_manager' (152f8db6-7544-4a84-b587-d27ae900233a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:04:34 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-65dcde74-6fdb-46e1-85ae-de1fffdfccca tempest-VolumesSnapshotTestJSON-1092695371 None] Created volume successfully. Sep 17 22:04:34 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-594def2e-84a2-413a-8fb3-dd3bcedc6195 tempest-ProjectReaderTests-175105665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:04:34 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-594def2e-84a2-413a-8fb3-dd3bcedc6195 tempest-ProjectReaderTests-175105665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:04:34 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-594def2e-84a2-413a-8fb3-dd3bcedc6195 tempest-ProjectReaderTests-175105665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:04:34 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-594def2e-84a2-413a-8fb3-dd3bcedc6195 tempest-ProjectReaderTests-175105665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:04:34 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-594def2e-84a2-413a-8fb3-dd3bcedc6195 tempest-ProjectReaderTests-175105665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:04:34 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-594def2e-84a2-413a-8fb3-dd3bcedc6195 tempest-ProjectReaderTests-175105665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:04:34 devstack sudo[100525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:04:34 devstack sudo[100525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:04:34 devstack sudo[100525]: pam_unix(sudo:session): session closed for user root Sep 17 22:04:34 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-594def2e-84a2-413a-8fb3-dd3bcedc6195 tempest-ProjectReaderTests-175105665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.286s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:04:34 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-594def2e-84a2-413a-8fb3-dd3bcedc6195 tempest-ProjectReaderTests-175105665 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:04:34 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-594def2e-84a2-413a-8fb3-dd3bcedc6195 tempest-ProjectReaderTests-175105665 None] Deleted volume successfully. Sep 17 22:04:34 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-594def2e-84a2-413a-8fb3-dd3bcedc6195 tempest-ProjectReaderTests-175105665 None] Lock "cinder-b007343e-7f26-4edf-8098-7a072ac57124-delete_volume" released by "delete_volume" :: held 1.764s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:04:35 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-17de5f1b-f723-4ce9-9a79-b745405524be tempest-VolumesSnapshotTestJSON-1092695371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:04:35 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-17de5f1b-f723-4ce9-9a79-b745405524be tempest-VolumesSnapshotTestJSON-1092695371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:04:35 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-17de5f1b-f723-4ce9-9a79-b745405524be tempest-VolumesSnapshotTestJSON-1092695371 None] Creating offline snapshot e57bb703-584d-48af-8e8b-91212a1afe94 of volume fe4fb451-3297-4fc6-a9a0-40abf22adfdc {{(pid=85458) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 22:04:35 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[761ed762-6717-47da-be8e-35abd0b1195f]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:04:35 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-17de5f1b-f723-4ce9-9a79-b745405524be tempest-VolumesSnapshotTestJSON-1092695371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-fe4fb451-3297-4fc6-a9a0-40abf22adfdc {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:04:35 devstack sudo[100529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-fe4fb451-3297-4fc6-a9a0-40abf22adfdc Sep 17 22:04:35 devstack sudo[100529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:04:35 devstack sudo[100529]: pam_unix(sudo:session): session closed for user root Sep 17 22:04:35 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-17de5f1b-f723-4ce9-9a79-b745405524be tempest-VolumesSnapshotTestJSON-1092695371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-fe4fb451-3297-4fc6-a9a0-40abf22adfdc" returned: 0 in 0.548s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:04:35 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-17de5f1b-f723-4ce9-9a79-b745405524be tempest-VolumesSnapshotTestJSON-1092695371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-fe4fb451-3297-4fc6-a9a0-40abf22adfdc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-fe4fb451-3297-4fc6-a9a0-40abf22adfdc.e57bb703-584d-48af-8e8b-91212a1afe94 1G {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:04:35 devstack sudo[100535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-fe4fb451-3297-4fc6-a9a0-40abf22adfdc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-fe4fb451-3297-4fc6-a9a0-40abf22adfdc.e57bb703-584d-48af-8e8b-91212a1afe94 1G Sep 17 22:04:35 devstack sudo[100535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:04:35 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-67eaacfa-146c-453f-8df4-d7cf1496d595 tempest-ProjectReaderTests-175105665 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 22:04:35 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-67eaacfa-146c-453f-8df4-d7cf1496d595 tempest-ProjectReaderTests-175105665 None] Flow 'volume_create_manager' (d485e8f3-16d0-4f77-9308-c8788d9221d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:04:35 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-67eaacfa-146c-453f-8df4-d7cf1496d595 tempest-ProjectReaderTests-175105665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7537f1c-70c7-4bbe-92cb-58b220279ee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:04:35 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-67eaacfa-146c-453f-8df4-d7cf1496d595 tempest-ProjectReaderTests-175105665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7537f1c-70c7-4bbe-92cb-58b220279ee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:04:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2044656814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45533abb-d948-4d16-afa5-45b7ef61d10f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1418d283606644b18a40060d970a6492',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:04:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:04:36Z,use_quota=True,user_id='646b61c416c54d229245c2fae0e5d260',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:04:35 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-67eaacfa-146c-453f-8df4-d7cf1496d595 tempest-ProjectReaderTests-175105665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcaaeb9d-b1ac-4155-859a-3afba15971f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:04:35 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-67eaacfa-146c-453f-8df4-d7cf1496d595 tempest-ProjectReaderTests-175105665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcaaeb9d-b1ac-4155-859a-3afba15971f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:04:35 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-67eaacfa-146c-453f-8df4-d7cf1496d595 tempest-ProjectReaderTests-175105665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e012f8f7-bf30-452b-a9d1-f0c94696de8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:04:35 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-67eaacfa-146c-453f-8df4-d7cf1496d595 tempest-ProjectReaderTests-175105665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e012f8f7-bf30-452b-a9d1-f0c94696de8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45533abb-d948-4d16-afa5-45b7ef61d10f', 'volume_name': 'volume-45533abb-d948-4d16-afa5-45b7ef61d10f', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:04:35 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-67eaacfa-146c-453f-8df4-d7cf1496d595 tempest-ProjectReaderTests-175105665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (008b82bb-5b8e-4b70-a572-c8b4e3048ca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:04:35 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-67eaacfa-146c-453f-8df4-d7cf1496d595 tempest-ProjectReaderTests-175105665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (008b82bb-5b8e-4b70-a572-c8b4e3048ca1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:04:35 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-67eaacfa-146c-453f-8df4-d7cf1496d595 tempest-ProjectReaderTests-175105665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69bd8e8e-ad14-40f4-9ee8-63031b49349f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:04:35 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-67eaacfa-146c-453f-8df4-d7cf1496d595 tempest-ProjectReaderTests-175105665 None] Volume 45533abb-d948-4d16-afa5-45b7ef61d10f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45533abb-d948-4d16-afa5-45b7ef61d10f', 'volume_size': 1} Sep 17 22:04:35 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-67eaacfa-146c-453f-8df4-d7cf1496d595 tempest-ProjectReaderTests-175105665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:04:36 devstack sudo[100535]: pam_unix(sudo:session): session closed for user root Sep 17 22:04:36 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-17de5f1b-f723-4ce9-9a79-b745405524be tempest-VolumesSnapshotTestJSON-1092695371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-fe4fb451-3297-4fc6-a9a0-40abf22adfdc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-fe4fb451-3297-4fc6-a9a0-40abf22adfdc.e57bb703-584d-48af-8e8b-91212a1afe94 1G" returned: 0 in 0.565s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:04:36 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-17de5f1b-f723-4ce9-9a79-b745405524be tempest-VolumesSnapshotTestJSON-1092695371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe4fb451-3297-4fc6-a9a0-40abf22adfdc -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-fe4fb451-3297-4fc6-a9a0-40abf22adfdc.e57bb703-584d-48af-8e8b-91212a1afe94 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:04:36 devstack sudo[100540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe4fb451-3297-4fc6-a9a0-40abf22adfdc -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-fe4fb451-3297-4fc6-a9a0-40abf22adfdc.e57bb703-584d-48af-8e8b-91212a1afe94 Sep 17 22:04:36 devstack sudo[100540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:04:36 devstack sudo[100540]: pam_unix(sudo:session): session closed for user root Sep 17 22:04:36 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-17de5f1b-f723-4ce9-9a79-b745405524be tempest-VolumesSnapshotTestJSON-1092695371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe4fb451-3297-4fc6-a9a0-40abf22adfdc -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-fe4fb451-3297-4fc6-a9a0-40abf22adfdc.e57bb703-584d-48af-8e8b-91212a1afe94" returned: 0 in 0.339s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:04:36 devstack cinder-volume[85458]: WARNING cinder.volume.drivers.remotefs [None req-17de5f1b-f723-4ce9-9a79-b745405524be tempest-VolumesSnapshotTestJSON-1092695371 None] /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-fe4fb451-3297-4fc6-a9a0-40abf22adfdc.e57bb703-584d-48af-8e8b-91212a1afe94 is being set with open permissions: ugo+rw Sep 17 22:04:36 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-17de5f1b-f723-4ce9-9a79-b745405524be tempest-VolumesSnapshotTestJSON-1092695371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-fe4fb451-3297-4fc6-a9a0-40abf22adfdc.e57bb703-584d-48af-8e8b-91212a1afe94 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:04:36 devstack sudo[100545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-fe4fb451-3297-4fc6-a9a0-40abf22adfdc.e57bb703-584d-48af-8e8b-91212a1afe94 Sep 17 22:04:36 devstack sudo[100545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:04:36 devstack sudo[100545]: pam_unix(sudo:session): session closed for user root Sep 17 22:04:36 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-17de5f1b-f723-4ce9-9a79-b745405524be tempest-VolumesSnapshotTestJSON-1092695371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-fe4fb451-3297-4fc6-a9a0-40abf22adfdc.e57bb703-584d-48af-8e8b-91212a1afe94" returned: 0 in 0.273s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:04:36 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-17de5f1b-f723-4ce9-9a79-b745405524be tempest-VolumesSnapshotTestJSON-1092695371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-fe4fb451-3297-4fc6-a9a0-40abf22adfdc.info {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:04:36 devstack sudo[100548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-fe4fb451-3297-4fc6-a9a0-40abf22adfdc.info Sep 17 22:04:36 devstack sudo[100548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:04:37 devstack sudo[100548]: pam_unix(sudo:session): session closed for user root Sep 17 22:04:37 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-17de5f1b-f723-4ce9-9a79-b745405524be tempest-VolumesSnapshotTestJSON-1092695371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-fe4fb451-3297-4fc6-a9a0-40abf22adfdc.info" returned: 0 in 0.286s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:04:37 devstack cinder-volume[85458]: WARNING cinder.volume.drivers.remotefs [None req-17de5f1b-f723-4ce9-9a79-b745405524be tempest-VolumesSnapshotTestJSON-1092695371 None] /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-fe4fb451-3297-4fc6-a9a0-40abf22adfdc.info is being set with open permissions: ugo+rw Sep 17 22:04:37 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-17de5f1b-f723-4ce9-9a79-b745405524be tempest-VolumesSnapshotTestJSON-1092695371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-fe4fb451-3297-4fc6-a9a0-40abf22adfdc.info {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:04:37 devstack sudo[100551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-fe4fb451-3297-4fc6-a9a0-40abf22adfdc.info Sep 17 22:04:37 devstack sudo[100551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:04:37 devstack sudo[100551]: pam_unix(sudo:session): session closed for user root Sep 17 22:04:37 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-17de5f1b-f723-4ce9-9a79-b745405524be tempest-VolumesSnapshotTestJSON-1092695371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-fe4fb451-3297-4fc6-a9a0-40abf22adfdc.info" returned: 0 in 0.329s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:04:37 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-17de5f1b-f723-4ce9-9a79-b745405524be tempest-VolumesSnapshotTestJSON-1092695371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.466s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:04:37 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-67eaacfa-146c-453f-8df4-d7cf1496d595 tempest-ProjectReaderTests-175105665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.552s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:04:37 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-67eaacfa-146c-453f-8df4-d7cf1496d595 tempest-ProjectReaderTests-175105665 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:04:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2044656814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45533abb-d948-4d16-afa5-45b7ef61d10f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1418d283606644b18a40060d970a6492',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:04:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:04:36Z,use_quota=True,user_id='646b61c416c54d229245c2fae0e5d260',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 22:04:37 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-67eaacfa-146c-453f-8df4-d7cf1496d595 tempest-ProjectReaderTests-175105665 None] Creating volume 45533abb-d948-4d16-afa5-45b7ef61d10f {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 22:04:37 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-67eaacfa-146c-453f-8df4-d7cf1496d595 tempest-ProjectReaderTests-175105665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:04:37 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-67eaacfa-146c-453f-8df4-d7cf1496d595 tempest-ProjectReaderTests-175105665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:04:37 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-67eaacfa-146c-453f-8df4-d7cf1496d595 tempest-ProjectReaderTests-175105665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:04:37 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-67eaacfa-146c-453f-8df4-d7cf1496d595 tempest-ProjectReaderTests-175105665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:04:37 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-67eaacfa-146c-453f-8df4-d7cf1496d595 tempest-ProjectReaderTests-175105665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:04:37 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-67eaacfa-146c-453f-8df4-d7cf1496d595 tempest-ProjectReaderTests-175105665 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 22:04:37 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-67eaacfa-146c-453f-8df4-d7cf1496d595 tempest-ProjectReaderTests-175105665 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 22:04:37 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-67eaacfa-146c-453f-8df4-d7cf1496d595 tempest-ProjectReaderTests-175105665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-45533abb-d948-4d16-afa5-45b7ef61d10f 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:04:37 devstack sudo[100555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-45533abb-d948-4d16-afa5-45b7ef61d10f 1073741824 Sep 17 22:04:37 devstack sudo[100555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:04:37 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-17de5f1b-f723-4ce9-9a79-b745405524be tempest-VolumesSnapshotTestJSON-1092695371 None] Create snapshot completed successfully Sep 17 22:04:38 devstack sudo[100555]: pam_unix(sudo:session): session closed for user root Sep 17 22:04:38 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-67eaacfa-146c-453f-8df4-d7cf1496d595 tempest-ProjectReaderTests-175105665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-45533abb-d948-4d16-afa5-45b7ef61d10f 1073741824" returned: 0 in 0.553s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:04:38 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-67eaacfa-146c-453f-8df4-d7cf1496d595 tempest-ProjectReaderTests-175105665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-45533abb-d948-4d16-afa5-45b7ef61d10f {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:04:38 devstack sudo[100561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-45533abb-d948-4d16-afa5-45b7ef61d10f Sep 17 22:04:38 devstack sudo[100561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:04:38 devstack sudo[100561]: pam_unix(sudo:session): session closed for user root Sep 17 22:04:38 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-67eaacfa-146c-453f-8df4-d7cf1496d595 tempest-ProjectReaderTests-175105665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-45533abb-d948-4d16-afa5-45b7ef61d10f" returned: 0 in 0.357s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:04:38 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-67eaacfa-146c-453f-8df4-d7cf1496d595 tempest-ProjectReaderTests-175105665 None] <== create_volume: return (981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 22:04:38 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-67eaacfa-146c-453f-8df4-d7cf1496d595 tempest-ProjectReaderTests-175105665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.986s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:04:38 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-67eaacfa-146c-453f-8df4-d7cf1496d595 tempest-ProjectReaderTests-175105665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69bd8e8e-ad14-40f4-9ee8-63031b49349f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45533abb-d948-4d16-afa5-45b7ef61d10f', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:04:38 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-67eaacfa-146c-453f-8df4-d7cf1496d595 tempest-ProjectReaderTests-175105665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb15fd76-dfce-46ea-833c-827188986acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:04:38 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-67eaacfa-146c-453f-8df4-d7cf1496d595 tempest-ProjectReaderTests-175105665 None] Volume volume-45533abb-d948-4d16-afa5-45b7ef61d10f (45533abb-d948-4d16-afa5-45b7ef61d10f): created successfully Sep 17 22:04:38 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-67eaacfa-146c-453f-8df4-d7cf1496d595 tempest-ProjectReaderTests-175105665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb15fd76-dfce-46ea-833c-827188986acf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:04:38 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-67eaacfa-146c-453f-8df4-d7cf1496d595 tempest-ProjectReaderTests-175105665 None] Flow 'volume_create_manager' (d485e8f3-16d0-4f77-9308-c8788d9221d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:04:38 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-67eaacfa-146c-453f-8df4-d7cf1496d595 tempest-ProjectReaderTests-175105665 None] Created volume successfully. Sep 17 22:04:38 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-42519761-2dc2-42cd-b7c5-c8563cf65879 tempest-VolumesSnapshotTestJSON-1092695371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 22:04:38 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-42519761-2dc2-42cd-b7c5-c8563cf65879 tempest-VolumesSnapshotTestJSON-1092695371 None] Flow 'volume_create_manager' (c2d351e2-1e7a-4d55-a7f0-a9fca0f82e6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:04:38 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-42519761-2dc2-42cd-b7c5-c8563cf65879 tempest-VolumesSnapshotTestJSON-1092695371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (597cccb1-29cb-4dc3-929b-852c4d2df3e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:04:38 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-42519761-2dc2-42cd-b7c5-c8563cf65879 tempest-VolumesSnapshotTestJSON-1092695371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (597cccb1-29cb-4dc3-929b-852c4d2df3e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:04:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-601712308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f55a99cb-90bc-45d6-bdb4-296da5cc2d0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06cd571a5b3a4923912443d726b16adb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:04:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e57bb703-584d-48af-8e8b-91212a1afe94,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:04:39Z,use_quota=True,user_id='53305d3d19814893af8139460c405901',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:04:38 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-42519761-2dc2-42cd-b7c5-c8563cf65879 tempest-VolumesSnapshotTestJSON-1092695371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18f45109-1447-4419-b9fe-36cd36f37155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:04:38 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-42519761-2dc2-42cd-b7c5-c8563cf65879 tempest-VolumesSnapshotTestJSON-1092695371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18f45109-1447-4419-b9fe-36cd36f37155) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:04:38 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-42519761-2dc2-42cd-b7c5-c8563cf65879 tempest-VolumesSnapshotTestJSON-1092695371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad93c3c5-5234-45fc-8e28-a10d004947a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:04:38 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-42519761-2dc2-42cd-b7c5-c8563cf65879 tempest-VolumesSnapshotTestJSON-1092695371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad93c3c5-5234-45fc-8e28-a10d004947a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f55a99cb-90bc-45d6-bdb4-296da5cc2d0d', 'volume_name': 'volume-f55a99cb-90bc-45d6-bdb4-296da5cc2d0d', 'volume_size': 1, 'snapshot_id': 'e57bb703-584d-48af-8e8b-91212a1afe94'}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:04:38 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-42519761-2dc2-42cd-b7c5-c8563cf65879 tempest-VolumesSnapshotTestJSON-1092695371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64deead7-aa7a-44d3-ba83-73afcdbe2931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:04:38 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-42519761-2dc2-42cd-b7c5-c8563cf65879 tempest-VolumesSnapshotTestJSON-1092695371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64deead7-aa7a-44d3-ba83-73afcdbe2931) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:04:38 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-42519761-2dc2-42cd-b7c5-c8563cf65879 tempest-VolumesSnapshotTestJSON-1092695371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d38d1eba-e598-4b5d-8374-55c6d1e225a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:04:38 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-42519761-2dc2-42cd-b7c5-c8563cf65879 tempest-VolumesSnapshotTestJSON-1092695371 None] Volume f55a99cb-90bc-45d6-bdb4-296da5cc2d0d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f55a99cb-90bc-45d6-bdb4-296da5cc2d0d', 'volume_size': 1, 'snapshot_id': 'e57bb703-584d-48af-8e8b-91212a1afe94'} Sep 17 22:04:39 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-42519761-2dc2-42cd-b7c5-c8563cf65879 tempest-VolumesSnapshotTestJSON-1092695371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:04:39 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-42519761-2dc2-42cd-b7c5-c8563cf65879 tempest-VolumesSnapshotTestJSON-1092695371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:04:39 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-42519761-2dc2-42cd-b7c5-c8563cf65879 tempest-VolumesSnapshotTestJSON-1092695371 None] Acquiring lock "cinder-quobyte-e57bb703-584d-48af-8e8b-91212a1afe94-f55a99cb-90bc-45d6-bdb4-296da5cc2d0d" by "_create_volume_from_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:04:39 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-42519761-2dc2-42cd-b7c5-c8563cf65879 tempest-VolumesSnapshotTestJSON-1092695371 None] Lock "cinder-quobyte-e57bb703-584d-48af-8e8b-91212a1afe94-f55a99cb-90bc-45d6-bdb4-296da5cc2d0d" acquired by "_create_volume_from_snapshot" :: waited 0.029s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:04:39 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-42519761-2dc2-42cd-b7c5-c8563cf65879 tempest-VolumesSnapshotTestJSON-1092695371 None] Creating volume f55a99cb-90bc-45d6-bdb4-296da5cc2d0d from snapshot e57bb703-584d-48af-8e8b-91212a1afe94 {{(pid=85458) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 17 22:04:39 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-42519761-2dc2-42cd-b7c5-c8563cf65879 tempest-VolumesSnapshotTestJSON-1092695371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:04:39 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-42519761-2dc2-42cd-b7c5-c8563cf65879 tempest-VolumesSnapshotTestJSON-1092695371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:04:39 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-42519761-2dc2-42cd-b7c5-c8563cf65879 tempest-VolumesSnapshotTestJSON-1092695371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:04:39 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-42519761-2dc2-42cd-b7c5-c8563cf65879 tempest-VolumesSnapshotTestJSON-1092695371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:04:39 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-42519761-2dc2-42cd-b7c5-c8563cf65879 tempest-VolumesSnapshotTestJSON-1092695371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:04:39 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-42519761-2dc2-42cd-b7c5-c8563cf65879 tempest-VolumesSnapshotTestJSON-1092695371 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 22:04:39 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-42519761-2dc2-42cd-b7c5-c8563cf65879 tempest-VolumesSnapshotTestJSON-1092695371 None] Acquiring lock "cinder-quobyte-f55a99cb-90bc-45d6-bdb4-296da5cc2d0d" by "_copy_volume_from_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:04:39 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-42519761-2dc2-42cd-b7c5-c8563cf65879 tempest-VolumesSnapshotTestJSON-1092695371 None] Lock "cinder-quobyte-f55a99cb-90bc-45d6-bdb4-296da5cc2d0d" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:04:39 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-42519761-2dc2-42cd-b7c5-c8563cf65879 tempest-VolumesSnapshotTestJSON-1092695371 None] snapshot: e57bb703-584d-48af-8e8b-91212a1afe94, volume: f55a99cb-90bc-45d6-bdb4-296da5cc2d0d, {{(pid=85458) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 17 22:04:39 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-42519761-2dc2-42cd-b7c5-c8563cf65879 tempest-VolumesSnapshotTestJSON-1092695371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:04:39 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-42519761-2dc2-42cd-b7c5-c8563cf65879 tempest-VolumesSnapshotTestJSON-1092695371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:04:39 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-42519761-2dc2-42cd-b7c5-c8563cf65879 tempest-VolumesSnapshotTestJSON-1092695371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:04:39 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-42519761-2dc2-42cd-b7c5-c8563cf65879 tempest-VolumesSnapshotTestJSON-1092695371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:04:39 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-42519761-2dc2-42cd-b7c5-c8563cf65879 tempest-VolumesSnapshotTestJSON-1092695371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:04:39 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfe85b74-22a9-4bb3-951e-fb94480e908f]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:04:39 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-42519761-2dc2-42cd-b7c5-c8563cf65879 tempest-VolumesSnapshotTestJSON-1092695371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-fe4fb451-3297-4fc6-a9a0-40abf22adfdc.e57bb703-584d-48af-8e8b-91212a1afe94 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:04:39 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-0ddbeb88-2e2a-4180-8508-c968d4330506 tempest-ProjectReaderTests-175105665 None] Acquiring lock "cinder-45533abb-d948-4d16-afa5-45b7ef61d10f-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:04:39 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-0ddbeb88-2e2a-4180-8508-c968d4330506 tempest-ProjectReaderTests-175105665 None] Lock "cinder-45533abb-d948-4d16-afa5-45b7ef61d10f-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:04:39 devstack sudo[100565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-fe4fb451-3297-4fc6-a9a0-40abf22adfdc.e57bb703-584d-48af-8e8b-91212a1afe94 Sep 17 22:04:39 devstack sudo[100565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:04:39 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-0ddbeb88-2e2a-4180-8508-c968d4330506 tempest-ProjectReaderTests-175105665 None] Acquiring lock "cinder-quobyte-45533abb-d948-4d16-afa5-45b7ef61d10f" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:04:39 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-0ddbeb88-2e2a-4180-8508-c968d4330506 tempest-ProjectReaderTests-175105665 None] Lock "cinder-quobyte-45533abb-d948-4d16-afa5-45b7ef61d10f" acquired by "delete_volume" :: waited 0.024s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:04:39 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[38971005-5cf6-4925-b34b-d655cfdaab68]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:04:39 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-0ddbeb88-2e2a-4180-8508-c968d4330506 tempest-ProjectReaderTests-175105665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-45533abb-d948-4d16-afa5-45b7ef61d10f {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:04:39 devstack sudo[100568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-45533abb-d948-4d16-afa5-45b7ef61d10f Sep 17 22:04:39 devstack sudo[100568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:04:39 devstack sudo[100565]: pam_unix(sudo:session): session closed for user root Sep 17 22:04:39 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-42519761-2dc2-42cd-b7c5-c8563cf65879 tempest-VolumesSnapshotTestJSON-1092695371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-fe4fb451-3297-4fc6-a9a0-40abf22adfdc.e57bb703-584d-48af-8e8b-91212a1afe94" returned: 0 in 0.504s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:04:39 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-42519761-2dc2-42cd-b7c5-c8563cf65879 tempest-VolumesSnapshotTestJSON-1092695371 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fe4fb451-3297-4fc6-a9a0-40abf22adfdc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85458) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 22:04:39 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[6401337e-153f-4ac2-ac80-886bb2b78634]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:04:39 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-42519761-2dc2-42cd-b7c5-c8563cf65879 tempest-VolumesSnapshotTestJSON-1092695371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-fe4fb451-3297-4fc6-a9a0-40abf22adfdc {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:04:39 devstack sudo[100573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-fe4fb451-3297-4fc6-a9a0-40abf22adfdc Sep 17 22:04:39 devstack sudo[100573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:04:39 devstack sudo[100568]: pam_unix(sudo:session): session closed for user root Sep 17 22:04:39 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-0ddbeb88-2e2a-4180-8508-c968d4330506 tempest-ProjectReaderTests-175105665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-45533abb-d948-4d16-afa5-45b7ef61d10f" returned: 0 in 0.483s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:04:39 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-0ddbeb88-2e2a-4180-8508-c968d4330506 tempest-ProjectReaderTests-175105665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-45533abb-d948-4d16-afa5-45b7ef61d10f {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:04:39 devstack sudo[100579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-45533abb-d948-4d16-afa5-45b7ef61d10f Sep 17 22:04:39 devstack sudo[100579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:04:40 devstack sudo[100573]: pam_unix(sudo:session): session closed for user root Sep 17 22:04:40 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-42519761-2dc2-42cd-b7c5-c8563cf65879 tempest-VolumesSnapshotTestJSON-1092695371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-fe4fb451-3297-4fc6-a9a0-40abf22adfdc" returned: 0 in 0.540s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:04:40 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-42519761-2dc2-42cd-b7c5-c8563cf65879 tempest-VolumesSnapshotTestJSON-1092695371 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-fe4fb451-3297-4fc6-a9a0-40abf22adfdc {{(pid=85458) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 17 22:04:40 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-42519761-2dc2-42cd-b7c5-c8563cf65879 tempest-VolumesSnapshotTestJSON-1092695371 None] Creating direct copy from snapshot {{(pid=85458) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 17 22:04:40 devstack cinder-volume[85458]: DEBUG cinder.utils [None req-42519761-2dc2-42cd-b7c5-c8563cf65879 tempest-VolumesSnapshotTestJSON-1092695371 None] Path /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f55a99cb-90bc-45d6-bdb4-296da5cc2d0d not found in is_blk_device check {{(pid=85458) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 17 22:04:40 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-42519761-2dc2-42cd-b7c5-c8563cf65879 tempest-VolumesSnapshotTestJSON-1092695371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-fe4fb451-3297-4fc6-a9a0-40abf22adfdc /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f55a99cb-90bc-45d6-bdb4-296da5cc2d0d {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:04:40 devstack sudo[100584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-fe4fb451-3297-4fc6-a9a0-40abf22adfdc /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f55a99cb-90bc-45d6-bdb4-296da5cc2d0d Sep 17 22:04:40 devstack sudo[100584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:04:40 devstack sudo[100579]: pam_unix(sudo:session): session closed for user root Sep 17 22:04:40 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-0ddbeb88-2e2a-4180-8508-c968d4330506 tempest-ProjectReaderTests-175105665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-45533abb-d948-4d16-afa5-45b7ef61d10f" returned: 0 in 0.404s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:04:40 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-0ddbeb88-2e2a-4180-8508-c968d4330506 tempest-ProjectReaderTests-175105665 None] Lock "cinder-quobyte-45533abb-d948-4d16-afa5-45b7ef61d10f" released by "delete_volume" :: held 0.975s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:04:40 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-0ddbeb88-2e2a-4180-8508-c968d4330506 tempest-ProjectReaderTests-175105665 None] Created reservations ['42245853-0779-4d3f-9f85-fa3594a7eede', 'cb3f9b19-cb41-4833-ad9d-4ef8d227df37', '13bb312a-f34f-42c5-afcd-f4dcf298673f', '02f97572-739b-49af-b1a8-8c1929c8ce06'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:04:40 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-0ddbeb88-2e2a-4180-8508-c968d4330506 tempest-ProjectReaderTests-175105665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:04:40 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-0ddbeb88-2e2a-4180-8508-c968d4330506 tempest-ProjectReaderTests-175105665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:04:40 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-0ddbeb88-2e2a-4180-8508-c968d4330506 tempest-ProjectReaderTests-175105665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:04:40 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-0ddbeb88-2e2a-4180-8508-c968d4330506 tempest-ProjectReaderTests-175105665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:04:40 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-0ddbeb88-2e2a-4180-8508-c968d4330506 tempest-ProjectReaderTests-175105665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:04:40 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-0ddbeb88-2e2a-4180-8508-c968d4330506 tempest-ProjectReaderTests-175105665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:04:40 devstack sudo[100591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:04:40 devstack sudo[100591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:04:40 devstack sudo[100591]: pam_unix(sudo:session): session closed for user root Sep 17 22:04:40 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-0ddbeb88-2e2a-4180-8508-c968d4330506 tempest-ProjectReaderTests-175105665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.408s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:04:40 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-0ddbeb88-2e2a-4180-8508-c968d4330506 tempest-ProjectReaderTests-175105665 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:04:41 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-0ddbeb88-2e2a-4180-8508-c968d4330506 tempest-ProjectReaderTests-175105665 None] Deleted volume successfully. Sep 17 22:04:41 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-0ddbeb88-2e2a-4180-8508-c968d4330506 tempest-ProjectReaderTests-175105665 None] Lock "cinder-45533abb-d948-4d16-afa5-45b7ef61d10f-delete_volume" released by "delete_volume" :: held 1.808s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:04:43 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-08a6d0e3-1c16-4d57-95f6-c4eeecb63f18 tempest-ProjectReaderTests-175105665 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 22:04:43 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-08a6d0e3-1c16-4d57-95f6-c4eeecb63f18 tempest-ProjectReaderTests-175105665 None] Flow 'volume_create_manager' (8a7f3db5-976b-4b7f-9472-801364cdd400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:04:43 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-08a6d0e3-1c16-4d57-95f6-c4eeecb63f18 tempest-ProjectReaderTests-175105665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ffb4135-9b36-4453-8fb1-f05364a6c62c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:04:43 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-08a6d0e3-1c16-4d57-95f6-c4eeecb63f18 tempest-ProjectReaderTests-175105665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ffb4135-9b36-4453-8fb1-f05364a6c62c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:04:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-814154965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1529b07c-3acb-4049-8e95-a3aa6ec3f2c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1418d283606644b18a40060d970a6492',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:04:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:04:43Z,use_quota=True,user_id='646b61c416c54d229245c2fae0e5d260',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:04:43 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-08a6d0e3-1c16-4d57-95f6-c4eeecb63f18 tempest-ProjectReaderTests-175105665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (761ccf0c-ac00-4b16-b7e4-5a4134a57632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:04:43 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-08a6d0e3-1c16-4d57-95f6-c4eeecb63f18 tempest-ProjectReaderTests-175105665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (761ccf0c-ac00-4b16-b7e4-5a4134a57632) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:04:43 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-08a6d0e3-1c16-4d57-95f6-c4eeecb63f18 tempest-ProjectReaderTests-175105665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fab26379-d81a-4a77-96e7-aa4d159ade64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:04:43 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-08a6d0e3-1c16-4d57-95f6-c4eeecb63f18 tempest-ProjectReaderTests-175105665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fab26379-d81a-4a77-96e7-aa4d159ade64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1529b07c-3acb-4049-8e95-a3aa6ec3f2c3', 'volume_name': 'volume-1529b07c-3acb-4049-8e95-a3aa6ec3f2c3', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:04:43 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-08a6d0e3-1c16-4d57-95f6-c4eeecb63f18 tempest-ProjectReaderTests-175105665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffbb688d-001a-4ff3-8065-553b11d63b67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:04:43 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-08a6d0e3-1c16-4d57-95f6-c4eeecb63f18 tempest-ProjectReaderTests-175105665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffbb688d-001a-4ff3-8065-553b11d63b67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:04:43 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-08a6d0e3-1c16-4d57-95f6-c4eeecb63f18 tempest-ProjectReaderTests-175105665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b92fffef-47ed-41d1-9de0-284cc07b3fe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:04:43 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-08a6d0e3-1c16-4d57-95f6-c4eeecb63f18 tempest-ProjectReaderTests-175105665 None] Volume 1529b07c-3acb-4049-8e95-a3aa6ec3f2c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1529b07c-3acb-4049-8e95-a3aa6ec3f2c3', 'volume_size': 1} Sep 17 22:04:43 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-08a6d0e3-1c16-4d57-95f6-c4eeecb63f18 tempest-ProjectReaderTests-175105665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:04:44 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a8ba274-2b50-44c8-ac4a-7f826258de63 tempest-TestImageHashVerification-572669237 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 22:04:44 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-7a8ba274-2b50-44c8-ac4a-7f826258de63 tempest-TestImageHashVerification-572669237 None] Flow 'volume_create_manager' (b018c92c-ccbb-4879-88ae-939dc25d940e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:04:44 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-7a8ba274-2b50-44c8-ac4a-7f826258de63 tempest-TestImageHashVerification-572669237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8f6dee1-0d26-474e-bc33-e0c673d9aa0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:04:44 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-7a8ba274-2b50-44c8-ac4a-7f826258de63 tempest-TestImageHashVerification-572669237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8f6dee1-0d26-474e-bc33-e0c673d9aa0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:04:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1552634597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f870ca8-8c49-45ca-9f74-2bc6af4bfd98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a5a481fb8884462851aa37adbe120f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:04:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:04:44Z,use_quota=True,user_id='f27fe2a3a8684121b576b1cd97fd59d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:04:44 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-7a8ba274-2b50-44c8-ac4a-7f826258de63 tempest-TestImageHashVerification-572669237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d4498ec-c892-4422-8404-24ef3ffcb4f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:04:44 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-7a8ba274-2b50-44c8-ac4a-7f826258de63 tempest-TestImageHashVerification-572669237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d4498ec-c892-4422-8404-24ef3ffcb4f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:04:44 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-7a8ba274-2b50-44c8-ac4a-7f826258de63 tempest-TestImageHashVerification-572669237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c789d89-81e5-4c2e-8396-5f83413c0a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:04:44 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-7a8ba274-2b50-44c8-ac4a-7f826258de63 tempest-TestImageHashVerification-572669237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c789d89-81e5-4c2e-8396-5f83413c0a59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f870ca8-8c49-45ca-9f74-2bc6af4bfd98', 'volume_name': 'volume-9f870ca8-8c49-45ca-9f74-2bc6af4bfd98', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:04:44 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-7a8ba274-2b50-44c8-ac4a-7f826258de63 tempest-TestImageHashVerification-572669237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7066d5b-ffe3-4bd7-9ad2-fefab324ba58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:04:44 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-7a8ba274-2b50-44c8-ac4a-7f826258de63 tempest-TestImageHashVerification-572669237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7066d5b-ffe3-4bd7-9ad2-fefab324ba58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:04:44 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-7a8ba274-2b50-44c8-ac4a-7f826258de63 tempest-TestImageHashVerification-572669237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a697a69-11d2-48e4-a43a-63799786b92b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:04:44 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-7a8ba274-2b50-44c8-ac4a-7f826258de63 tempest-TestImageHashVerification-572669237 None] Volume 9f870ca8-8c49-45ca-9f74-2bc6af4bfd98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f870ca8-8c49-45ca-9f74-2bc6af4bfd98', 'volume_size': 1} Sep 17 22:04:44 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-7a8ba274-2b50-44c8-ac4a-7f826258de63 tempest-TestImageHashVerification-572669237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:04:48 devstack sudo[100584]: pam_unix(sudo:session): session closed for user root Sep 17 22:04:48 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-42519761-2dc2-42cd-b7c5-c8563cf65879 tempest-VolumesSnapshotTestJSON-1092695371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-fe4fb451-3297-4fc6-a9a0-40abf22adfdc /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f55a99cb-90bc-45d6-bdb4-296da5cc2d0d" returned: 0 in 8.704s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:04:48 devstack cinder-volume[85458]: DEBUG cinder.image.image_utils [None req-42519761-2dc2-42cd-b7c5-c8563cf65879 tempest-VolumesSnapshotTestJSON-1092695371 None] Image conversion details: src /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-fe4fb451-3297-4fc6-a9a0-40abf22adfdc, size 1024.00 MB, duration 8.70 sec, destination /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f55a99cb-90bc-45d6-bdb4-296da5cc2d0d {{(pid=85458) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 17 22:04:48 devstack cinder-volume[85458]: INFO cinder.image.image_utils [None req-42519761-2dc2-42cd-b7c5-c8563cf65879 tempest-VolumesSnapshotTestJSON-1092695371 None] Converted 1024.00 MB image at 117.64 MB/s Sep 17 22:04:48 devstack cinder-volume[85458]: WARNING cinder.volume.drivers.remotefs [None req-42519761-2dc2-42cd-b7c5-c8563cf65879 tempest-VolumesSnapshotTestJSON-1092695371 None] /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f55a99cb-90bc-45d6-bdb4-296da5cc2d0d is being set with open permissions: ugo+rw Sep 17 22:04:48 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-42519761-2dc2-42cd-b7c5-c8563cf65879 tempest-VolumesSnapshotTestJSON-1092695371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f55a99cb-90bc-45d6-bdb4-296da5cc2d0d {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:04:48 devstack sudo[100605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f55a99cb-90bc-45d6-bdb4-296da5cc2d0d Sep 17 22:04:48 devstack sudo[100605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:04:49 devstack sudo[100605]: pam_unix(sudo:session): session closed for user root Sep 17 22:04:49 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-42519761-2dc2-42cd-b7c5-c8563cf65879 tempest-VolumesSnapshotTestJSON-1092695371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f55a99cb-90bc-45d6-bdb4-296da5cc2d0d" returned: 0 in 0.254s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:04:49 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-42519761-2dc2-42cd-b7c5-c8563cf65879 tempest-VolumesSnapshotTestJSON-1092695371 None] Lock "cinder-quobyte-f55a99cb-90bc-45d6-bdb4-296da5cc2d0d" released by "_copy_volume_from_snapshot" :: held 10.129s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:04:49 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-42519761-2dc2-42cd-b7c5-c8563cf65879 tempest-VolumesSnapshotTestJSON-1092695371 None] Lock "cinder-quobyte-e57bb703-584d-48af-8e8b-91212a1afe94-f55a99cb-90bc-45d6-bdb4-296da5cc2d0d" released by "_create_volume_from_snapshot" :: held 10.206s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:04:49 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-42519761-2dc2-42cd-b7c5-c8563cf65879 tempest-VolumesSnapshotTestJSON-1092695371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.237s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:04:49 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-08a6d0e3-1c16-4d57-95f6-c4eeecb63f18 tempest-ProjectReaderTests-175105665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.972s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:04:49 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-08a6d0e3-1c16-4d57-95f6-c4eeecb63f18 tempest-ProjectReaderTests-175105665 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:04:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-814154965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1529b07c-3acb-4049-8e95-a3aa6ec3f2c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1418d283606644b18a40060d970a6492',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:04:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:04:43Z,use_quota=True,user_id='646b61c416c54d229245c2fae0e5d260',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 22:04:49 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-08a6d0e3-1c16-4d57-95f6-c4eeecb63f18 tempest-ProjectReaderTests-175105665 None] Creating volume 1529b07c-3acb-4049-8e95-a3aa6ec3f2c3 {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 22:04:49 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-08a6d0e3-1c16-4d57-95f6-c4eeecb63f18 tempest-ProjectReaderTests-175105665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:04:49 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-08a6d0e3-1c16-4d57-95f6-c4eeecb63f18 tempest-ProjectReaderTests-175105665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:04:49 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-08a6d0e3-1c16-4d57-95f6-c4eeecb63f18 tempest-ProjectReaderTests-175105665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:04:49 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-08a6d0e3-1c16-4d57-95f6-c4eeecb63f18 tempest-ProjectReaderTests-175105665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:04:49 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-08a6d0e3-1c16-4d57-95f6-c4eeecb63f18 tempest-ProjectReaderTests-175105665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:04:49 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-08a6d0e3-1c16-4d57-95f6-c4eeecb63f18 tempest-ProjectReaderTests-175105665 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 22:04:49 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-08a6d0e3-1c16-4d57-95f6-c4eeecb63f18 tempest-ProjectReaderTests-175105665 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 22:04:49 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-08a6d0e3-1c16-4d57-95f6-c4eeecb63f18 tempest-ProjectReaderTests-175105665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-1529b07c-3acb-4049-8e95-a3aa6ec3f2c3 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:04:49 devstack sudo[100609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-1529b07c-3acb-4049-8e95-a3aa6ec3f2c3 1073741824 Sep 17 22:04:49 devstack sudo[100609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:04:49 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-42519761-2dc2-42cd-b7c5-c8563cf65879 tempest-VolumesSnapshotTestJSON-1092695371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d38d1eba-e598-4b5d-8374-55c6d1e225a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f55a99cb-90bc-45d6-bdb4-296da5cc2d0d', 'volume_size': 1, 'snapshot_id': 'e57bb703-584d-48af-8e8b-91212a1afe94'}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:04:49 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-42519761-2dc2-42cd-b7c5-c8563cf65879 tempest-VolumesSnapshotTestJSON-1092695371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bed07ae9-c993-4271-894e-58f4ca6c8a7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:04:49 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-42519761-2dc2-42cd-b7c5-c8563cf65879 tempest-VolumesSnapshotTestJSON-1092695371 None] Volume volume-f55a99cb-90bc-45d6-bdb4-296da5cc2d0d (f55a99cb-90bc-45d6-bdb4-296da5cc2d0d): created successfully Sep 17 22:04:49 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-42519761-2dc2-42cd-b7c5-c8563cf65879 tempest-VolumesSnapshotTestJSON-1092695371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bed07ae9-c993-4271-894e-58f4ca6c8a7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:04:49 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-42519761-2dc2-42cd-b7c5-c8563cf65879 tempest-VolumesSnapshotTestJSON-1092695371 None] Flow 'volume_create_manager' (c2d351e2-1e7a-4d55-a7f0-a9fca0f82e6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:04:49 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-42519761-2dc2-42cd-b7c5-c8563cf65879 tempest-VolumesSnapshotTestJSON-1092695371 None] Created volume successfully. Sep 17 22:04:49 devstack sudo[100609]: pam_unix(sudo:session): session closed for user root Sep 17 22:04:49 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-08a6d0e3-1c16-4d57-95f6-c4eeecb63f18 tempest-ProjectReaderTests-175105665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-1529b07c-3acb-4049-8e95-a3aa6ec3f2c3 1073741824" returned: 0 in 0.438s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:04:49 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-08a6d0e3-1c16-4d57-95f6-c4eeecb63f18 tempest-ProjectReaderTests-175105665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-1529b07c-3acb-4049-8e95-a3aa6ec3f2c3 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:04:49 devstack sudo[100615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-1529b07c-3acb-4049-8e95-a3aa6ec3f2c3 Sep 17 22:04:49 devstack sudo[100615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:04:50 devstack sudo[100615]: pam_unix(sudo:session): session closed for user root Sep 17 22:04:50 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-08a6d0e3-1c16-4d57-95f6-c4eeecb63f18 tempest-ProjectReaderTests-175105665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-1529b07c-3acb-4049-8e95-a3aa6ec3f2c3" returned: 0 in 0.295s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:04:50 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-08a6d0e3-1c16-4d57-95f6-c4eeecb63f18 tempest-ProjectReaderTests-175105665 None] <== create_volume: return (779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 22:04:50 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-08a6d0e3-1c16-4d57-95f6-c4eeecb63f18 tempest-ProjectReaderTests-175105665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.782s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:04:50 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-7a8ba274-2b50-44c8-ac4a-7f826258de63 tempest-TestImageHashVerification-572669237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.276s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:04:50 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-7a8ba274-2b50-44c8-ac4a-7f826258de63 tempest-TestImageHashVerification-572669237 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:04:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1552634597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f870ca8-8c49-45ca-9f74-2bc6af4bfd98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a5a481fb8884462851aa37adbe120f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:04:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:04:44Z,use_quota=True,user_id='f27fe2a3a8684121b576b1cd97fd59d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 22:04:50 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-7a8ba274-2b50-44c8-ac4a-7f826258de63 tempest-TestImageHashVerification-572669237 None] Creating volume 9f870ca8-8c49-45ca-9f74-2bc6af4bfd98 {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 22:04:50 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-7a8ba274-2b50-44c8-ac4a-7f826258de63 tempest-TestImageHashVerification-572669237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:04:50 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-7a8ba274-2b50-44c8-ac4a-7f826258de63 tempest-TestImageHashVerification-572669237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:04:50 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-7a8ba274-2b50-44c8-ac4a-7f826258de63 tempest-TestImageHashVerification-572669237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:04:50 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-7a8ba274-2b50-44c8-ac4a-7f826258de63 tempest-TestImageHashVerification-572669237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:04:50 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-7a8ba274-2b50-44c8-ac4a-7f826258de63 tempest-TestImageHashVerification-572669237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:04:50 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-7a8ba274-2b50-44c8-ac4a-7f826258de63 tempest-TestImageHashVerification-572669237 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 22:04:50 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-7a8ba274-2b50-44c8-ac4a-7f826258de63 tempest-TestImageHashVerification-572669237 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 22:04:50 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-7a8ba274-2b50-44c8-ac4a-7f826258de63 tempest-TestImageHashVerification-572669237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-9f870ca8-8c49-45ca-9f74-2bc6af4bfd98 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:04:50 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-08a6d0e3-1c16-4d57-95f6-c4eeecb63f18 tempest-ProjectReaderTests-175105665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b92fffef-47ed-41d1-9de0-284cc07b3fe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1529b07c-3acb-4049-8e95-a3aa6ec3f2c3', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:04:50 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-08a6d0e3-1c16-4d57-95f6-c4eeecb63f18 tempest-ProjectReaderTests-175105665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54251c52-2623-4fc5-8e1c-72292d97cafe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:04:50 devstack sudo[100619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-9f870ca8-8c49-45ca-9f74-2bc6af4bfd98 1073741824 Sep 17 22:04:50 devstack sudo[100619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:04:50 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-08a6d0e3-1c16-4d57-95f6-c4eeecb63f18 tempest-ProjectReaderTests-175105665 None] Volume volume-1529b07c-3acb-4049-8e95-a3aa6ec3f2c3 (1529b07c-3acb-4049-8e95-a3aa6ec3f2c3): created successfully Sep 17 22:04:50 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-08a6d0e3-1c16-4d57-95f6-c4eeecb63f18 tempest-ProjectReaderTests-175105665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54251c52-2623-4fc5-8e1c-72292d97cafe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:04:50 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-08a6d0e3-1c16-4d57-95f6-c4eeecb63f18 tempest-ProjectReaderTests-175105665 None] Flow 'volume_create_manager' (8a7f3db5-976b-4b7f-9472-801364cdd400) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:04:50 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-08a6d0e3-1c16-4d57-95f6-c4eeecb63f18 tempest-ProjectReaderTests-175105665 None] Created volume successfully. Sep 17 22:04:50 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-29ce34a0-fa87-4ae4-ba6b-323497544867 tempest-VolumesSnapshotTestJSON-1092695371 None] Acquiring lock "cinder-f55a99cb-90bc-45d6-bdb4-296da5cc2d0d-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:04:50 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-29ce34a0-fa87-4ae4-ba6b-323497544867 tempest-VolumesSnapshotTestJSON-1092695371 None] Lock "cinder-f55a99cb-90bc-45d6-bdb4-296da5cc2d0d-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:04:50 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-29ce34a0-fa87-4ae4-ba6b-323497544867 tempest-VolumesSnapshotTestJSON-1092695371 None] Acquiring lock "cinder-quobyte-f55a99cb-90bc-45d6-bdb4-296da5cc2d0d" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:04:50 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-29ce34a0-fa87-4ae4-ba6b-323497544867 tempest-VolumesSnapshotTestJSON-1092695371 None] Lock "cinder-quobyte-f55a99cb-90bc-45d6-bdb4-296da5cc2d0d" acquired by "delete_volume" :: waited 0.019s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:04:50 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[f24be707-f3a8-4276-93be-e11ab751974e]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:04:50 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-29ce34a0-fa87-4ae4-ba6b-323497544867 tempest-VolumesSnapshotTestJSON-1092695371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f55a99cb-90bc-45d6-bdb4-296da5cc2d0d {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:04:50 devstack sudo[100622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f55a99cb-90bc-45d6-bdb4-296da5cc2d0d Sep 17 22:04:50 devstack sudo[100622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:04:50 devstack sudo[100619]: pam_unix(sudo:session): session closed for user root Sep 17 22:04:50 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-7a8ba274-2b50-44c8-ac4a-7f826258de63 tempest-TestImageHashVerification-572669237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-9f870ca8-8c49-45ca-9f74-2bc6af4bfd98 1073741824" returned: 0 in 0.546s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:04:50 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-7a8ba274-2b50-44c8-ac4a-7f826258de63 tempest-TestImageHashVerification-572669237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-9f870ca8-8c49-45ca-9f74-2bc6af4bfd98 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:04:50 devstack sudo[100629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-9f870ca8-8c49-45ca-9f74-2bc6af4bfd98 Sep 17 22:04:50 devstack sudo[100629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:04:50 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-ca3f1e36-1ba9-4a18-a2c6-70c012188e9b tempest-ProjectReaderTests-175105665 None] Acquiring lock "cinder-1529b07c-3acb-4049-8e95-a3aa6ec3f2c3-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:04:50 devstack sudo[100622]: pam_unix(sudo:session): session closed for user root Sep 17 22:04:50 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-ca3f1e36-1ba9-4a18-a2c6-70c012188e9b tempest-ProjectReaderTests-175105665 None] Lock "cinder-1529b07c-3acb-4049-8e95-a3aa6ec3f2c3-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:04:50 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-29ce34a0-fa87-4ae4-ba6b-323497544867 tempest-VolumesSnapshotTestJSON-1092695371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f55a99cb-90bc-45d6-bdb4-296da5cc2d0d" returned: 0 in 0.454s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:04:50 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-29ce34a0-fa87-4ae4-ba6b-323497544867 tempest-VolumesSnapshotTestJSON-1092695371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f55a99cb-90bc-45d6-bdb4-296da5cc2d0d {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:04:50 devstack sudo[100632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f55a99cb-90bc-45d6-bdb4-296da5cc2d0d Sep 17 22:04:50 devstack sudo[100632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:04:50 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-ca3f1e36-1ba9-4a18-a2c6-70c012188e9b tempest-ProjectReaderTests-175105665 None] Acquiring lock "cinder-quobyte-1529b07c-3acb-4049-8e95-a3aa6ec3f2c3" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:04:50 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-ca3f1e36-1ba9-4a18-a2c6-70c012188e9b tempest-ProjectReaderTests-175105665 None] Lock "cinder-quobyte-1529b07c-3acb-4049-8e95-a3aa6ec3f2c3" acquired by "delete_volume" :: waited 0.022s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:04:50 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[174f790a-86b4-468e-9e5f-573abd1f9ee7]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:04:50 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-ca3f1e36-1ba9-4a18-a2c6-70c012188e9b tempest-ProjectReaderTests-175105665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-1529b07c-3acb-4049-8e95-a3aa6ec3f2c3 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:04:50 devstack sudo[100629]: pam_unix(sudo:session): session closed for user root Sep 17 22:04:50 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-7a8ba274-2b50-44c8-ac4a-7f826258de63 tempest-TestImageHashVerification-572669237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-9f870ca8-8c49-45ca-9f74-2bc6af4bfd98" returned: 0 in 0.304s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:04:50 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-7a8ba274-2b50-44c8-ac4a-7f826258de63 tempest-TestImageHashVerification-572669237 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 22:04:50 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-7a8ba274-2b50-44c8-ac4a-7f826258de63 tempest-TestImageHashVerification-572669237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.917s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:04:50 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-7a8ba274-2b50-44c8-ac4a-7f826258de63 tempest-TestImageHashVerification-572669237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a697a69-11d2-48e4-a43a-63799786b92b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f870ca8-8c49-45ca-9f74-2bc6af4bfd98', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:04:50 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-7a8ba274-2b50-44c8-ac4a-7f826258de63 tempest-TestImageHashVerification-572669237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd8f1cf5-9d06-4bc1-93a1-a5acb4d9cee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:04:50 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-7a8ba274-2b50-44c8-ac4a-7f826258de63 tempest-TestImageHashVerification-572669237 None] Volume volume-9f870ca8-8c49-45ca-9f74-2bc6af4bfd98 (9f870ca8-8c49-45ca-9f74-2bc6af4bfd98): created successfully Sep 17 22:04:51 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-7a8ba274-2b50-44c8-ac4a-7f826258de63 tempest-TestImageHashVerification-572669237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd8f1cf5-9d06-4bc1-93a1-a5acb4d9cee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:04:51 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-7a8ba274-2b50-44c8-ac4a-7f826258de63 tempest-TestImageHashVerification-572669237 None] Flow 'volume_create_manager' (b018c92c-ccbb-4879-88ae-939dc25d940e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:04:51 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-7a8ba274-2b50-44c8-ac4a-7f826258de63 tempest-TestImageHashVerification-572669237 None] Created volume successfully. Sep 17 22:04:51 devstack sudo[100634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-1529b07c-3acb-4049-8e95-a3aa6ec3f2c3 Sep 17 22:04:51 devstack sudo[100634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:04:51 devstack sudo[100632]: pam_unix(sudo:session): session closed for user root Sep 17 22:04:51 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-29ce34a0-fa87-4ae4-ba6b-323497544867 tempest-VolumesSnapshotTestJSON-1092695371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f55a99cb-90bc-45d6-bdb4-296da5cc2d0d" returned: 0 in 0.335s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:04:51 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-29ce34a0-fa87-4ae4-ba6b-323497544867 tempest-VolumesSnapshotTestJSON-1092695371 None] Lock "cinder-quobyte-f55a99cb-90bc-45d6-bdb4-296da5cc2d0d" released by "delete_volume" :: held 0.849s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:04:51 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-29ce34a0-fa87-4ae4-ba6b-323497544867 tempest-VolumesSnapshotTestJSON-1092695371 None] Created reservations ['a7d79119-47dc-430e-aa81-eb531391e1d2', '52447288-7301-4f37-a4fc-844b8ff03e55', 'cce0d1d3-f85d-4029-afd1-25e72253ebb4', '9e1d1368-1d19-4f3d-bd97-c61ffdee543f'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:04:51 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-29ce34a0-fa87-4ae4-ba6b-323497544867 tempest-VolumesSnapshotTestJSON-1092695371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:04:51 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-29ce34a0-fa87-4ae4-ba6b-323497544867 tempest-VolumesSnapshotTestJSON-1092695371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:04:51 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-29ce34a0-fa87-4ae4-ba6b-323497544867 tempest-VolumesSnapshotTestJSON-1092695371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:04:51 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-29ce34a0-fa87-4ae4-ba6b-323497544867 tempest-VolumesSnapshotTestJSON-1092695371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:04:51 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-29ce34a0-fa87-4ae4-ba6b-323497544867 tempest-VolumesSnapshotTestJSON-1092695371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:04:51 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-29ce34a0-fa87-4ae4-ba6b-323497544867 tempest-VolumesSnapshotTestJSON-1092695371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:04:51 devstack sudo[100638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:04:51 devstack sudo[100638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:04:51 devstack sudo[100634]: pam_unix(sudo:session): session closed for user root Sep 17 22:04:51 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-ca3f1e36-1ba9-4a18-a2c6-70c012188e9b tempest-ProjectReaderTests-175105665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-1529b07c-3acb-4049-8e95-a3aa6ec3f2c3" returned: 0 in 0.549s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:04:51 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-ca3f1e36-1ba9-4a18-a2c6-70c012188e9b tempest-ProjectReaderTests-175105665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-1529b07c-3acb-4049-8e95-a3aa6ec3f2c3 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:04:51 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-42d1829f-3b80-4383-9968-a1194dd9871d tempest-VolumesSnapshotTestJSON-1092695371 None] Acquiring lock "cinder-e57bb703-584d-48af-8e8b-91212a1afe94-delete_snapshot" by "delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:04:51 devstack sudo[100643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-1529b07c-3acb-4049-8e95-a3aa6ec3f2c3 Sep 17 22:04:51 devstack sudo[100643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:04:51 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-42d1829f-3b80-4383-9968-a1194dd9871d tempest-VolumesSnapshotTestJSON-1092695371 None] Lock "cinder-e57bb703-584d-48af-8e8b-91212a1afe94-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:04:51 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-42d1829f-3b80-4383-9968-a1194dd9871d tempest-VolumesSnapshotTestJSON-1092695371 None] Acquiring lock "cinder-quobyte-fe4fb451-3297-4fc6-a9a0-40abf22adfdc" by "delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:04:51 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-42d1829f-3b80-4383-9968-a1194dd9871d tempest-VolumesSnapshotTestJSON-1092695371 None] Lock "cinder-quobyte-fe4fb451-3297-4fc6-a9a0-40abf22adfdc" acquired by "delete_snapshot" :: waited 0.021s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:04:51 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-42d1829f-3b80-4383-9968-a1194dd9871d tempest-VolumesSnapshotTestJSON-1092695371 None] Acquiring lock "cinder-quobyte-e57bb703-584d-48af-8e8b-91212a1afe94" by "_delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:04:51 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-42d1829f-3b80-4383-9968-a1194dd9871d tempest-VolumesSnapshotTestJSON-1092695371 None] Lock "cinder-quobyte-e57bb703-584d-48af-8e8b-91212a1afe94" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:04:51 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-42d1829f-3b80-4383-9968-a1194dd9871d tempest-VolumesSnapshotTestJSON-1092695371 None] Deleting offline snapshot e57bb703-584d-48af-8e8b-91212a1afe94 of volume fe4fb451-3297-4fc6-a9a0-40abf22adfdc {{(pid=85458) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 22:04:51 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-42d1829f-3b80-4383-9968-a1194dd9871d tempest-VolumesSnapshotTestJSON-1092695371 None] snapshot_file for this snap is: volume-fe4fb451-3297-4fc6-a9a0-40abf22adfdc.e57bb703-584d-48af-8e8b-91212a1afe94 {{(pid=85458) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 22:04:51 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[4591f179-ee48-4585-bb99-b5f09886c5b6]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:04:51 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-42d1829f-3b80-4383-9968-a1194dd9871d tempest-VolumesSnapshotTestJSON-1092695371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-fe4fb451-3297-4fc6-a9a0-40abf22adfdc.e57bb703-584d-48af-8e8b-91212a1afe94 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:04:51 devstack sudo[100638]: pam_unix(sudo:session): session closed for user root Sep 17 22:04:51 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-29ce34a0-fa87-4ae4-ba6b-323497544867 tempest-VolumesSnapshotTestJSON-1092695371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.306s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:04:51 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-29ce34a0-fa87-4ae4-ba6b-323497544867 tempest-VolumesSnapshotTestJSON-1092695371 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:04:51 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-29ce34a0-fa87-4ae4-ba6b-323497544867 tempest-VolumesSnapshotTestJSON-1092695371 None] Deleted volume successfully. Sep 17 22:04:51 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-29ce34a0-fa87-4ae4-ba6b-323497544867 tempest-VolumesSnapshotTestJSON-1092695371 None] Lock "cinder-f55a99cb-90bc-45d6-bdb4-296da5cc2d0d-delete_volume" released by "delete_volume" :: held 1.427s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:04:51 devstack sudo[100646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-fe4fb451-3297-4fc6-a9a0-40abf22adfdc.e57bb703-584d-48af-8e8b-91212a1afe94 Sep 17 22:04:51 devstack sudo[100646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:04:51 devstack sudo[100643]: pam_unix(sudo:session): session closed for user root Sep 17 22:04:51 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-ca3f1e36-1ba9-4a18-a2c6-70c012188e9b tempest-ProjectReaderTests-175105665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-1529b07c-3acb-4049-8e95-a3aa6ec3f2c3" returned: 0 in 0.269s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:04:51 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-ca3f1e36-1ba9-4a18-a2c6-70c012188e9b tempest-ProjectReaderTests-175105665 None] Lock "cinder-quobyte-1529b07c-3acb-4049-8e95-a3aa6ec3f2c3" released by "delete_volume" :: held 0.874s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:04:51 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-ca3f1e36-1ba9-4a18-a2c6-70c012188e9b tempest-ProjectReaderTests-175105665 None] Created reservations ['bf7b24c9-6d1d-445d-9025-94b048b2e12e', '0d738ecd-9136-42a0-90bb-112275d59e76', '42c65f69-1a80-4318-9f30-5aa289ee6593', '782a7524-fe0c-4ae3-8a89-3d67dded6db8'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:04:51 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-ca3f1e36-1ba9-4a18-a2c6-70c012188e9b tempest-ProjectReaderTests-175105665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:04:51 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-ca3f1e36-1ba9-4a18-a2c6-70c012188e9b tempest-ProjectReaderTests-175105665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:04:51 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-ca3f1e36-1ba9-4a18-a2c6-70c012188e9b tempest-ProjectReaderTests-175105665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:04:51 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-ca3f1e36-1ba9-4a18-a2c6-70c012188e9b tempest-ProjectReaderTests-175105665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:04:51 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-ca3f1e36-1ba9-4a18-a2c6-70c012188e9b tempest-ProjectReaderTests-175105665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:04:51 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-ca3f1e36-1ba9-4a18-a2c6-70c012188e9b tempest-ProjectReaderTests-175105665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:04:51 devstack sudo[100649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:04:51 devstack sudo[100649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:04:51 devstack sudo[100646]: pam_unix(sudo:session): session closed for user root Sep 17 22:04:51 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-42d1829f-3b80-4383-9968-a1194dd9871d tempest-VolumesSnapshotTestJSON-1092695371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-fe4fb451-3297-4fc6-a9a0-40abf22adfdc.e57bb703-584d-48af-8e8b-91212a1afe94" returned: 0 in 0.407s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:04:51 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-42d1829f-3b80-4383-9968-a1194dd9871d tempest-VolumesSnapshotTestJSON-1092695371 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fe4fb451-3297-4fc6-a9a0-40abf22adfdc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85458) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 22:04:52 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8d42816-30fa-480f-b196-d77cc2a965e3]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:04:52 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-42d1829f-3b80-4383-9968-a1194dd9871d tempest-VolumesSnapshotTestJSON-1092695371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-fe4fb451-3297-4fc6-a9a0-40abf22adfdc {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:04:52 devstack sudo[100649]: pam_unix(sudo:session): session closed for user root Sep 17 22:04:52 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-ca3f1e36-1ba9-4a18-a2c6-70c012188e9b tempest-ProjectReaderTests-175105665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.297s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:04:52 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-ca3f1e36-1ba9-4a18-a2c6-70c012188e9b tempest-ProjectReaderTests-175105665 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:04:52 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-ca3f1e36-1ba9-4a18-a2c6-70c012188e9b tempest-ProjectReaderTests-175105665 None] Deleted volume successfully. Sep 17 22:04:52 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-ca3f1e36-1ba9-4a18-a2c6-70c012188e9b tempest-ProjectReaderTests-175105665 None] Lock "cinder-1529b07c-3acb-4049-8e95-a3aa6ec3f2c3-delete_volume" released by "delete_volume" :: held 1.471s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:04:52 devstack sudo[100654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-fe4fb451-3297-4fc6-a9a0-40abf22adfdc Sep 17 22:04:52 devstack sudo[100654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:04:52 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-02310526-1bd4-4c11-96fb-a27dbe4991de tempest-ProjectReaderTests-175105665 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 22:04:52 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-02310526-1bd4-4c11-96fb-a27dbe4991de tempest-ProjectReaderTests-175105665 None] Flow 'volume_create_manager' (96efa25f-155d-4a35-9dfe-e6ab7265a0ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:04:52 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-02310526-1bd4-4c11-96fb-a27dbe4991de tempest-ProjectReaderTests-175105665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c25cd2ed-d48c-4b4a-8695-79ac6a0d9b1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:04:52 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-02310526-1bd4-4c11-96fb-a27dbe4991de tempest-ProjectReaderTests-175105665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c25cd2ed-d48c-4b4a-8695-79ac6a0d9b1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:04:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-834935762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b64af961-1509-44f3-8b2a-69c94c0fbbcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1418d283606644b18a40060d970a6492',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:04:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:04:52Z,use_quota=True,user_id='646b61c416c54d229245c2fae0e5d260',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:04:52 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-02310526-1bd4-4c11-96fb-a27dbe4991de tempest-ProjectReaderTests-175105665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f92c108-e2da-467c-8db2-442f3466ba31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:04:52 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-02310526-1bd4-4c11-96fb-a27dbe4991de tempest-ProjectReaderTests-175105665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f92c108-e2da-467c-8db2-442f3466ba31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:04:52 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-02310526-1bd4-4c11-96fb-a27dbe4991de tempest-ProjectReaderTests-175105665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52336f8d-655f-4ffe-9e1a-b1a12e4c6562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:04:52 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-02310526-1bd4-4c11-96fb-a27dbe4991de tempest-ProjectReaderTests-175105665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52336f8d-655f-4ffe-9e1a-b1a12e4c6562) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b64af961-1509-44f3-8b2a-69c94c0fbbcf', 'volume_name': 'volume-b64af961-1509-44f3-8b2a-69c94c0fbbcf', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:04:52 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-02310526-1bd4-4c11-96fb-a27dbe4991de tempest-ProjectReaderTests-175105665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d080968b-e743-4670-b4ae-fbd988ab2544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:04:52 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-02310526-1bd4-4c11-96fb-a27dbe4991de tempest-ProjectReaderTests-175105665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d080968b-e743-4670-b4ae-fbd988ab2544) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:04:52 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-02310526-1bd4-4c11-96fb-a27dbe4991de tempest-ProjectReaderTests-175105665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6c1ba0a-20d0-495a-862c-4dadc9b846ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:04:52 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-02310526-1bd4-4c11-96fb-a27dbe4991de tempest-ProjectReaderTests-175105665 None] Volume b64af961-1509-44f3-8b2a-69c94c0fbbcf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b64af961-1509-44f3-8b2a-69c94c0fbbcf', 'volume_size': 1} Sep 17 22:04:52 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-02310526-1bd4-4c11-96fb-a27dbe4991de tempest-ProjectReaderTests-175105665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:04:52 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-02310526-1bd4-4c11-96fb-a27dbe4991de tempest-ProjectReaderTests-175105665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:04:52 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-02310526-1bd4-4c11-96fb-a27dbe4991de tempest-ProjectReaderTests-175105665 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:04:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-834935762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b64af961-1509-44f3-8b2a-69c94c0fbbcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1418d283606644b18a40060d970a6492',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:04:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:04:52Z,use_quota=True,user_id='646b61c416c54d229245c2fae0e5d260',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 22:04:52 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-02310526-1bd4-4c11-96fb-a27dbe4991de tempest-ProjectReaderTests-175105665 None] Creating volume b64af961-1509-44f3-8b2a-69c94c0fbbcf {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 22:04:52 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-02310526-1bd4-4c11-96fb-a27dbe4991de tempest-ProjectReaderTests-175105665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:04:52 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-02310526-1bd4-4c11-96fb-a27dbe4991de tempest-ProjectReaderTests-175105665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:04:52 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-02310526-1bd4-4c11-96fb-a27dbe4991de tempest-ProjectReaderTests-175105665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:04:52 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-02310526-1bd4-4c11-96fb-a27dbe4991de tempest-ProjectReaderTests-175105665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:04:52 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-02310526-1bd4-4c11-96fb-a27dbe4991de tempest-ProjectReaderTests-175105665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:04:52 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-02310526-1bd4-4c11-96fb-a27dbe4991de tempest-ProjectReaderTests-175105665 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 22:04:52 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-02310526-1bd4-4c11-96fb-a27dbe4991de tempest-ProjectReaderTests-175105665 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 22:04:52 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-02310526-1bd4-4c11-96fb-a27dbe4991de tempest-ProjectReaderTests-175105665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b64af961-1509-44f3-8b2a-69c94c0fbbcf 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:04:52 devstack sudo[100659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b64af961-1509-44f3-8b2a-69c94c0fbbcf 1073741824 Sep 17 22:04:52 devstack sudo[100659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:04:52 devstack sudo[100654]: pam_unix(sudo:session): session closed for user root Sep 17 22:04:52 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-42d1829f-3b80-4383-9968-a1194dd9871d tempest-VolumesSnapshotTestJSON-1092695371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-fe4fb451-3297-4fc6-a9a0-40abf22adfdc" returned: 0 in 0.692s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:04:52 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-42d1829f-3b80-4383-9968-a1194dd9871d tempest-VolumesSnapshotTestJSON-1092695371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-fe4fb451-3297-4fc6-a9a0-40abf22adfdc.e57bb703-584d-48af-8e8b-91212a1afe94 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:04:52 devstack sudo[100663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-fe4fb451-3297-4fc6-a9a0-40abf22adfdc.e57bb703-584d-48af-8e8b-91212a1afe94 Sep 17 22:04:52 devstack sudo[100663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:04:53 devstack sudo[100663]: pam_unix(sudo:session): session closed for user root Sep 17 22:04:53 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-42d1829f-3b80-4383-9968-a1194dd9871d tempest-VolumesSnapshotTestJSON-1092695371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-fe4fb451-3297-4fc6-a9a0-40abf22adfdc.e57bb703-584d-48af-8e8b-91212a1afe94" returned: 0 in 0.389s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:04:53 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-42d1829f-3b80-4383-9968-a1194dd9871d tempest-VolumesSnapshotTestJSON-1092695371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-fe4fb451-3297-4fc6-a9a0-40abf22adfdc.e57bb703-584d-48af-8e8b-91212a1afe94 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:04:53 devstack sudo[100659]: pam_unix(sudo:session): session closed for user root Sep 17 22:04:53 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-02310526-1bd4-4c11-96fb-a27dbe4991de tempest-ProjectReaderTests-175105665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b64af961-1509-44f3-8b2a-69c94c0fbbcf 1073741824" returned: 0 in 0.547s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:04:53 devstack sudo[100671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-fe4fb451-3297-4fc6-a9a0-40abf22adfdc.e57bb703-584d-48af-8e8b-91212a1afe94 Sep 17 22:04:53 devstack sudo[100671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:04:53 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-02310526-1bd4-4c11-96fb-a27dbe4991de tempest-ProjectReaderTests-175105665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b64af961-1509-44f3-8b2a-69c94c0fbbcf {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:04:53 devstack sudo[100673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b64af961-1509-44f3-8b2a-69c94c0fbbcf Sep 17 22:04:53 devstack sudo[100673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:04:53 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-73f6a398-2254-4094-a151-b6b6afefe36b tempest-TestImageHashVerification-572669237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:04:53 devstack sudo[100671]: pam_unix(sudo:session): session closed for user root Sep 17 22:04:53 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-42d1829f-3b80-4383-9968-a1194dd9871d tempest-VolumesSnapshotTestJSON-1092695371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-fe4fb451-3297-4fc6-a9a0-40abf22adfdc.e57bb703-584d-48af-8e8b-91212a1afe94" returned: 0 in 0.388s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:04:53 devstack sudo[100673]: pam_unix(sudo:session): session closed for user root Sep 17 22:04:53 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-02310526-1bd4-4c11-96fb-a27dbe4991de tempest-ProjectReaderTests-175105665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b64af961-1509-44f3-8b2a-69c94c0fbbcf" returned: 0 in 0.363s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:04:53 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-02310526-1bd4-4c11-96fb-a27dbe4991de tempest-ProjectReaderTests-175105665 None] <== create_volume: return (982ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 22:04:53 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-02310526-1bd4-4c11-96fb-a27dbe4991de tempest-ProjectReaderTests-175105665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.985s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:04:53 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-42d1829f-3b80-4383-9968-a1194dd9871d tempest-VolumesSnapshotTestJSON-1092695371 None] Lock "cinder-quobyte-e57bb703-584d-48af-8e8b-91212a1afe94" released by "_delete_snapshot" :: held 2.027s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:04:53 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-73f6a398-2254-4094-a151-b6b6afefe36b tempest-TestImageHashVerification-572669237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.237s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:04:53 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-42d1829f-3b80-4383-9968-a1194dd9871d tempest-VolumesSnapshotTestJSON-1092695371 None] Lock "cinder-quobyte-fe4fb451-3297-4fc6-a9a0-40abf22adfdc" released by "delete_snapshot" :: held 2.063s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:04:53 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-02310526-1bd4-4c11-96fb-a27dbe4991de tempest-ProjectReaderTests-175105665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6c1ba0a-20d0-495a-862c-4dadc9b846ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b64af961-1509-44f3-8b2a-69c94c0fbbcf', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:04:53 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-02310526-1bd4-4c11-96fb-a27dbe4991de tempest-ProjectReaderTests-175105665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe842105-87b9-4573-bc6b-577eb1e77a28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:04:53 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[82d3da63-d469-40a4-94d6-de26f8f426d7]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:04:53 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-73f6a398-2254-4094-a151-b6b6afefe36b tempest-TestImageHashVerification-572669237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-9f870ca8-8c49-45ca-9f74-2bc6af4bfd98 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:04:53 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-02310526-1bd4-4c11-96fb-a27dbe4991de tempest-ProjectReaderTests-175105665 None] Volume volume-b64af961-1509-44f3-8b2a-69c94c0fbbcf (b64af961-1509-44f3-8b2a-69c94c0fbbcf): created successfully Sep 17 22:04:53 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-02310526-1bd4-4c11-96fb-a27dbe4991de tempest-ProjectReaderTests-175105665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe842105-87b9-4573-bc6b-577eb1e77a28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:04:53 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-02310526-1bd4-4c11-96fb-a27dbe4991de tempest-ProjectReaderTests-175105665 None] Flow 'volume_create_manager' (96efa25f-155d-4a35-9dfe-e6ab7265a0ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:04:53 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-02310526-1bd4-4c11-96fb-a27dbe4991de tempest-ProjectReaderTests-175105665 None] Created volume successfully. Sep 17 22:04:53 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-42d1829f-3b80-4383-9968-a1194dd9871d tempest-VolumesSnapshotTestJSON-1092695371 None] Created reservations ['236d5dd4-a4e1-478a-9804-736406e98e8b', '30e72904-1e64-45fc-aa23-551901bbcca2', '5553e5d0-4531-4861-9ddd-ad72afdde9a1', '93e2669f-37dc-439c-a491-7f18a9b7490f'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:04:53 devstack sudo[100678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-9f870ca8-8c49-45ca-9f74-2bc6af4bfd98 Sep 17 22:04:53 devstack sudo[100678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:04:53 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-42d1829f-3b80-4383-9968-a1194dd9871d tempest-VolumesSnapshotTestJSON-1092695371 None] Delete snapshot completed successfully. Sep 17 22:04:53 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-42d1829f-3b80-4383-9968-a1194dd9871d tempest-VolumesSnapshotTestJSON-1092695371 None] Lock "cinder-e57bb703-584d-48af-8e8b-91212a1afe94-delete_snapshot" released by "delete_snapshot" :: held 2.284s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:04:54 devstack sudo[100678]: pam_unix(sudo:session): session closed for user root Sep 17 22:04:54 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-73f6a398-2254-4094-a151-b6b6afefe36b tempest-TestImageHashVerification-572669237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-9f870ca8-8c49-45ca-9f74-2bc6af4bfd98" returned: 0 in 0.419s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:04:54 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef3732f6-d9e8-46f9-ab7d-ce00e7a68143]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:04:54 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-73f6a398-2254-4094-a151-b6b6afefe36b tempest-TestImageHashVerification-572669237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-9f870ca8-8c49-45ca-9f74-2bc6af4bfd98 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:04:54 devstack sudo[100683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-9f870ca8-8c49-45ca-9f74-2bc6af4bfd98 Sep 17 22:04:54 devstack sudo[100683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:04:54 devstack sudo[100683]: pam_unix(sudo:session): session closed for user root Sep 17 22:04:54 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-73f6a398-2254-4094-a151-b6b6afefe36b tempest-TestImageHashVerification-572669237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-9f870ca8-8c49-45ca-9f74-2bc6af4bfd98" returned: 0 in 0.431s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:04:54 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-73f6a398-2254-4094-a151-b6b6afefe36b tempest-TestImageHashVerification-572669237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-9f870ca8-8c49-45ca-9f74-2bc6af4bfd98 /opt/stack/data/cinder/conversion/9f870ca8-8c49-45ca-9f74-2bc6af4bfd98.temp_image.0a9a5cf0-de4d-42d8-a8ae-0a125b03e160_cactj40.img {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:04:54 devstack sudo[100689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-9f870ca8-8c49-45ca-9f74-2bc6af4bfd98 /opt/stack/data/cinder/conversion/9f870ca8-8c49-45ca-9f74-2bc6af4bfd98.temp_image.0a9a5cf0-de4d-42d8-a8ae-0a125b03e160_cactj40.img Sep 17 22:04:54 devstack sudo[100689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:04:54 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-b2971039-6f67-494c-8409-7e8c52b45ac0 tempest-ProjectReaderTests-175105665 None] Acquiring lock "cinder-b64af961-1509-44f3-8b2a-69c94c0fbbcf-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:04:54 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-b2971039-6f67-494c-8409-7e8c52b45ac0 tempest-ProjectReaderTests-175105665 None] Lock "cinder-b64af961-1509-44f3-8b2a-69c94c0fbbcf-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:04:54 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-b2971039-6f67-494c-8409-7e8c52b45ac0 tempest-ProjectReaderTests-175105665 None] Acquiring lock "cinder-quobyte-b64af961-1509-44f3-8b2a-69c94c0fbbcf" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:04:54 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-b2971039-6f67-494c-8409-7e8c52b45ac0 tempest-ProjectReaderTests-175105665 None] Lock "cinder-quobyte-b64af961-1509-44f3-8b2a-69c94c0fbbcf" acquired by "delete_volume" :: waited 0.018s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:04:54 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[89fffcfd-249a-4f5a-8ebb-4e4e91ae78b5]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:04:54 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-b2971039-6f67-494c-8409-7e8c52b45ac0 tempest-ProjectReaderTests-175105665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b64af961-1509-44f3-8b2a-69c94c0fbbcf {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:04:54 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-813d799c-8150-428a-97f4-66351bc416dd tempest-VolumesSnapshotTestJSON-1092695371 None] Acquiring lock "cinder-fe4fb451-3297-4fc6-a9a0-40abf22adfdc-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:04:54 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-813d799c-8150-428a-97f4-66351bc416dd tempest-VolumesSnapshotTestJSON-1092695371 None] Lock "cinder-fe4fb451-3297-4fc6-a9a0-40abf22adfdc-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:04:54 devstack sudo[100693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b64af961-1509-44f3-8b2a-69c94c0fbbcf Sep 17 22:04:54 devstack sudo[100693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:04:54 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-813d799c-8150-428a-97f4-66351bc416dd tempest-VolumesSnapshotTestJSON-1092695371 None] Acquiring lock "cinder-quobyte-fe4fb451-3297-4fc6-a9a0-40abf22adfdc" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:04:54 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-813d799c-8150-428a-97f4-66351bc416dd tempest-VolumesSnapshotTestJSON-1092695371 None] Lock "cinder-quobyte-fe4fb451-3297-4fc6-a9a0-40abf22adfdc" acquired by "delete_volume" :: waited 0.042s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:04:55 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[933f5ebd-582b-492a-8ac8-49cc53e9b76f]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:04:55 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-813d799c-8150-428a-97f4-66351bc416dd tempest-VolumesSnapshotTestJSON-1092695371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-fe4fb451-3297-4fc6-a9a0-40abf22adfdc {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:04:55 devstack sudo[100693]: pam_unix(sudo:session): session closed for user root Sep 17 22:04:55 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-b2971039-6f67-494c-8409-7e8c52b45ac0 tempest-ProjectReaderTests-175105665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b64af961-1509-44f3-8b2a-69c94c0fbbcf" returned: 0 in 0.590s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:04:55 devstack sudo[100705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-fe4fb451-3297-4fc6-a9a0-40abf22adfdc Sep 17 22:04:55 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-b2971039-6f67-494c-8409-7e8c52b45ac0 tempest-ProjectReaderTests-175105665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b64af961-1509-44f3-8b2a-69c94c0fbbcf {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:04:55 devstack sudo[100705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:04:55 devstack sudo[100708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b64af961-1509-44f3-8b2a-69c94c0fbbcf Sep 17 22:04:55 devstack sudo[100708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:04:55 devstack sudo[100705]: pam_unix(sudo:session): session closed for user root Sep 17 22:04:55 devstack sudo[100708]: pam_unix(sudo:session): session closed for user root Sep 17 22:04:55 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-813d799c-8150-428a-97f4-66351bc416dd tempest-VolumesSnapshotTestJSON-1092695371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-fe4fb451-3297-4fc6-a9a0-40abf22adfdc" returned: 0 in 0.914s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:04:55 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-813d799c-8150-428a-97f4-66351bc416dd tempest-VolumesSnapshotTestJSON-1092695371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-fe4fb451-3297-4fc6-a9a0-40abf22adfdc {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:04:56 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-b2971039-6f67-494c-8409-7e8c52b45ac0 tempest-ProjectReaderTests-175105665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b64af961-1509-44f3-8b2a-69c94c0fbbcf" returned: 0 in 0.694s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:04:56 devstack sudo[100715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-fe4fb451-3297-4fc6-a9a0-40abf22adfdc Sep 17 22:04:56 devstack sudo[100715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:04:56 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-b2971039-6f67-494c-8409-7e8c52b45ac0 tempest-ProjectReaderTests-175105665 None] Lock "cinder-quobyte-b64af961-1509-44f3-8b2a-69c94c0fbbcf" released by "delete_volume" :: held 1.384s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:04:56 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-b2971039-6f67-494c-8409-7e8c52b45ac0 tempest-ProjectReaderTests-175105665 None] Created reservations ['56562942-cabd-4481-8c3a-fbe2dd2a10c4', '37cd2910-9a7c-4970-93a3-d6879fead19a', '62940ab9-1716-4645-a68d-e8c48c31bbca', '162f0ceb-ef05-4839-ba30-2c46cdaad552'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:04:56 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-b2971039-6f67-494c-8409-7e8c52b45ac0 tempest-ProjectReaderTests-175105665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:04:56 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-b2971039-6f67-494c-8409-7e8c52b45ac0 tempest-ProjectReaderTests-175105665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:04:56 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-b2971039-6f67-494c-8409-7e8c52b45ac0 tempest-ProjectReaderTests-175105665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:04:56 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-b2971039-6f67-494c-8409-7e8c52b45ac0 tempest-ProjectReaderTests-175105665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:04:56 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-b2971039-6f67-494c-8409-7e8c52b45ac0 tempest-ProjectReaderTests-175105665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:04:56 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-b2971039-6f67-494c-8409-7e8c52b45ac0 tempest-ProjectReaderTests-175105665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:04:56 devstack sudo[100715]: pam_unix(sudo:session): session closed for user root Sep 17 22:04:56 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-813d799c-8150-428a-97f4-66351bc416dd tempest-VolumesSnapshotTestJSON-1092695371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-fe4fb451-3297-4fc6-a9a0-40abf22adfdc" returned: 0 in 0.530s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:04:56 devstack sudo[100718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:04:56 devstack sudo[100718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:04:56 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-813d799c-8150-428a-97f4-66351bc416dd tempest-VolumesSnapshotTestJSON-1092695371 None] Lock "cinder-quobyte-fe4fb451-3297-4fc6-a9a0-40abf22adfdc" released by "delete_volume" :: held 1.596s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:04:56 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-813d799c-8150-428a-97f4-66351bc416dd tempest-VolumesSnapshotTestJSON-1092695371 None] Created reservations ['bbdcdd05-8b99-4df8-b9a9-427b5104b24b', '2a6b1b79-62d1-44ba-ba24-551a22f68062', 'cdde6eea-f4ca-4f9b-aba3-634bdd55251e', '4f2fb392-a1a9-491b-b199-c47f21d57ff9'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:04:56 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-813d799c-8150-428a-97f4-66351bc416dd tempest-VolumesSnapshotTestJSON-1092695371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:04:56 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-813d799c-8150-428a-97f4-66351bc416dd tempest-VolumesSnapshotTestJSON-1092695371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:04:56 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-813d799c-8150-428a-97f4-66351bc416dd tempest-VolumesSnapshotTestJSON-1092695371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:04:56 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-813d799c-8150-428a-97f4-66351bc416dd tempest-VolumesSnapshotTestJSON-1092695371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:04:56 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-813d799c-8150-428a-97f4-66351bc416dd tempest-VolumesSnapshotTestJSON-1092695371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:04:56 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-813d799c-8150-428a-97f4-66351bc416dd tempest-VolumesSnapshotTestJSON-1092695371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:04:56 devstack sudo[100720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:04:56 devstack sudo[100720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:04:56 devstack sudo[100718]: pam_unix(sudo:session): session closed for user root Sep 17 22:04:56 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-b2971039-6f67-494c-8409-7e8c52b45ac0 tempest-ProjectReaderTests-175105665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.518s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:04:56 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-b2971039-6f67-494c-8409-7e8c52b45ac0 tempest-ProjectReaderTests-175105665 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:04:56 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-b2971039-6f67-494c-8409-7e8c52b45ac0 tempest-ProjectReaderTests-175105665 None] Deleted volume successfully. Sep 17 22:04:57 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-b2971039-6f67-494c-8409-7e8c52b45ac0 tempest-ProjectReaderTests-175105665 None] Lock "cinder-b64af961-1509-44f3-8b2a-69c94c0fbbcf-delete_volume" released by "delete_volume" :: held 2.417s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:04:57 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-b716546c-966c-47c2-8c91-cfa254788461 tempest-VolumesSnapshotTestJSON-1092695371 None] Acquiring lock "cinder-db8e1a8f-f5f7-4a60-a0b0-c352da13d12c-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:04:57 devstack sudo[100720]: pam_unix(sudo:session): session closed for user root Sep 17 22:04:57 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-813d799c-8150-428a-97f4-66351bc416dd tempest-VolumesSnapshotTestJSON-1092695371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.736s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:04:57 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-813d799c-8150-428a-97f4-66351bc416dd tempest-VolumesSnapshotTestJSON-1092695371 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:04:57 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-b716546c-966c-47c2-8c91-cfa254788461 tempest-VolumesSnapshotTestJSON-1092695371 None] Lock "cinder-db8e1a8f-f5f7-4a60-a0b0-c352da13d12c-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:04:57 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-813d799c-8150-428a-97f4-66351bc416dd tempest-VolumesSnapshotTestJSON-1092695371 None] Deleted volume successfully. Sep 17 22:04:57 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-813d799c-8150-428a-97f4-66351bc416dd tempest-VolumesSnapshotTestJSON-1092695371 None] Lock "cinder-fe4fb451-3297-4fc6-a9a0-40abf22adfdc-delete_volume" released by "delete_volume" :: held 2.882s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:04:57 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-b716546c-966c-47c2-8c91-cfa254788461 tempest-VolumesSnapshotTestJSON-1092695371 None] Acquiring lock "cinder-quobyte-db8e1a8f-f5f7-4a60-a0b0-c352da13d12c" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:04:57 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-b716546c-966c-47c2-8c91-cfa254788461 tempest-VolumesSnapshotTestJSON-1092695371 None] Lock "cinder-quobyte-db8e1a8f-f5f7-4a60-a0b0-c352da13d12c" acquired by "delete_volume" :: waited 0.025s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:04:57 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed17f231-9c46-4e72-be36-251790ba0021]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:04:57 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-b716546c-966c-47c2-8c91-cfa254788461 tempest-VolumesSnapshotTestJSON-1092695371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-db8e1a8f-f5f7-4a60-a0b0-c352da13d12c {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:04:58 devstack sudo[100724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-db8e1a8f-f5f7-4a60-a0b0-c352da13d12c Sep 17 22:04:58 devstack sudo[100724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:04:58 devstack sudo[100724]: pam_unix(sudo:session): session closed for user root Sep 17 22:04:58 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-b716546c-966c-47c2-8c91-cfa254788461 tempest-VolumesSnapshotTestJSON-1092695371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-db8e1a8f-f5f7-4a60-a0b0-c352da13d12c" returned: 0 in 0.637s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:04:58 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-b716546c-966c-47c2-8c91-cfa254788461 tempest-VolumesSnapshotTestJSON-1092695371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-db8e1a8f-f5f7-4a60-a0b0-c352da13d12c {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:04:58 devstack sudo[100730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-db8e1a8f-f5f7-4a60-a0b0-c352da13d12c Sep 17 22:04:58 devstack sudo[100730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:04:59 devstack sudo[100730]: pam_unix(sudo:session): session closed for user root Sep 17 22:04:59 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-b716546c-966c-47c2-8c91-cfa254788461 tempest-VolumesSnapshotTestJSON-1092695371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-db8e1a8f-f5f7-4a60-a0b0-c352da13d12c" returned: 0 in 0.613s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:04:59 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-b716546c-966c-47c2-8c91-cfa254788461 tempest-VolumesSnapshotTestJSON-1092695371 None] Lock "cinder-quobyte-db8e1a8f-f5f7-4a60-a0b0-c352da13d12c" released by "delete_volume" :: held 1.418s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:04:59 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-b716546c-966c-47c2-8c91-cfa254788461 tempest-VolumesSnapshotTestJSON-1092695371 None] Created reservations ['2b26226e-8c7c-44d3-bec4-d935062c0a7e', 'c4301e0e-eeba-49c8-9659-1a9fba137b35', 'f1c1a791-47c9-42ab-a06f-3c4c6763da56', '85948249-64d5-4fdf-bf2f-d152444bb651'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:04:59 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-b716546c-966c-47c2-8c91-cfa254788461 tempest-VolumesSnapshotTestJSON-1092695371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:04:59 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-b716546c-966c-47c2-8c91-cfa254788461 tempest-VolumesSnapshotTestJSON-1092695371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:04:59 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-b716546c-966c-47c2-8c91-cfa254788461 tempest-VolumesSnapshotTestJSON-1092695371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:04:59 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-b716546c-966c-47c2-8c91-cfa254788461 tempest-VolumesSnapshotTestJSON-1092695371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:04:59 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-b716546c-966c-47c2-8c91-cfa254788461 tempest-VolumesSnapshotTestJSON-1092695371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:04:59 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-b716546c-966c-47c2-8c91-cfa254788461 tempest-VolumesSnapshotTestJSON-1092695371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:04:59 devstack sudo[100734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:04:59 devstack sudo[100734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:05:00 devstack sudo[100734]: pam_unix(sudo:session): session closed for user root Sep 17 22:05:00 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-b716546c-966c-47c2-8c91-cfa254788461 tempest-VolumesSnapshotTestJSON-1092695371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.451s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:05:00 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-b716546c-966c-47c2-8c91-cfa254788461 tempest-VolumesSnapshotTestJSON-1092695371 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:05:00 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-b716546c-966c-47c2-8c91-cfa254788461 tempest-VolumesSnapshotTestJSON-1092695371 None] Deleted volume successfully. Sep 17 22:05:00 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-b716546c-966c-47c2-8c91-cfa254788461 tempest-VolumesSnapshotTestJSON-1092695371 None] Lock "cinder-db8e1a8f-f5f7-4a60-a0b0-c352da13d12c-delete_volume" released by "delete_volume" :: held 2.497s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:05:03 devstack sudo[100689]: pam_unix(sudo:session): session closed for user root Sep 17 22:05:03 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-73f6a398-2254-4094-a151-b6b6afefe36b tempest-TestImageHashVerification-572669237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-9f870ca8-8c49-45ca-9f74-2bc6af4bfd98 /opt/stack/data/cinder/conversion/9f870ca8-8c49-45ca-9f74-2bc6af4bfd98.temp_image.0a9a5cf0-de4d-42d8-a8ae-0a125b03e160_cactj40.img" returned: 0 in 8.733s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:05:03 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbbbb497-e861-4518-aa0a-5c58d51f1536]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:05:03 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-73f6a398-2254-4094-a151-b6b6afefe36b tempest-TestImageHashVerification-572669237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-9f870ca8-8c49-45ca-9f74-2bc6af4bfd98 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:05:03 devstack sudo[100741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-9f870ca8-8c49-45ca-9f74-2bc6af4bfd98 Sep 17 22:05:03 devstack sudo[100741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:05:03 devstack sudo[100741]: pam_unix(sudo:session): session closed for user root Sep 17 22:05:03 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-73f6a398-2254-4094-a151-b6b6afefe36b tempest-TestImageHashVerification-572669237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-9f870ca8-8c49-45ca-9f74-2bc6af4bfd98" returned: 0 in 0.648s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:05:03 devstack cinder-volume[85458]: DEBUG cinder.image.image_utils [None req-73f6a398-2254-4094-a151-b6b6afefe36b tempest-TestImageHashVerification-572669237 None] Image conversion details: src /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-9f870ca8-8c49-45ca-9f74-2bc6af4bfd98, size 1024.00 MB, duration 8.74 sec, destination /opt/stack/data/cinder/conversion/9f870ca8-8c49-45ca-9f74-2bc6af4bfd98.temp_image.0a9a5cf0-de4d-42d8-a8ae-0a125b03e160_cactj40.img {{(pid=85458) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 17 22:05:03 devstack cinder-volume[85458]: INFO cinder.image.image_utils [None req-73f6a398-2254-4094-a151-b6b6afefe36b tempest-TestImageHashVerification-572669237 None] Converted 1024.00 MB image at 117.18 MB/s Sep 17 22:05:03 devstack cinder-volume[85458]: DEBUG cinder.image.image_utils [None req-73f6a398-2254-4094-a151-b6b6afefe36b tempest-TestImageHashVerification-572669237 None] 0a9a5cf0-de4d-42d8-a8ae-0a125b03e160 was raw, no need to convert to raw {{(pid=85458) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 17 22:05:13 devstack cinder-volume[85458]: DEBUG dbcounter [-] [85458] Writing DB stats cinder:SELECT=84,cinder:INSERT=34,cinder:UPDATE=106,cinder:DELETE=14 {{(pid=85458) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 22:05:13 devstack cinder-volume[85458]: DEBUG dbcounter [-] [85458] Writing DB stats cinder:UPDATE=126,cinder:SELECT=84,cinder:INSERT=23,cinder:DELETE=5 {{(pid=85458) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 22:05:27 devstack cinder-volume[85458]: DEBUG oslo_service.periodic_task [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85458) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 22:05:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:05:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:05:27 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:05:27 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:05:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:05:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:05:27 devstack sudo[100786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:05:27 devstack sudo[100786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:05:28 devstack sudo[100786]: pam_unix(sudo:session): session closed for user root Sep 17 22:05:28 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.377s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:05:28 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:05:28 devstack cinder-volume[85458]: DEBUG oslo_service.periodic_task [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Running periodic task VolumeManager._thread_info {{(pid=85458) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 22:05:28 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] thread count: 28 {{(pid=85458) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 22:05:28 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] thread info: [<_MainThread(MainThread, started 127546830999680)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85458) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 22:05:29 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-73f6a398-2254-4094-a151-b6b6afefe36b tempest-TestImageHashVerification-572669237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 35.855s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:05:29 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-73f6a398-2254-4094-a151-b6b6afefe36b tempest-TestImageHashVerification-572669237 None] Uploaded volume to glance image-id: 0a9a5cf0-de4d-42d8-a8ae-0a125b03e160. {{(pid=85458) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 17 22:05:29 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-73f6a398-2254-4094-a151-b6b6afefe36b tempest-TestImageHashVerification-572669237 None] Copy volume to image completed successfully. Sep 17 22:05:31 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-aba31369-0475-48b6-a086-bf4bff0deb5e tempest-TestImageHashVerification-572669237 None] Acquiring lock "cinder-9f870ca8-8c49-45ca-9f74-2bc6af4bfd98-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:05:31 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-aba31369-0475-48b6-a086-bf4bff0deb5e tempest-TestImageHashVerification-572669237 None] Lock "cinder-9f870ca8-8c49-45ca-9f74-2bc6af4bfd98-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:05:31 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-aba31369-0475-48b6-a086-bf4bff0deb5e tempest-TestImageHashVerification-572669237 None] Acquiring lock "cinder-quobyte-9f870ca8-8c49-45ca-9f74-2bc6af4bfd98" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:05:31 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-aba31369-0475-48b6-a086-bf4bff0deb5e tempest-TestImageHashVerification-572669237 None] Lock "cinder-quobyte-9f870ca8-8c49-45ca-9f74-2bc6af4bfd98" acquired by "delete_volume" :: waited 0.020s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:05:31 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[85e0f0c9-064d-45a1-b5b4-5a596c3f05e0]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:05:31 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-aba31369-0475-48b6-a086-bf4bff0deb5e tempest-TestImageHashVerification-572669237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-9f870ca8-8c49-45ca-9f74-2bc6af4bfd98 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:05:31 devstack sudo[100798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-9f870ca8-8c49-45ca-9f74-2bc6af4bfd98 Sep 17 22:05:31 devstack sudo[100798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:05:31 devstack sudo[100798]: pam_unix(sudo:session): session closed for user root Sep 17 22:05:31 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-aba31369-0475-48b6-a086-bf4bff0deb5e tempest-TestImageHashVerification-572669237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-9f870ca8-8c49-45ca-9f74-2bc6af4bfd98" returned: 0 in 0.434s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:05:31 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-aba31369-0475-48b6-a086-bf4bff0deb5e tempest-TestImageHashVerification-572669237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-9f870ca8-8c49-45ca-9f74-2bc6af4bfd98 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:05:31 devstack sudo[100803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-9f870ca8-8c49-45ca-9f74-2bc6af4bfd98 Sep 17 22:05:31 devstack sudo[100803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:05:31 devstack sudo[100803]: pam_unix(sudo:session): session closed for user root Sep 17 22:05:31 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-aba31369-0475-48b6-a086-bf4bff0deb5e tempest-TestImageHashVerification-572669237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-9f870ca8-8c49-45ca-9f74-2bc6af4bfd98" returned: 0 in 0.310s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:05:32 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-aba31369-0475-48b6-a086-bf4bff0deb5e tempest-TestImageHashVerification-572669237 None] Lock "cinder-quobyte-9f870ca8-8c49-45ca-9f74-2bc6af4bfd98" released by "delete_volume" :: held 0.821s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:05:32 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-aba31369-0475-48b6-a086-bf4bff0deb5e tempest-TestImageHashVerification-572669237 None] Created reservations ['ba270e08-3cc3-4b8d-aee9-63874a5c5180', '9886856a-4d1c-4af9-a2d3-2f69c691b652', '201c2fe2-7748-4e06-94f8-a99dcce3c3d2', '7854f636-959e-4091-855d-dbf101665655'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:05:32 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-aba31369-0475-48b6-a086-bf4bff0deb5e tempest-TestImageHashVerification-572669237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:05:32 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-aba31369-0475-48b6-a086-bf4bff0deb5e tempest-TestImageHashVerification-572669237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:05:32 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-aba31369-0475-48b6-a086-bf4bff0deb5e tempest-TestImageHashVerification-572669237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:05:32 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-aba31369-0475-48b6-a086-bf4bff0deb5e tempest-TestImageHashVerification-572669237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:05:32 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-aba31369-0475-48b6-a086-bf4bff0deb5e tempest-TestImageHashVerification-572669237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:05:32 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-aba31369-0475-48b6-a086-bf4bff0deb5e tempest-TestImageHashVerification-572669237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:05:32 devstack sudo[100806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:05:32 devstack sudo[100806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:05:32 devstack sudo[100806]: pam_unix(sudo:session): session closed for user root Sep 17 22:05:32 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-aba31369-0475-48b6-a086-bf4bff0deb5e tempest-TestImageHashVerification-572669237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.284s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:05:32 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-aba31369-0475-48b6-a086-bf4bff0deb5e tempest-TestImageHashVerification-572669237 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:05:32 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-aba31369-0475-48b6-a086-bf4bff0deb5e tempest-TestImageHashVerification-572669237 None] Deleted volume successfully. Sep 17 22:05:32 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-aba31369-0475-48b6-a086-bf4bff0deb5e tempest-TestImageHashVerification-572669237 None] Lock "cinder-9f870ca8-8c49-45ca-9f74-2bc6af4bfd98-delete_volume" released by "delete_volume" :: held 1.429s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:05:42 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9d2f5ab-4a72-46a4-9dfa-f6a408fecbc1 tempest-SnapshotDependencyTests-1307708626 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 22:05:42 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b9d2f5ab-4a72-46a4-9dfa-f6a408fecbc1 tempest-SnapshotDependencyTests-1307708626 None] Flow 'volume_create_manager' (28c3b4e8-41d1-45e1-b59f-85e1b3dcace6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:05:42 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b9d2f5ab-4a72-46a4-9dfa-f6a408fecbc1 tempest-SnapshotDependencyTests-1307708626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03343d31-7417-44a6-b824-eec74722a481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:05:42 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b9d2f5ab-4a72-46a4-9dfa-f6a408fecbc1 tempest-SnapshotDependencyTests-1307708626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03343d31-7417-44a6-b824-eec74722a481) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:05:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1193674576',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c342fb53-f7b6-4bd2-83a6-9ba2707a2ecd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='155adc01a5da43cc9e6d5be5d8403ebe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:05:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:05:42Z,use_quota=True,user_id='a5acacee8ef94c25939cbf15441a51bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:05:42 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b9d2f5ab-4a72-46a4-9dfa-f6a408fecbc1 tempest-SnapshotDependencyTests-1307708626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebdbb9c6-f3be-4df0-88d3-45da4395bf45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:05:42 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b9d2f5ab-4a72-46a4-9dfa-f6a408fecbc1 tempest-SnapshotDependencyTests-1307708626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebdbb9c6-f3be-4df0-88d3-45da4395bf45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:05:42 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b9d2f5ab-4a72-46a4-9dfa-f6a408fecbc1 tempest-SnapshotDependencyTests-1307708626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (500750a7-400e-4ac0-9e9b-4a2399a58cdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:05:42 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b9d2f5ab-4a72-46a4-9dfa-f6a408fecbc1 tempest-SnapshotDependencyTests-1307708626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (500750a7-400e-4ac0-9e9b-4a2399a58cdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c342fb53-f7b6-4bd2-83a6-9ba2707a2ecd', 'volume_name': 'volume-c342fb53-f7b6-4bd2-83a6-9ba2707a2ecd', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:05:42 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b9d2f5ab-4a72-46a4-9dfa-f6a408fecbc1 tempest-SnapshotDependencyTests-1307708626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b732d981-fbb0-4f67-873b-121c8ccb4507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:05:42 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b9d2f5ab-4a72-46a4-9dfa-f6a408fecbc1 tempest-SnapshotDependencyTests-1307708626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b732d981-fbb0-4f67-873b-121c8ccb4507) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:05:42 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b9d2f5ab-4a72-46a4-9dfa-f6a408fecbc1 tempest-SnapshotDependencyTests-1307708626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0435f6e7-5802-40f0-b0b1-d8a1e1a08150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:05:42 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-b9d2f5ab-4a72-46a4-9dfa-f6a408fecbc1 tempest-SnapshotDependencyTests-1307708626 None] Volume c342fb53-f7b6-4bd2-83a6-9ba2707a2ecd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c342fb53-f7b6-4bd2-83a6-9ba2707a2ecd', 'volume_size': 1} Sep 17 22:05:42 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-b9d2f5ab-4a72-46a4-9dfa-f6a408fecbc1 tempest-SnapshotDependencyTests-1307708626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:05:42 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-b9d2f5ab-4a72-46a4-9dfa-f6a408fecbc1 tempest-SnapshotDependencyTests-1307708626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:05:42 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-b9d2f5ab-4a72-46a4-9dfa-f6a408fecbc1 tempest-SnapshotDependencyTests-1307708626 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:05:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1193674576',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c342fb53-f7b6-4bd2-83a6-9ba2707a2ecd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='155adc01a5da43cc9e6d5be5d8403ebe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:05:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:05:42Z,use_quota=True,user_id='a5acacee8ef94c25939cbf15441a51bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 22:05:42 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-b9d2f5ab-4a72-46a4-9dfa-f6a408fecbc1 tempest-SnapshotDependencyTests-1307708626 None] Creating volume c342fb53-f7b6-4bd2-83a6-9ba2707a2ecd {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 22:05:42 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-b9d2f5ab-4a72-46a4-9dfa-f6a408fecbc1 tempest-SnapshotDependencyTests-1307708626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:05:42 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-b9d2f5ab-4a72-46a4-9dfa-f6a408fecbc1 tempest-SnapshotDependencyTests-1307708626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:05:42 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-b9d2f5ab-4a72-46a4-9dfa-f6a408fecbc1 tempest-SnapshotDependencyTests-1307708626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:05:42 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-b9d2f5ab-4a72-46a4-9dfa-f6a408fecbc1 tempest-SnapshotDependencyTests-1307708626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:05:42 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-b9d2f5ab-4a72-46a4-9dfa-f6a408fecbc1 tempest-SnapshotDependencyTests-1307708626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:05:42 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-b9d2f5ab-4a72-46a4-9dfa-f6a408fecbc1 tempest-SnapshotDependencyTests-1307708626 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 22:05:42 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-b9d2f5ab-4a72-46a4-9dfa-f6a408fecbc1 tempest-SnapshotDependencyTests-1307708626 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 22:05:42 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-b9d2f5ab-4a72-46a4-9dfa-f6a408fecbc1 tempest-SnapshotDependencyTests-1307708626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c342fb53-f7b6-4bd2-83a6-9ba2707a2ecd 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:05:42 devstack sudo[100811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c342fb53-f7b6-4bd2-83a6-9ba2707a2ecd 1073741824 Sep 17 22:05:42 devstack sudo[100811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:05:42 devstack sudo[100811]: pam_unix(sudo:session): session closed for user root Sep 17 22:05:42 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-b9d2f5ab-4a72-46a4-9dfa-f6a408fecbc1 tempest-SnapshotDependencyTests-1307708626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c342fb53-f7b6-4bd2-83a6-9ba2707a2ecd 1073741824" returned: 0 in 0.608s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:05:42 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-b9d2f5ab-4a72-46a4-9dfa-f6a408fecbc1 tempest-SnapshotDependencyTests-1307708626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c342fb53-f7b6-4bd2-83a6-9ba2707a2ecd {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:05:42 devstack sudo[100817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c342fb53-f7b6-4bd2-83a6-9ba2707a2ecd Sep 17 22:05:42 devstack sudo[100817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:05:43 devstack sudo[100817]: pam_unix(sudo:session): session closed for user root Sep 17 22:05:43 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-b9d2f5ab-4a72-46a4-9dfa-f6a408fecbc1 tempest-SnapshotDependencyTests-1307708626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c342fb53-f7b6-4bd2-83a6-9ba2707a2ecd" returned: 0 in 0.359s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:05:43 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-b9d2f5ab-4a72-46a4-9dfa-f6a408fecbc1 tempest-SnapshotDependencyTests-1307708626 None] <== create_volume: return (1040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 22:05:43 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-b9d2f5ab-4a72-46a4-9dfa-f6a408fecbc1 tempest-SnapshotDependencyTests-1307708626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.045s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:05:43 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b9d2f5ab-4a72-46a4-9dfa-f6a408fecbc1 tempest-SnapshotDependencyTests-1307708626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0435f6e7-5802-40f0-b0b1-d8a1e1a08150) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c342fb53-f7b6-4bd2-83a6-9ba2707a2ecd', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:05:43 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b9d2f5ab-4a72-46a4-9dfa-f6a408fecbc1 tempest-SnapshotDependencyTests-1307708626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0065de1-6d5f-41c9-b509-58007dc12ef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:05:43 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-b9d2f5ab-4a72-46a4-9dfa-f6a408fecbc1 tempest-SnapshotDependencyTests-1307708626 None] Volume volume-c342fb53-f7b6-4bd2-83a6-9ba2707a2ecd (c342fb53-f7b6-4bd2-83a6-9ba2707a2ecd): created successfully Sep 17 22:05:43 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b9d2f5ab-4a72-46a4-9dfa-f6a408fecbc1 tempest-SnapshotDependencyTests-1307708626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0065de1-6d5f-41c9-b509-58007dc12ef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:05:43 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b9d2f5ab-4a72-46a4-9dfa-f6a408fecbc1 tempest-SnapshotDependencyTests-1307708626 None] Flow 'volume_create_manager' (28c3b4e8-41d1-45e1-b59f-85e1b3dcace6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:05:43 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-b9d2f5ab-4a72-46a4-9dfa-f6a408fecbc1 tempest-SnapshotDependencyTests-1307708626 None] Created volume successfully. Sep 17 22:05:44 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-1f13c99b-ea46-411a-ba07-4a7941ec29aa tempest-SnapshotDependencyTests-1307708626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:05:44 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-1f13c99b-ea46-411a-ba07-4a7941ec29aa tempest-SnapshotDependencyTests-1307708626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:05:44 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-1f13c99b-ea46-411a-ba07-4a7941ec29aa tempest-SnapshotDependencyTests-1307708626 None] Creating offline snapshot 7e6d7bf7-2830-440f-8d08-5b85ee95a385 of volume c342fb53-f7b6-4bd2-83a6-9ba2707a2ecd {{(pid=85458) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 22:05:44 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1e9b312-e736-49cf-b1d5-e913a5d2dd6e]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:05:44 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-1f13c99b-ea46-411a-ba07-4a7941ec29aa tempest-SnapshotDependencyTests-1307708626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c342fb53-f7b6-4bd2-83a6-9ba2707a2ecd {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:05:44 devstack sudo[100821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c342fb53-f7b6-4bd2-83a6-9ba2707a2ecd Sep 17 22:05:44 devstack sudo[100821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:05:45 devstack sudo[100821]: pam_unix(sudo:session): session closed for user root Sep 17 22:05:45 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-1f13c99b-ea46-411a-ba07-4a7941ec29aa tempest-SnapshotDependencyTests-1307708626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c342fb53-f7b6-4bd2-83a6-9ba2707a2ecd" returned: 0 in 0.452s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:05:45 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-1f13c99b-ea46-411a-ba07-4a7941ec29aa tempest-SnapshotDependencyTests-1307708626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c342fb53-f7b6-4bd2-83a6-9ba2707a2ecd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c342fb53-f7b6-4bd2-83a6-9ba2707a2ecd.7e6d7bf7-2830-440f-8d08-5b85ee95a385 1G {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:05:45 devstack sudo[100826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c342fb53-f7b6-4bd2-83a6-9ba2707a2ecd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c342fb53-f7b6-4bd2-83a6-9ba2707a2ecd.7e6d7bf7-2830-440f-8d08-5b85ee95a385 1G Sep 17 22:05:45 devstack sudo[100826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:05:45 devstack sudo[100826]: pam_unix(sudo:session): session closed for user root Sep 17 22:05:45 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-1f13c99b-ea46-411a-ba07-4a7941ec29aa tempest-SnapshotDependencyTests-1307708626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c342fb53-f7b6-4bd2-83a6-9ba2707a2ecd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c342fb53-f7b6-4bd2-83a6-9ba2707a2ecd.7e6d7bf7-2830-440f-8d08-5b85ee95a385 1G" returned: 0 in 0.578s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:05:45 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-1f13c99b-ea46-411a-ba07-4a7941ec29aa tempest-SnapshotDependencyTests-1307708626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c342fb53-f7b6-4bd2-83a6-9ba2707a2ecd -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c342fb53-f7b6-4bd2-83a6-9ba2707a2ecd.7e6d7bf7-2830-440f-8d08-5b85ee95a385 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:05:45 devstack sudo[100831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c342fb53-f7b6-4bd2-83a6-9ba2707a2ecd -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c342fb53-f7b6-4bd2-83a6-9ba2707a2ecd.7e6d7bf7-2830-440f-8d08-5b85ee95a385 Sep 17 22:05:45 devstack sudo[100831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:05:45 devstack sudo[100831]: pam_unix(sudo:session): session closed for user root Sep 17 22:05:45 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-1f13c99b-ea46-411a-ba07-4a7941ec29aa tempest-SnapshotDependencyTests-1307708626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c342fb53-f7b6-4bd2-83a6-9ba2707a2ecd -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c342fb53-f7b6-4bd2-83a6-9ba2707a2ecd.7e6d7bf7-2830-440f-8d08-5b85ee95a385" returned: 0 in 0.348s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:05:45 devstack cinder-volume[85458]: WARNING cinder.volume.drivers.remotefs [None req-1f13c99b-ea46-411a-ba07-4a7941ec29aa tempest-SnapshotDependencyTests-1307708626 None] /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c342fb53-f7b6-4bd2-83a6-9ba2707a2ecd.7e6d7bf7-2830-440f-8d08-5b85ee95a385 is being set with open permissions: ugo+rw Sep 17 22:05:45 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-1f13c99b-ea46-411a-ba07-4a7941ec29aa tempest-SnapshotDependencyTests-1307708626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c342fb53-f7b6-4bd2-83a6-9ba2707a2ecd.7e6d7bf7-2830-440f-8d08-5b85ee95a385 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:05:46 devstack sudo[100836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c342fb53-f7b6-4bd2-83a6-9ba2707a2ecd.7e6d7bf7-2830-440f-8d08-5b85ee95a385 Sep 17 22:05:46 devstack sudo[100836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:05:46 devstack sudo[100836]: pam_unix(sudo:session): session closed for user root Sep 17 22:05:46 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-1f13c99b-ea46-411a-ba07-4a7941ec29aa tempest-SnapshotDependencyTests-1307708626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c342fb53-f7b6-4bd2-83a6-9ba2707a2ecd.7e6d7bf7-2830-440f-8d08-5b85ee95a385" returned: 0 in 0.276s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:05:46 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-1f13c99b-ea46-411a-ba07-4a7941ec29aa tempest-SnapshotDependencyTests-1307708626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c342fb53-f7b6-4bd2-83a6-9ba2707a2ecd.info {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:05:46 devstack sudo[100840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c342fb53-f7b6-4bd2-83a6-9ba2707a2ecd.info Sep 17 22:05:46 devstack sudo[100840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:05:46 devstack sudo[100840]: pam_unix(sudo:session): session closed for user root Sep 17 22:05:46 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-1f13c99b-ea46-411a-ba07-4a7941ec29aa tempest-SnapshotDependencyTests-1307708626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c342fb53-f7b6-4bd2-83a6-9ba2707a2ecd.info" returned: 0 in 0.298s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:05:46 devstack cinder-volume[85458]: WARNING cinder.volume.drivers.remotefs [None req-1f13c99b-ea46-411a-ba07-4a7941ec29aa tempest-SnapshotDependencyTests-1307708626 None] /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c342fb53-f7b6-4bd2-83a6-9ba2707a2ecd.info is being set with open permissions: ugo+rw Sep 17 22:05:46 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-1f13c99b-ea46-411a-ba07-4a7941ec29aa tempest-SnapshotDependencyTests-1307708626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c342fb53-f7b6-4bd2-83a6-9ba2707a2ecd.info {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:05:46 devstack sudo[100843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c342fb53-f7b6-4bd2-83a6-9ba2707a2ecd.info Sep 17 22:05:46 devstack sudo[100843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:05:46 devstack sudo[100843]: pam_unix(sudo:session): session closed for user root Sep 17 22:05:46 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-1f13c99b-ea46-411a-ba07-4a7941ec29aa tempest-SnapshotDependencyTests-1307708626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c342fb53-f7b6-4bd2-83a6-9ba2707a2ecd.info" returned: 0 in 0.263s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:05:46 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-1f13c99b-ea46-411a-ba07-4a7941ec29aa tempest-SnapshotDependencyTests-1307708626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.360s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:05:46 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-1f13c99b-ea46-411a-ba07-4a7941ec29aa tempest-SnapshotDependencyTests-1307708626 None] Create snapshot completed successfully Sep 17 22:05:48 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-54f00050-c8cf-4b5d-a9d3-242e08e2cedb tempest-TestShelveInstance-763943664 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 22:05:48 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-54f00050-c8cf-4b5d-a9d3-242e08e2cedb tempest-TestShelveInstance-763943664 None] Flow 'volume_create_manager' (4d45ef6c-22d1-4b93-b383-2dff1ffcb58f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:05:48 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-54f00050-c8cf-4b5d-a9d3-242e08e2cedb tempest-TestShelveInstance-763943664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70c0686b-19a2-4364-a69d-c989952f4317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:05:48 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-54f00050-c8cf-4b5d-a9d3-242e08e2cedb tempest-TestShelveInstance-763943664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70c0686b-19a2-4364-a69d-c989952f4317) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:05:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-462654834',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5303dab-81aa-4558-b4a2-13fead2fa414,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da66b6a1435d42c394fce8c7f293021e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:05:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:05:48Z,use_quota=True,user_id='a7ac9e10e12b49a0833fd3df6c718df1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:05:48 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-54f00050-c8cf-4b5d-a9d3-242e08e2cedb tempest-TestShelveInstance-763943664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61125509-4a49-4fd4-b5ee-d91041590da2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:05:48 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-54f00050-c8cf-4b5d-a9d3-242e08e2cedb tempest-TestShelveInstance-763943664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61125509-4a49-4fd4-b5ee-d91041590da2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:05:48 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-54f00050-c8cf-4b5d-a9d3-242e08e2cedb tempest-TestShelveInstance-763943664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c5c1afd-b47b-460b-9b92-6a43a47d5a11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:05:48 devstack cinder-volume[85458]: DEBUG cinder.image.glance [None req-54f00050-c8cf-4b5d-a9d3-242e08e2cedb tempest-TestShelveInstance-763943664 None] Creating Keystone auth plugin from conf {{(pid=85458) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 17 22:05:48 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-c111f40c-ce04-4e22-a5db-8aa76817e40f tempest-SnapshotDependencyTests-1307708626 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 22:05:48 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-c111f40c-ce04-4e22-a5db-8aa76817e40f tempest-SnapshotDependencyTests-1307708626 None] Flow 'volume_create_manager' (c60142c2-db43-4c8c-bc8c-e52e9f3f99f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:05:48 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-c111f40c-ce04-4e22-a5db-8aa76817e40f tempest-SnapshotDependencyTests-1307708626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1877493f-2417-4271-8f92-cbdd5cd867a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:05:48 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-c111f40c-ce04-4e22-a5db-8aa76817e40f tempest-SnapshotDependencyTests-1307708626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1877493f-2417-4271-8f92-cbdd5cd867a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:05:48Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b2701a7-d34b-4b87-9189-9eff4e8f6f73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='155adc01a5da43cc9e6d5be5d8403ebe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:05:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7e6d7bf7-2830-440f-8d08-5b85ee95a385,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:05:49Z,use_quota=True,user_id='a5acacee8ef94c25939cbf15441a51bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:05:48 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-c111f40c-ce04-4e22-a5db-8aa76817e40f tempest-SnapshotDependencyTests-1307708626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bb79949-5e77-4516-81bd-53ba406d6bdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:05:48 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-c111f40c-ce04-4e22-a5db-8aa76817e40f tempest-SnapshotDependencyTests-1307708626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bb79949-5e77-4516-81bd-53ba406d6bdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:05:48 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-c111f40c-ce04-4e22-a5db-8aa76817e40f tempest-SnapshotDependencyTests-1307708626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b2d7aca-a764-4b6b-a83b-0dd77372d42a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:05:48 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-c111f40c-ce04-4e22-a5db-8aa76817e40f tempest-SnapshotDependencyTests-1307708626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b2d7aca-a764-4b6b-a83b-0dd77372d42a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4b2701a7-d34b-4b87-9189-9eff4e8f6f73', 'volume_name': 'volume-4b2701a7-d34b-4b87-9189-9eff4e8f6f73', 'volume_size': 1, 'snapshot_id': '7e6d7bf7-2830-440f-8d08-5b85ee95a385'}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:05:48 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-c111f40c-ce04-4e22-a5db-8aa76817e40f tempest-SnapshotDependencyTests-1307708626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0ca771d-7e74-472f-8822-f5892fe293a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:05:48 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-c111f40c-ce04-4e22-a5db-8aa76817e40f tempest-SnapshotDependencyTests-1307708626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0ca771d-7e74-472f-8822-f5892fe293a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:05:48 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-c111f40c-ce04-4e22-a5db-8aa76817e40f tempest-SnapshotDependencyTests-1307708626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f6955ab-b2cf-4665-81c5-dea90d8ea5eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:05:48 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-c111f40c-ce04-4e22-a5db-8aa76817e40f tempest-SnapshotDependencyTests-1307708626 None] Volume 4b2701a7-d34b-4b87-9189-9eff4e8f6f73: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4b2701a7-d34b-4b87-9189-9eff4e8f6f73', 'volume_size': 1, 'snapshot_id': '7e6d7bf7-2830-440f-8d08-5b85ee95a385'} Sep 17 22:05:48 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-c111f40c-ce04-4e22-a5db-8aa76817e40f tempest-SnapshotDependencyTests-1307708626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:05:48 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-c111f40c-ce04-4e22-a5db-8aa76817e40f tempest-SnapshotDependencyTests-1307708626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:05:48 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-c111f40c-ce04-4e22-a5db-8aa76817e40f tempest-SnapshotDependencyTests-1307708626 None] Acquiring lock "cinder-quobyte-7e6d7bf7-2830-440f-8d08-5b85ee95a385-4b2701a7-d34b-4b87-9189-9eff4e8f6f73" by "_create_volume_from_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:05:48 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-c111f40c-ce04-4e22-a5db-8aa76817e40f tempest-SnapshotDependencyTests-1307708626 None] Lock "cinder-quobyte-7e6d7bf7-2830-440f-8d08-5b85ee95a385-4b2701a7-d34b-4b87-9189-9eff4e8f6f73" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:05:48 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-c111f40c-ce04-4e22-a5db-8aa76817e40f tempest-SnapshotDependencyTests-1307708626 None] Creating volume 4b2701a7-d34b-4b87-9189-9eff4e8f6f73 from snapshot 7e6d7bf7-2830-440f-8d08-5b85ee95a385 {{(pid=85458) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 17 22:05:48 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-c111f40c-ce04-4e22-a5db-8aa76817e40f tempest-SnapshotDependencyTests-1307708626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:05:48 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-c111f40c-ce04-4e22-a5db-8aa76817e40f tempest-SnapshotDependencyTests-1307708626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:05:48 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-c111f40c-ce04-4e22-a5db-8aa76817e40f tempest-SnapshotDependencyTests-1307708626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:05:48 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-c111f40c-ce04-4e22-a5db-8aa76817e40f tempest-SnapshotDependencyTests-1307708626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:05:48 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-c111f40c-ce04-4e22-a5db-8aa76817e40f tempest-SnapshotDependencyTests-1307708626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:05:48 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-c111f40c-ce04-4e22-a5db-8aa76817e40f tempest-SnapshotDependencyTests-1307708626 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 22:05:48 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-c111f40c-ce04-4e22-a5db-8aa76817e40f tempest-SnapshotDependencyTests-1307708626 None] Acquiring lock "cinder-quobyte-4b2701a7-d34b-4b87-9189-9eff4e8f6f73" by "_copy_volume_from_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:05:48 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-c111f40c-ce04-4e22-a5db-8aa76817e40f tempest-SnapshotDependencyTests-1307708626 None] Lock "cinder-quobyte-4b2701a7-d34b-4b87-9189-9eff4e8f6f73" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:05:48 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-c111f40c-ce04-4e22-a5db-8aa76817e40f tempest-SnapshotDependencyTests-1307708626 None] snapshot: 7e6d7bf7-2830-440f-8d08-5b85ee95a385, volume: 4b2701a7-d34b-4b87-9189-9eff4e8f6f73, {{(pid=85458) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 17 22:05:48 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-c111f40c-ce04-4e22-a5db-8aa76817e40f tempest-SnapshotDependencyTests-1307708626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:05:48 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-c111f40c-ce04-4e22-a5db-8aa76817e40f tempest-SnapshotDependencyTests-1307708626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:05:48 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-c111f40c-ce04-4e22-a5db-8aa76817e40f tempest-SnapshotDependencyTests-1307708626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:05:48 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-c111f40c-ce04-4e22-a5db-8aa76817e40f tempest-SnapshotDependencyTests-1307708626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:05:48 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-c111f40c-ce04-4e22-a5db-8aa76817e40f tempest-SnapshotDependencyTests-1307708626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:05:48 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f20f3bc-e442-463c-b28e-860ce7bb20aa]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:05:48 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-c111f40c-ce04-4e22-a5db-8aa76817e40f tempest-SnapshotDependencyTests-1307708626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c342fb53-f7b6-4bd2-83a6-9ba2707a2ecd.7e6d7bf7-2830-440f-8d08-5b85ee95a385 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:05:48 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-54f00050-c8cf-4b5d-a9d3-242e08e2cedb tempest-TestShelveInstance-763943664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c5c1afd-b47b-460b-9b92-6a43a47d5a11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f5303dab-81aa-4558-b4a2-13fead2fa414', 'volume_name': 'volume-f5303dab-81aa-4558-b4a2-13fead2fa414', 'volume_size': 1, 'image_id': '764e44ff-49f7-469a-925c-23f254888b59', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/764e44ff-49f7-469a-925c-23f254888b59', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '530062d71c924da39eff46373302dc71', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '764e44ff-49f7-469a-925c-23f254888b59', 'created_at': datetime.datetime(2026, 9, 17, 19, 45, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 19, 45, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/764e44ff-49f7-469a-925c-23f254888b59/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:05:48 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-54f00050-c8cf-4b5d-a9d3-242e08e2cedb tempest-TestShelveInstance-763943664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eff4e75b-7a0a-4711-9b88-d9b0fcbe452d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:05:48 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-54f00050-c8cf-4b5d-a9d3-242e08e2cedb tempest-TestShelveInstance-763943664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eff4e75b-7a0a-4711-9b88-d9b0fcbe452d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:05:48 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-54f00050-c8cf-4b5d-a9d3-242e08e2cedb tempest-TestShelveInstance-763943664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26b4fc98-44ef-45b7-b0c1-b16032c8a7ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:05:48 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-54f00050-c8cf-4b5d-a9d3-242e08e2cedb tempest-TestShelveInstance-763943664 None] Volume f5303dab-81aa-4558-b4a2-13fead2fa414: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f5303dab-81aa-4558-b4a2-13fead2fa414', 'volume_size': 1, 'image_id': '764e44ff-49f7-469a-925c-23f254888b59', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/764e44ff-49f7-469a-925c-23f254888b59', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '530062d71c924da39eff46373302dc71', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '764e44ff-49f7-469a-925c-23f254888b59', 'created_at': datetime.datetime(2026, 9, 17, 19, 45, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 19, 45, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/764e44ff-49f7-469a-925c-23f254888b59/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 17 22:05:48 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-54f00050-c8cf-4b5d-a9d3-242e08e2cedb tempest-TestShelveInstance-763943664 None] Trying to clone f5303dab-81aa-4558-b4a2-13fead2fa414 from image 764e44ff-49f7-469a-925c-23f254888b59 at location (None, [{'url': 'file:///opt/stack/data/glance/images/764e44ff-49f7-469a-925c-23f254888b59', 'metadata': {}}]). {{(pid=85458) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 17 22:05:48 devstack sudo[100847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c342fb53-f7b6-4bd2-83a6-9ba2707a2ecd.7e6d7bf7-2830-440f-8d08-5b85ee95a385 Sep 17 22:05:48 devstack sudo[100847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:05:49 devstack sudo[100847]: pam_unix(sudo:session): session closed for user root Sep 17 22:05:49 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-c111f40c-ce04-4e22-a5db-8aa76817e40f tempest-SnapshotDependencyTests-1307708626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c342fb53-f7b6-4bd2-83a6-9ba2707a2ecd.7e6d7bf7-2830-440f-8d08-5b85ee95a385" returned: 0 in 0.529s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:05:49 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-c111f40c-ce04-4e22-a5db-8aa76817e40f tempest-SnapshotDependencyTests-1307708626 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c342fb53-f7b6-4bd2-83a6-9ba2707a2ecd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85458) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 22:05:49 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[811275b5-a9fb-419f-a12d-91cb722fe7de]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:05:49 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-c111f40c-ce04-4e22-a5db-8aa76817e40f tempest-SnapshotDependencyTests-1307708626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c342fb53-f7b6-4bd2-83a6-9ba2707a2ecd {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:05:49 devstack cinder-volume[85458]: DEBUG cinder.image.image_utils [None req-54f00050-c8cf-4b5d-a9d3-242e08e2cedb tempest-TestShelveInstance-763943664 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_764e44ff-49f7-469a-925c-23f254888b59_5349va11devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=85458) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 17 22:05:49 devstack cinder-volume[85458]: INFO cinder.image.image_utils [None req-54f00050-c8cf-4b5d-a9d3-242e08e2cedb tempest-TestShelveInstance-763943664 None] Image download 20.69 MB at 20.69 MB/s Sep 17 22:05:49 devstack sudo[100855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c342fb53-f7b6-4bd2-83a6-9ba2707a2ecd Sep 17 22:05:49 devstack sudo[100855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:05:49 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cce2335-083d-4e14-9355-cb4b896a21b5]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:05:49 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-54f00050-c8cf-4b5d-a9d3-242e08e2cedb tempest-TestShelveInstance-763943664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_764e44ff-49f7-469a-925c-23f254888b59_5349va11devstack@QuobyteHD {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:05:49 devstack sudo[100858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_764e44ff-49f7-469a-925c-23f254888b59_5349va11devstack@QuobyteHD Sep 17 22:05:49 devstack sudo[100858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:05:50 devstack sudo[100855]: pam_unix(sudo:session): session closed for user root Sep 17 22:05:50 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-c111f40c-ce04-4e22-a5db-8aa76817e40f tempest-SnapshotDependencyTests-1307708626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c342fb53-f7b6-4bd2-83a6-9ba2707a2ecd" returned: 0 in 0.625s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:05:50 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-c111f40c-ce04-4e22-a5db-8aa76817e40f tempest-SnapshotDependencyTests-1307708626 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c342fb53-f7b6-4bd2-83a6-9ba2707a2ecd {{(pid=85458) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 17 22:05:50 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-c111f40c-ce04-4e22-a5db-8aa76817e40f tempest-SnapshotDependencyTests-1307708626 None] Creating direct copy from snapshot {{(pid=85458) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 17 22:05:50 devstack cinder-volume[85458]: DEBUG cinder.utils [None req-c111f40c-ce04-4e22-a5db-8aa76817e40f tempest-SnapshotDependencyTests-1307708626 None] Path /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-4b2701a7-d34b-4b87-9189-9eff4e8f6f73 not found in is_blk_device check {{(pid=85458) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 17 22:05:50 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-c111f40c-ce04-4e22-a5db-8aa76817e40f tempest-SnapshotDependencyTests-1307708626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c342fb53-f7b6-4bd2-83a6-9ba2707a2ecd /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-4b2701a7-d34b-4b87-9189-9eff4e8f6f73 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:05:50 devstack sudo[100867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c342fb53-f7b6-4bd2-83a6-9ba2707a2ecd /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-4b2701a7-d34b-4b87-9189-9eff4e8f6f73 Sep 17 22:05:50 devstack sudo[100867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:05:50 devstack sudo[100858]: pam_unix(sudo:session): session closed for user root Sep 17 22:05:50 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-54f00050-c8cf-4b5d-a9d3-242e08e2cedb tempest-TestShelveInstance-763943664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_764e44ff-49f7-469a-925c-23f254888b59_5349va11devstack@QuobyteHD" returned: 0 in 0.512s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:05:50 devstack cinder-volume[85458]: DEBUG cinder.image.image_utils [None req-54f00050-c8cf-4b5d-a9d3-242e08e2cedb tempest-TestShelveInstance-763943664 None] Temporary image 764e44ff-49f7-469a-925c-23f254888b59 is fetched for user a7ac9e10e12b49a0833fd3df6c718df1. {{(pid=85458) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 17 22:05:50 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[015cd576-30fb-4478-882c-3de1ba8fdefc]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:05:50 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-54f00050-c8cf-4b5d-a9d3-242e08e2cedb tempest-TestShelveInstance-763943664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_764e44ff-49f7-469a-925c-23f254888b59_5349va11devstack@QuobyteHD {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:05:50 devstack sudo[100869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_764e44ff-49f7-469a-925c-23f254888b59_5349va11devstack@QuobyteHD Sep 17 22:05:50 devstack sudo[100869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:05:50 devstack sudo[100869]: pam_unix(sudo:session): session closed for user root Sep 17 22:05:50 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-54f00050-c8cf-4b5d-a9d3-242e08e2cedb tempest-TestShelveInstance-763943664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_764e44ff-49f7-469a-925c-23f254888b59_5349va11devstack@QuobyteHD" returned: 0 in 0.456s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:05:50 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-54f00050-c8cf-4b5d-a9d3-242e08e2cedb tempest-TestShelveInstance-763943664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:05:58 devstack sudo[100867]: pam_unix(sudo:session): session closed for user root Sep 17 22:05:58 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-c111f40c-ce04-4e22-a5db-8aa76817e40f tempest-SnapshotDependencyTests-1307708626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c342fb53-f7b6-4bd2-83a6-9ba2707a2ecd /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-4b2701a7-d34b-4b87-9189-9eff4e8f6f73" returned: 0 in 8.668s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:05:58 devstack cinder-volume[85458]: DEBUG cinder.image.image_utils [None req-c111f40c-ce04-4e22-a5db-8aa76817e40f tempest-SnapshotDependencyTests-1307708626 None] Image conversion details: src /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c342fb53-f7b6-4bd2-83a6-9ba2707a2ecd, size 1024.00 MB, duration 8.67 sec, destination /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-4b2701a7-d34b-4b87-9189-9eff4e8f6f73 {{(pid=85458) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 17 22:05:58 devstack cinder-volume[85458]: INFO cinder.image.image_utils [None req-c111f40c-ce04-4e22-a5db-8aa76817e40f tempest-SnapshotDependencyTests-1307708626 None] Converted 1024.00 MB image at 118.12 MB/s Sep 17 22:05:58 devstack cinder-volume[85458]: WARNING cinder.volume.drivers.remotefs [None req-c111f40c-ce04-4e22-a5db-8aa76817e40f tempest-SnapshotDependencyTests-1307708626 None] /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-4b2701a7-d34b-4b87-9189-9eff4e8f6f73 is being set with open permissions: ugo+rw Sep 17 22:05:58 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-c111f40c-ce04-4e22-a5db-8aa76817e40f tempest-SnapshotDependencyTests-1307708626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-4b2701a7-d34b-4b87-9189-9eff4e8f6f73 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:05:58 devstack sudo[100887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-4b2701a7-d34b-4b87-9189-9eff4e8f6f73 Sep 17 22:05:58 devstack sudo[100887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:05:59 devstack sudo[100887]: pam_unix(sudo:session): session closed for user root Sep 17 22:05:59 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-c111f40c-ce04-4e22-a5db-8aa76817e40f tempest-SnapshotDependencyTests-1307708626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-4b2701a7-d34b-4b87-9189-9eff4e8f6f73" returned: 0 in 0.305s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:05:59 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-c111f40c-ce04-4e22-a5db-8aa76817e40f tempest-SnapshotDependencyTests-1307708626 None] Lock "cinder-quobyte-4b2701a7-d34b-4b87-9189-9eff4e8f6f73" released by "_copy_volume_from_snapshot" :: held 10.259s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:05:59 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-c111f40c-ce04-4e22-a5db-8aa76817e40f tempest-SnapshotDependencyTests-1307708626 None] Lock "cinder-quobyte-7e6d7bf7-2830-440f-8d08-5b85ee95a385-4b2701a7-d34b-4b87-9189-9eff4e8f6f73" released by "_create_volume_from_snapshot" :: held 10.397s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:05:59 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-c111f40c-ce04-4e22-a5db-8aa76817e40f tempest-SnapshotDependencyTests-1307708626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.419s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:05:59 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-54f00050-c8cf-4b5d-a9d3-242e08e2cedb tempest-TestShelveInstance-763943664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.493s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:05:59 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-54f00050-c8cf-4b5d-a9d3-242e08e2cedb tempest-TestShelveInstance-763943664 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:05:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-462654834',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5303dab-81aa-4558-b4a2-13fead2fa414,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da66b6a1435d42c394fce8c7f293021e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:05:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:05:48Z,use_quota=True,user_id='a7ac9e10e12b49a0833fd3df6c718df1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 22:05:59 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-54f00050-c8cf-4b5d-a9d3-242e08e2cedb tempest-TestShelveInstance-763943664 None] Creating volume f5303dab-81aa-4558-b4a2-13fead2fa414 {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 22:05:59 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-54f00050-c8cf-4b5d-a9d3-242e08e2cedb tempest-TestShelveInstance-763943664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:05:59 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-54f00050-c8cf-4b5d-a9d3-242e08e2cedb tempest-TestShelveInstance-763943664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:05:59 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-54f00050-c8cf-4b5d-a9d3-242e08e2cedb tempest-TestShelveInstance-763943664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:05:59 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-54f00050-c8cf-4b5d-a9d3-242e08e2cedb tempest-TestShelveInstance-763943664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:05:59 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-54f00050-c8cf-4b5d-a9d3-242e08e2cedb tempest-TestShelveInstance-763943664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:05:59 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-54f00050-c8cf-4b5d-a9d3-242e08e2cedb tempest-TestShelveInstance-763943664 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 22:05:59 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-54f00050-c8cf-4b5d-a9d3-242e08e2cedb tempest-TestShelveInstance-763943664 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 22:05:59 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-54f00050-c8cf-4b5d-a9d3-242e08e2cedb tempest-TestShelveInstance-763943664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f5303dab-81aa-4558-b4a2-13fead2fa414 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:05:59 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-c111f40c-ce04-4e22-a5db-8aa76817e40f tempest-SnapshotDependencyTests-1307708626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f6955ab-b2cf-4665-81c5-dea90d8ea5eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b2701a7-d34b-4b87-9189-9eff4e8f6f73', 'volume_size': 1, 'snapshot_id': '7e6d7bf7-2830-440f-8d08-5b85ee95a385'}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:05:59 devstack sudo[100890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f5303dab-81aa-4558-b4a2-13fead2fa414 1073741824 Sep 17 22:05:59 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-c111f40c-ce04-4e22-a5db-8aa76817e40f tempest-SnapshotDependencyTests-1307708626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb140a55-fb0a-47c1-905d-082aba0aed73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:05:59 devstack sudo[100890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:05:59 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-c111f40c-ce04-4e22-a5db-8aa76817e40f tempest-SnapshotDependencyTests-1307708626 None] Volume volume-4b2701a7-d34b-4b87-9189-9eff4e8f6f73 (4b2701a7-d34b-4b87-9189-9eff4e8f6f73): created successfully Sep 17 22:05:59 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-c111f40c-ce04-4e22-a5db-8aa76817e40f tempest-SnapshotDependencyTests-1307708626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb140a55-fb0a-47c1-905d-082aba0aed73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:05:59 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-c111f40c-ce04-4e22-a5db-8aa76817e40f tempest-SnapshotDependencyTests-1307708626 None] Flow 'volume_create_manager' (c60142c2-db43-4c8c-bc8c-e52e9f3f99f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:05:59 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-c111f40c-ce04-4e22-a5db-8aa76817e40f tempest-SnapshotDependencyTests-1307708626 None] Created volume successfully. Sep 17 22:05:59 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-fb9177ba-8973-46f8-8b2f-7d209ffd81c5 tempest-SnapshotDependencyTests-1307708626 None] Acquiring lock "cinder-7e6d7bf7-2830-440f-8d08-5b85ee95a385-delete_snapshot" by "delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:05:59 devstack sudo[100890]: pam_unix(sudo:session): session closed for user root Sep 17 22:05:59 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-54f00050-c8cf-4b5d-a9d3-242e08e2cedb tempest-TestShelveInstance-763943664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f5303dab-81aa-4558-b4a2-13fead2fa414 1073741824" returned: 0 in 0.645s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:05:59 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-fb9177ba-8973-46f8-8b2f-7d209ffd81c5 tempest-SnapshotDependencyTests-1307708626 None] Lock "cinder-7e6d7bf7-2830-440f-8d08-5b85ee95a385-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:05:59 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-fb9177ba-8973-46f8-8b2f-7d209ffd81c5 tempest-SnapshotDependencyTests-1307708626 None] Acquiring lock "cinder-quobyte-c342fb53-f7b6-4bd2-83a6-9ba2707a2ecd" by "delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:05:59 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-fb9177ba-8973-46f8-8b2f-7d209ffd81c5 tempest-SnapshotDependencyTests-1307708626 None] Lock "cinder-quobyte-c342fb53-f7b6-4bd2-83a6-9ba2707a2ecd" acquired by "delete_snapshot" :: waited 0.028s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:05:59 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-fb9177ba-8973-46f8-8b2f-7d209ffd81c5 tempest-SnapshotDependencyTests-1307708626 None] Acquiring lock "cinder-quobyte-7e6d7bf7-2830-440f-8d08-5b85ee95a385" by "_delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:05:59 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-54f00050-c8cf-4b5d-a9d3-242e08e2cedb tempest-TestShelveInstance-763943664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f5303dab-81aa-4558-b4a2-13fead2fa414 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:05:59 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-fb9177ba-8973-46f8-8b2f-7d209ffd81c5 tempest-SnapshotDependencyTests-1307708626 None] Lock "cinder-quobyte-7e6d7bf7-2830-440f-8d08-5b85ee95a385" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:05:59 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-fb9177ba-8973-46f8-8b2f-7d209ffd81c5 tempest-SnapshotDependencyTests-1307708626 None] Deleting offline snapshot 7e6d7bf7-2830-440f-8d08-5b85ee95a385 of volume c342fb53-f7b6-4bd2-83a6-9ba2707a2ecd {{(pid=85458) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 22:05:59 devstack sudo[100897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f5303dab-81aa-4558-b4a2-13fead2fa414 Sep 17 22:05:59 devstack sudo[100897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:05:59 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-fb9177ba-8973-46f8-8b2f-7d209ffd81c5 tempest-SnapshotDependencyTests-1307708626 None] snapshot_file for this snap is: volume-c342fb53-f7b6-4bd2-83a6-9ba2707a2ecd.7e6d7bf7-2830-440f-8d08-5b85ee95a385 {{(pid=85458) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 22:05:59 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8385b08-d209-449b-8dac-c686e37a4de7]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:05:59 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-fb9177ba-8973-46f8-8b2f-7d209ffd81c5 tempest-SnapshotDependencyTests-1307708626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c342fb53-f7b6-4bd2-83a6-9ba2707a2ecd.7e6d7bf7-2830-440f-8d08-5b85ee95a385 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:06:00 devstack sudo[100899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c342fb53-f7b6-4bd2-83a6-9ba2707a2ecd.7e6d7bf7-2830-440f-8d08-5b85ee95a385 Sep 17 22:06:00 devstack sudo[100899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:06:00 devstack sudo[100897]: pam_unix(sudo:session): session closed for user root Sep 17 22:06:00 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-54f00050-c8cf-4b5d-a9d3-242e08e2cedb tempest-TestShelveInstance-763943664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f5303dab-81aa-4558-b4a2-13fead2fa414" returned: 0 in 0.330s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:06:00 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-54f00050-c8cf-4b5d-a9d3-242e08e2cedb tempest-TestShelveInstance-763943664 None] <== create_volume: return (1055ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 22:06:00 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-54f00050-c8cf-4b5d-a9d3-242e08e2cedb tempest-TestShelveInstance-763943664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.058s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:06:00 devstack cinder-volume[85458]: DEBUG cinder.volume.volume_utils [None req-54f00050-c8cf-4b5d-a9d3-242e08e2cedb tempest-TestShelveInstance-763943664 None] Attempting download of 764e44ff-49f7-469a-925c-23f254888b59 ((None, [{'url': 'file:///opt/stack/data/glance/images/764e44ff-49f7-469a-925c-23f254888b59', 'metadata': {}}])) to volume f5303dab-81aa-4558-b4a2-13fead2fa414. {{(pid=85458) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 17 22:06:00 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[437458da-70a7-4896-bf87-57ddd2a75e9d]: (4, 'raw') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:06:00 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-54f00050-c8cf-4b5d-a9d3-242e08e2cedb tempest-TestShelveInstance-763943664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_764e44ff-49f7-469a-925c-23f254888b59_58cjy6_t {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:06:00 devstack sudo[100899]: pam_unix(sudo:session): session closed for user root Sep 17 22:06:00 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-fb9177ba-8973-46f8-8b2f-7d209ffd81c5 tempest-SnapshotDependencyTests-1307708626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c342fb53-f7b6-4bd2-83a6-9ba2707a2ecd.7e6d7bf7-2830-440f-8d08-5b85ee95a385" returned: 0 in 0.468s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:06:00 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-fb9177ba-8973-46f8-8b2f-7d209ffd81c5 tempest-SnapshotDependencyTests-1307708626 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c342fb53-f7b6-4bd2-83a6-9ba2707a2ecd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85458) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 22:06:00 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[25550a0b-5899-47b9-9c05-a2013ed092d6]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:06:00 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-fb9177ba-8973-46f8-8b2f-7d209ffd81c5 tempest-SnapshotDependencyTests-1307708626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c342fb53-f7b6-4bd2-83a6-9ba2707a2ecd {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:06:00 devstack sudo[100904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_764e44ff-49f7-469a-925c-23f254888b59_58cjy6_t Sep 17 22:06:00 devstack sudo[100904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:06:00 devstack sudo[100908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c342fb53-f7b6-4bd2-83a6-9ba2707a2ecd Sep 17 22:06:00 devstack sudo[100908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:06:00 devstack sudo[100904]: pam_unix(sudo:session): session closed for user root Sep 17 22:06:00 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-54f00050-c8cf-4b5d-a9d3-242e08e2cedb tempest-TestShelveInstance-763943664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_764e44ff-49f7-469a-925c-23f254888b59_58cjy6_t" returned: 0 in 0.370s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:06:00 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-54f00050-c8cf-4b5d-a9d3-242e08e2cedb tempest-TestShelveInstance-763943664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_764e44ff-49f7-469a-925c-23f254888b59_58cjy6_t {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:06:00 devstack sudo[100912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_764e44ff-49f7-469a-925c-23f254888b59_58cjy6_t Sep 17 22:06:00 devstack sudo[100912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:06:00 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-c846691e-e8b7-475a-bc07-f9e7c6997b46 tempest-CinderUnicodeTest-224747412 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 22:06:00 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-c846691e-e8b7-475a-bc07-f9e7c6997b46 tempest-CinderUnicodeTest-224747412 None] Flow 'volume_create_manager' (e01842b8-7923-4065-9398-9deeb3ad1ba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:06:00 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-c846691e-e8b7-475a-bc07-f9e7c6997b46 tempest-CinderUnicodeTest-224747412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcbe55f5-5958-459b-a4a8-0362c755a959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:06:00 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-c846691e-e8b7-475a-bc07-f9e7c6997b46 tempest-CinderUnicodeTest-224747412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcbe55f5-5958-459b-a4a8-0362c755a959) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:06:00Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5534812-1ebb-4810-b626-1ade0a260f0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73a282f8cfbd45cd85fa051f5275a909',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:06:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:06:01Z,use_quota=True,user_id='9eb24f49deba4afb9a9915f7ae44af48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:06:00 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-c846691e-e8b7-475a-bc07-f9e7c6997b46 tempest-CinderUnicodeTest-224747412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d83bcdc-4392-4110-b63b-f4ee5998bfe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:06:00 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-c846691e-e8b7-475a-bc07-f9e7c6997b46 tempest-CinderUnicodeTest-224747412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d83bcdc-4392-4110-b63b-f4ee5998bfe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:06:00 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-c846691e-e8b7-475a-bc07-f9e7c6997b46 tempest-CinderUnicodeTest-224747412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca9f877f-46f8-4ea9-b010-3258951d4d5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:06:00 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-c846691e-e8b7-475a-bc07-f9e7c6997b46 tempest-CinderUnicodeTest-224747412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca9f877f-46f8-4ea9-b010-3258951d4d5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5534812-1ebb-4810-b626-1ade0a260f0e', 'volume_name': 'volume-a5534812-1ebb-4810-b626-1ade0a260f0e', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:06:00 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-c846691e-e8b7-475a-bc07-f9e7c6997b46 tempest-CinderUnicodeTest-224747412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04a1c17d-7c6a-467a-acd5-7e68ddb68832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:06:00 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-c846691e-e8b7-475a-bc07-f9e7c6997b46 tempest-CinderUnicodeTest-224747412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04a1c17d-7c6a-467a-acd5-7e68ddb68832) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:06:00 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-c846691e-e8b7-475a-bc07-f9e7c6997b46 tempest-CinderUnicodeTest-224747412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71b7c3e4-f325-4d87-a78f-44de8c6e269b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:06:00 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-c846691e-e8b7-475a-bc07-f9e7c6997b46 tempest-CinderUnicodeTest-224747412 None] Volume a5534812-1ebb-4810-b626-1ade0a260f0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5534812-1ebb-4810-b626-1ade0a260f0e', 'volume_size': 1} Sep 17 22:06:00 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-c846691e-e8b7-475a-bc07-f9e7c6997b46 tempest-CinderUnicodeTest-224747412 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:06:00 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-c846691e-e8b7-475a-bc07-f9e7c6997b46 tempest-CinderUnicodeTest-224747412 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:06:00 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-c846691e-e8b7-475a-bc07-f9e7c6997b46 tempest-CinderUnicodeTest-224747412 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:06:00Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5534812-1ebb-4810-b626-1ade0a260f0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73a282f8cfbd45cd85fa051f5275a909',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:06:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:06:01Z,use_quota=True,user_id='9eb24f49deba4afb9a9915f7ae44af48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 22:06:00 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-c846691e-e8b7-475a-bc07-f9e7c6997b46 tempest-CinderUnicodeTest-224747412 None] Creating volume a5534812-1ebb-4810-b626-1ade0a260f0e {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 22:06:00 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-c846691e-e8b7-475a-bc07-f9e7c6997b46 tempest-CinderUnicodeTest-224747412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:06:01 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-c846691e-e8b7-475a-bc07-f9e7c6997b46 tempest-CinderUnicodeTest-224747412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:06:01 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-c846691e-e8b7-475a-bc07-f9e7c6997b46 tempest-CinderUnicodeTest-224747412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:06:01 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-c846691e-e8b7-475a-bc07-f9e7c6997b46 tempest-CinderUnicodeTest-224747412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:06:01 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-c846691e-e8b7-475a-bc07-f9e7c6997b46 tempest-CinderUnicodeTest-224747412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:06:01 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-c846691e-e8b7-475a-bc07-f9e7c6997b46 tempest-CinderUnicodeTest-224747412 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 22:06:01 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-c846691e-e8b7-475a-bc07-f9e7c6997b46 tempest-CinderUnicodeTest-224747412 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 22:06:01 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-c846691e-e8b7-475a-bc07-f9e7c6997b46 tempest-CinderUnicodeTest-224747412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a5534812-1ebb-4810-b626-1ade0a260f0e 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:06:01 devstack sudo[100916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a5534812-1ebb-4810-b626-1ade0a260f0e 1073741824 Sep 17 22:06:01 devstack sudo[100916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:06:01 devstack sudo[100912]: pam_unix(sudo:session): session closed for user root Sep 17 22:06:01 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-54f00050-c8cf-4b5d-a9d3-242e08e2cedb tempest-TestShelveInstance-763943664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_764e44ff-49f7-469a-925c-23f254888b59_58cjy6_t" returned: 1 in 0.359s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:06:01 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-54f00050-c8cf-4b5d-a9d3-242e08e2cedb tempest-TestShelveInstance-763943664 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_764e44ff-49f7-469a-925c-23f254888b59_58cjy6_t' failed. Not Retrying. {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 22:06:01 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[363e200c-cb00-4a04-bced-172aa95b243e]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:06:01 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-54f00050-c8cf-4b5d-a9d3-242e08e2cedb tempest-TestShelveInstance-763943664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_764e44ff-49f7-469a-925c-23f254888b59_5349va11devstack@QuobyteHD {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:06:01 devstack sudo[100908]: pam_unix(sudo:session): session closed for user root Sep 17 22:06:01 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-fb9177ba-8973-46f8-8b2f-7d209ffd81c5 tempest-SnapshotDependencyTests-1307708626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c342fb53-f7b6-4bd2-83a6-9ba2707a2ecd" returned: 0 in 0.684s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:06:01 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-fb9177ba-8973-46f8-8b2f-7d209ffd81c5 tempest-SnapshotDependencyTests-1307708626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c342fb53-f7b6-4bd2-83a6-9ba2707a2ecd.7e6d7bf7-2830-440f-8d08-5b85ee95a385 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:06:01 devstack sudo[100922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c342fb53-f7b6-4bd2-83a6-9ba2707a2ecd.7e6d7bf7-2830-440f-8d08-5b85ee95a385 Sep 17 22:06:01 devstack sudo[100922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:06:01 devstack sudo[100920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_764e44ff-49f7-469a-925c-23f254888b59_5349va11devstack@QuobyteHD Sep 17 22:06:01 devstack sudo[100920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:06:01 devstack sudo[100920]: pam_unix(sudo:session): session closed for user root Sep 17 22:06:01 devstack sudo[100916]: pam_unix(sudo:session): session closed for user root Sep 17 22:06:01 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-54f00050-c8cf-4b5d-a9d3-242e08e2cedb tempest-TestShelveInstance-763943664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_764e44ff-49f7-469a-925c-23f254888b59_5349va11devstack@QuobyteHD" returned: 0 in 0.409s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:06:01 devstack cinder-volume[85458]: DEBUG cinder.image.image_utils [None req-54f00050-c8cf-4b5d-a9d3-242e08e2cedb tempest-TestShelveInstance-763943664 None] 764e44ff-49f7-469a-925c-23f254888b59 was qcow2, converting to qcow2 {{(pid=85458) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 17 22:06:01 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-54f00050-c8cf-4b5d-a9d3-242e08e2cedb tempest-TestShelveInstance-763943664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_764e44ff-49f7-469a-925c-23f254888b59_5349va11devstack@QuobyteHD /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f5303dab-81aa-4558-b4a2-13fead2fa414 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:06:01 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-c846691e-e8b7-475a-bc07-f9e7c6997b46 tempest-CinderUnicodeTest-224747412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a5534812-1ebb-4810-b626-1ade0a260f0e 1073741824" returned: 0 in 0.496s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:06:01 devstack sudo[100939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_764e44ff-49f7-469a-925c-23f254888b59_5349va11devstack@QuobyteHD /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f5303dab-81aa-4558-b4a2-13fead2fa414 Sep 17 22:06:01 devstack sudo[100939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:06:01 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-c846691e-e8b7-475a-bc07-f9e7c6997b46 tempest-CinderUnicodeTest-224747412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a5534812-1ebb-4810-b626-1ade0a260f0e {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:06:01 devstack sudo[100941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a5534812-1ebb-4810-b626-1ade0a260f0e Sep 17 22:06:01 devstack sudo[100941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:06:01 devstack sudo[100922]: pam_unix(sudo:session): session closed for user root Sep 17 22:06:01 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-fb9177ba-8973-46f8-8b2f-7d209ffd81c5 tempest-SnapshotDependencyTests-1307708626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c342fb53-f7b6-4bd2-83a6-9ba2707a2ecd.7e6d7bf7-2830-440f-8d08-5b85ee95a385" returned: 0 in 0.474s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:06:01 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-fb9177ba-8973-46f8-8b2f-7d209ffd81c5 tempest-SnapshotDependencyTests-1307708626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c342fb53-f7b6-4bd2-83a6-9ba2707a2ecd.7e6d7bf7-2830-440f-8d08-5b85ee95a385 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:06:01 devstack sudo[100943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c342fb53-f7b6-4bd2-83a6-9ba2707a2ecd.7e6d7bf7-2830-440f-8d08-5b85ee95a385 Sep 17 22:06:01 devstack sudo[100943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:06:01 devstack sudo[100941]: pam_unix(sudo:session): session closed for user root Sep 17 22:06:01 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-c846691e-e8b7-475a-bc07-f9e7c6997b46 tempest-CinderUnicodeTest-224747412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a5534812-1ebb-4810-b626-1ade0a260f0e" returned: 0 in 0.307s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:06:01 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-c846691e-e8b7-475a-bc07-f9e7c6997b46 tempest-CinderUnicodeTest-224747412 None] <== create_volume: return (856ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 22:06:01 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-c846691e-e8b7-475a-bc07-f9e7c6997b46 tempest-CinderUnicodeTest-224747412 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.861s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:06:01 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-c846691e-e8b7-475a-bc07-f9e7c6997b46 tempest-CinderUnicodeTest-224747412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71b7c3e4-f325-4d87-a78f-44de8c6e269b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5534812-1ebb-4810-b626-1ade0a260f0e', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:06:01 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-c846691e-e8b7-475a-bc07-f9e7c6997b46 tempest-CinderUnicodeTest-224747412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6da67f66-e115-4dea-89e9-3b63932c525f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:06:01 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-c846691e-e8b7-475a-bc07-f9e7c6997b46 tempest-CinderUnicodeTest-224747412 None] Volume volume-a5534812-1ebb-4810-b626-1ade0a260f0e (a5534812-1ebb-4810-b626-1ade0a260f0e): created successfully Sep 17 22:06:01 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-c846691e-e8b7-475a-bc07-f9e7c6997b46 tempest-CinderUnicodeTest-224747412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6da67f66-e115-4dea-89e9-3b63932c525f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:06:01 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-c846691e-e8b7-475a-bc07-f9e7c6997b46 tempest-CinderUnicodeTest-224747412 None] Flow 'volume_create_manager' (e01842b8-7923-4065-9398-9deeb3ad1ba8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:06:01 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-c846691e-e8b7-475a-bc07-f9e7c6997b46 tempest-CinderUnicodeTest-224747412 None] Created volume successfully. Sep 17 22:06:01 devstack sudo[100943]: pam_unix(sudo:session): session closed for user root Sep 17 22:06:01 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-fb9177ba-8973-46f8-8b2f-7d209ffd81c5 tempest-SnapshotDependencyTests-1307708626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c342fb53-f7b6-4bd2-83a6-9ba2707a2ecd.7e6d7bf7-2830-440f-8d08-5b85ee95a385" returned: 0 in 0.313s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:06:01 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-fb9177ba-8973-46f8-8b2f-7d209ffd81c5 tempest-SnapshotDependencyTests-1307708626 None] Lock "cinder-quobyte-7e6d7bf7-2830-440f-8d08-5b85ee95a385" released by "_delete_snapshot" :: held 2.104s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:06:02 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-fb9177ba-8973-46f8-8b2f-7d209ffd81c5 tempest-SnapshotDependencyTests-1307708626 None] Lock "cinder-quobyte-c342fb53-f7b6-4bd2-83a6-9ba2707a2ecd" released by "delete_snapshot" :: held 2.148s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:06:02 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-fb9177ba-8973-46f8-8b2f-7d209ffd81c5 tempest-SnapshotDependencyTests-1307708626 None] Created reservations ['a61559bf-4d8e-45e2-9c62-6864157ce8da', '29322843-e6e4-4fbb-8160-109c3f62953b', 'bca9953f-c0b0-486e-988e-4b1c88da7e36', 'c7386cb4-0367-4ffa-b912-aaee3ef5056b'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:06:02 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-fb9177ba-8973-46f8-8b2f-7d209ffd81c5 tempest-SnapshotDependencyTests-1307708626 None] Delete snapshot completed successfully. Sep 17 22:06:02 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-fb9177ba-8973-46f8-8b2f-7d209ffd81c5 tempest-SnapshotDependencyTests-1307708626 None] Lock "cinder-7e6d7bf7-2830-440f-8d08-5b85ee95a385-delete_snapshot" released by "delete_snapshot" :: held 2.317s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:06:03 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-9d659801-0949-4b61-9421-9581a3d2a8cd tempest-SnapshotDependencyTests-1307708626 None] Acquiring lock "cinder-c342fb53-f7b6-4bd2-83a6-9ba2707a2ecd-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:06:03 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-9d659801-0949-4b61-9421-9581a3d2a8cd tempest-SnapshotDependencyTests-1307708626 None] Lock "cinder-c342fb53-f7b6-4bd2-83a6-9ba2707a2ecd-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:06:03 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-9d659801-0949-4b61-9421-9581a3d2a8cd tempest-SnapshotDependencyTests-1307708626 None] Acquiring lock "cinder-quobyte-c342fb53-f7b6-4bd2-83a6-9ba2707a2ecd" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:06:03 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-9d659801-0949-4b61-9421-9581a3d2a8cd tempest-SnapshotDependencyTests-1307708626 None] Lock "cinder-quobyte-c342fb53-f7b6-4bd2-83a6-9ba2707a2ecd" acquired by "delete_volume" :: waited 0.020s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:06:03 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[58a11077-fa93-4c6d-bd1b-451d28b4362f]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:06:03 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-9d659801-0949-4b61-9421-9581a3d2a8cd tempest-SnapshotDependencyTests-1307708626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c342fb53-f7b6-4bd2-83a6-9ba2707a2ecd {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:06:03 devstack sudo[100952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c342fb53-f7b6-4bd2-83a6-9ba2707a2ecd Sep 17 22:06:03 devstack sudo[100952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:06:03 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba6d464e-190e-464b-8013-e5113236f7f2 tempest-CinderUnicodeTest-224747412 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 22:06:03 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-ba6d464e-190e-464b-8013-e5113236f7f2 tempest-CinderUnicodeTest-224747412 None] Flow 'volume_create_manager' (d71d3625-a40e-495b-b6de-1a8a8453dfbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:06:03 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-ba6d464e-190e-464b-8013-e5113236f7f2 tempest-CinderUnicodeTest-224747412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae2b2490-577f-420b-a13e-437d97ae6b32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:06:03 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-ba6d464e-190e-464b-8013-e5113236f7f2 tempest-CinderUnicodeTest-224747412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae2b2490-577f-420b-a13e-437d97ae6b32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:06:03Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2004041851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=703b56e6-b34c-48dd-8ff2-250e4581cf31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73a282f8cfbd45cd85fa051f5275a909',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:06:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:06:03Z,use_quota=True,user_id='9eb24f49deba4afb9a9915f7ae44af48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:06:03 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-ba6d464e-190e-464b-8013-e5113236f7f2 tempest-CinderUnicodeTest-224747412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d6616b3-f793-4ce1-9bb0-2c2c67b3d997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:06:03 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-ba6d464e-190e-464b-8013-e5113236f7f2 tempest-CinderUnicodeTest-224747412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d6616b3-f793-4ce1-9bb0-2c2c67b3d997) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:06:03 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-ba6d464e-190e-464b-8013-e5113236f7f2 tempest-CinderUnicodeTest-224747412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed8022d6-f8e2-4914-b930-cec862963b53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:06:03 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-ba6d464e-190e-464b-8013-e5113236f7f2 tempest-CinderUnicodeTest-224747412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed8022d6-f8e2-4914-b930-cec862963b53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '703b56e6-b34c-48dd-8ff2-250e4581cf31', 'volume_name': 'volume-703b56e6-b34c-48dd-8ff2-250e4581cf31', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:06:03 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-ba6d464e-190e-464b-8013-e5113236f7f2 tempest-CinderUnicodeTest-224747412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb0c78e5-2868-4b4d-9b27-7fb2cd51def7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:06:03 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-ba6d464e-190e-464b-8013-e5113236f7f2 tempest-CinderUnicodeTest-224747412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb0c78e5-2868-4b4d-9b27-7fb2cd51def7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:06:03 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-ba6d464e-190e-464b-8013-e5113236f7f2 tempest-CinderUnicodeTest-224747412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99802e5f-173d-4fc9-9049-673c07b8e779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:06:03 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-ba6d464e-190e-464b-8013-e5113236f7f2 tempest-CinderUnicodeTest-224747412 None] Volume 703b56e6-b34c-48dd-8ff2-250e4581cf31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-703b56e6-b34c-48dd-8ff2-250e4581cf31', 'volume_size': 1} Sep 17 22:06:03 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-ba6d464e-190e-464b-8013-e5113236f7f2 tempest-CinderUnicodeTest-224747412 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:06:03 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-ba6d464e-190e-464b-8013-e5113236f7f2 tempest-CinderUnicodeTest-224747412 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:06:03 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-ba6d464e-190e-464b-8013-e5113236f7f2 tempest-CinderUnicodeTest-224747412 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:06:03Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2004041851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=703b56e6-b34c-48dd-8ff2-250e4581cf31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73a282f8cfbd45cd85fa051f5275a909',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:06:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:06:03Z,use_quota=True,user_id='9eb24f49deba4afb9a9915f7ae44af48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 22:06:03 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-ba6d464e-190e-464b-8013-e5113236f7f2 tempest-CinderUnicodeTest-224747412 None] Creating volume 703b56e6-b34c-48dd-8ff2-250e4581cf31 {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 22:06:03 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-ba6d464e-190e-464b-8013-e5113236f7f2 tempest-CinderUnicodeTest-224747412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:06:03 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-ba6d464e-190e-464b-8013-e5113236f7f2 tempest-CinderUnicodeTest-224747412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:06:03 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-ba6d464e-190e-464b-8013-e5113236f7f2 tempest-CinderUnicodeTest-224747412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:06:03 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-ba6d464e-190e-464b-8013-e5113236f7f2 tempest-CinderUnicodeTest-224747412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:06:03 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-ba6d464e-190e-464b-8013-e5113236f7f2 tempest-CinderUnicodeTest-224747412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:06:03 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-ba6d464e-190e-464b-8013-e5113236f7f2 tempest-CinderUnicodeTest-224747412 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 22:06:03 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-ba6d464e-190e-464b-8013-e5113236f7f2 tempest-CinderUnicodeTest-224747412 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 22:06:03 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-ba6d464e-190e-464b-8013-e5113236f7f2 tempest-CinderUnicodeTest-224747412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-703b56e6-b34c-48dd-8ff2-250e4581cf31 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:06:03 devstack sudo[100955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-703b56e6-b34c-48dd-8ff2-250e4581cf31 1073741824 Sep 17 22:06:03 devstack sudo[100955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:06:03 devstack sudo[100952]: pam_unix(sudo:session): session closed for user root Sep 17 22:06:03 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-9d659801-0949-4b61-9421-9581a3d2a8cd tempest-SnapshotDependencyTests-1307708626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c342fb53-f7b6-4bd2-83a6-9ba2707a2ecd" returned: 0 in 0.511s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:06:03 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-9d659801-0949-4b61-9421-9581a3d2a8cd tempest-SnapshotDependencyTests-1307708626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c342fb53-f7b6-4bd2-83a6-9ba2707a2ecd {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:06:03 devstack sudo[100960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c342fb53-f7b6-4bd2-83a6-9ba2707a2ecd Sep 17 22:06:03 devstack sudo[100960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:06:03 devstack sudo[100939]: pam_unix(sudo:session): session closed for user root Sep 17 22:06:03 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-54f00050-c8cf-4b5d-a9d3-242e08e2cedb tempest-TestShelveInstance-763943664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_764e44ff-49f7-469a-925c-23f254888b59_5349va11devstack@QuobyteHD /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f5303dab-81aa-4558-b4a2-13fead2fa414" returned: 0 in 2.406s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:06:03 devstack cinder-volume[85458]: DEBUG cinder.image.image_utils [None req-54f00050-c8cf-4b5d-a9d3-242e08e2cedb tempest-TestShelveInstance-763943664 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_764e44ff-49f7-469a-925c-23f254888b59_5349va11devstack@QuobyteHD, size 112.00 MB, duration 2.41 sec, destination /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f5303dab-81aa-4558-b4a2-13fead2fa414 {{(pid=85458) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 17 22:06:03 devstack cinder-volume[85458]: INFO cinder.image.image_utils [None req-54f00050-c8cf-4b5d-a9d3-242e08e2cedb tempest-TestShelveInstance-763943664 None] Converted 112.00 MB image at 46.53 MB/s Sep 17 22:06:03 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-54f00050-c8cf-4b5d-a9d3-242e08e2cedb tempest-TestShelveInstance-763943664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f5303dab-81aa-4558-b4a2-13fead2fa414 1G {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:06:03 devstack sudo[100963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f5303dab-81aa-4558-b4a2-13fead2fa414 1G Sep 17 22:06:03 devstack sudo[100963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:06:04 devstack sudo[100960]: pam_unix(sudo:session): session closed for user root Sep 17 22:06:04 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-9d659801-0949-4b61-9421-9581a3d2a8cd tempest-SnapshotDependencyTests-1307708626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c342fb53-f7b6-4bd2-83a6-9ba2707a2ecd" returned: 0 in 0.331s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:06:04 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-9d659801-0949-4b61-9421-9581a3d2a8cd tempest-SnapshotDependencyTests-1307708626 None] Lock "cinder-quobyte-c342fb53-f7b6-4bd2-83a6-9ba2707a2ecd" released by "delete_volume" :: held 0.970s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:06:04 devstack sudo[100955]: pam_unix(sudo:session): session closed for user root Sep 17 22:06:04 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-ba6d464e-190e-464b-8013-e5113236f7f2 tempest-CinderUnicodeTest-224747412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-703b56e6-b34c-48dd-8ff2-250e4581cf31 1073741824" returned: 0 in 0.641s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:06:04 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-9d659801-0949-4b61-9421-9581a3d2a8cd tempest-SnapshotDependencyTests-1307708626 None] Created reservations ['fa2b1901-e686-4f0b-948e-078f2c750dbc', '48d487d1-5adc-4ada-ba3d-aaff174798b2', '184865b8-7ea0-46ea-b003-8f792036e270', '9d347dd5-59c0-4c6a-b74b-f13347cc187a'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:06:04 devstack sudo[100963]: pam_unix(sudo:session): session closed for user root Sep 17 22:06:04 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-ba6d464e-190e-464b-8013-e5113236f7f2 tempest-CinderUnicodeTest-224747412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-703b56e6-b34c-48dd-8ff2-250e4581cf31 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:06:04 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-54f00050-c8cf-4b5d-a9d3-242e08e2cedb tempest-TestShelveInstance-763943664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f5303dab-81aa-4558-b4a2-13fead2fa414 1G" returned: 0 in 0.434s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:06:04 devstack cinder-volume[85458]: DEBUG cinder.volume.volume_utils [None req-54f00050-c8cf-4b5d-a9d3-242e08e2cedb tempest-TestShelveInstance-763943664 None] Downloaded image 764e44ff-49f7-469a-925c-23f254888b59 ((None, [{'url': 'file:///opt/stack/data/glance/images/764e44ff-49f7-469a-925c-23f254888b59', 'metadata': {}}])) to volume f5303dab-81aa-4558-b4a2-13fead2fa414 successfully. {{(pid=85458) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 17 22:06:04 devstack sudo[100973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-703b56e6-b34c-48dd-8ff2-250e4581cf31 Sep 17 22:06:04 devstack cinder-volume[85458]: DEBUG cinder.image.image_utils [None req-54f00050-c8cf-4b5d-a9d3-242e08e2cedb tempest-TestShelveInstance-763943664 None] Temporary image 764e44ff-49f7-469a-925c-23f254888b59 for user a7ac9e10e12b49a0833fd3df6c718df1 is deleted. {{(pid=85458) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 17 22:06:04 devstack cinder-volume[85458]: DEBUG cinder.volume.volume_utils [None req-54f00050-c8cf-4b5d-a9d3-242e08e2cedb tempest-TestShelveInstance-763943664 None] Marking volume f5303dab-81aa-4558-b4a2-13fead2fa414 as bootable. {{(pid=85458) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 17 22:06:04 devstack sudo[100973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:06:04 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-54f00050-c8cf-4b5d-a9d3-242e08e2cedb tempest-TestShelveInstance-763943664 None] Copying metadata from image 764e44ff-49f7-469a-925c-23f254888b59 to f5303dab-81aa-4558-b4a2-13fead2fa414. {{(pid=85458) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 17 22:06:04 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-54f00050-c8cf-4b5d-a9d3-242e08e2cedb tempest-TestShelveInstance-763943664 None] Creating volume glance metadata for volume f5303dab-81aa-4558-b4a2-13fead2fa414 backed by image 764e44ff-49f7-469a-925c-23f254888b59 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '764e44ff-49f7-469a-925c-23f254888b59', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=85458) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 17 22:06:04 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-6da0dca1-db21-4901-8066-969884ddef06 tempest-TestInstancesWithCinderVolumes-1282020637 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 22:06:04 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-6da0dca1-db21-4901-8066-969884ddef06 tempest-TestInstancesWithCinderVolumes-1282020637 None] Flow 'volume_create_manager' (753cc283-c097-4718-af68-2dff82ba56d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:06:04 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-6da0dca1-db21-4901-8066-969884ddef06 tempest-TestInstancesWithCinderVolumes-1282020637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe662a2f-9127-4923-99ef-700a472f5fd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:06:04 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-9d659801-0949-4b61-9421-9581a3d2a8cd tempest-SnapshotDependencyTests-1307708626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:06:04 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-9d659801-0949-4b61-9421-9581a3d2a8cd tempest-SnapshotDependencyTests-1307708626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:06:04 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-9d659801-0949-4b61-9421-9581a3d2a8cd tempest-SnapshotDependencyTests-1307708626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:06:04 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-9d659801-0949-4b61-9421-9581a3d2a8cd tempest-SnapshotDependencyTests-1307708626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:06:04 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-9d659801-0949-4b61-9421-9581a3d2a8cd tempest-SnapshotDependencyTests-1307708626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:06:04 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-9d659801-0949-4b61-9421-9581a3d2a8cd tempest-SnapshotDependencyTests-1307708626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:06:04 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-6da0dca1-db21-4901-8066-969884ddef06 tempest-TestInstancesWithCinderVolumes-1282020637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe662a2f-9127-4923-99ef-700a472f5fd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:06:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1825978348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a34c6cfc-733d-49d3-ad12-9bf9e5b64683,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa590d10f7ac435382709a76287685d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:06:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:06:04Z,use_quota=True,user_id='18182f2983b94be6a92e9cb0f86b042c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1eefb4cc-7393-49c5-9c1c-c69d053645f8),volume_type_id=1eefb4cc-7393-49c5-9c1c-c69d053645f8)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:06:04 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-6da0dca1-db21-4901-8066-969884ddef06 tempest-TestInstancesWithCinderVolumes-1282020637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38aab4f4-bcb9-436a-add6-f1653f85ee8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:06:04 devstack sudo[100975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:06:04 devstack sudo[100975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:06:04 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-6da0dca1-db21-4901-8066-969884ddef06 tempest-TestInstancesWithCinderVolumes-1282020637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38aab4f4-bcb9-436a-add6-f1653f85ee8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:06:04 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-6da0dca1-db21-4901-8066-969884ddef06 tempest-TestInstancesWithCinderVolumes-1282020637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f8082a7-d67a-4c2f-b5cb-72244271279f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:06:04 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-6da0dca1-db21-4901-8066-969884ddef06 tempest-TestInstancesWithCinderVolumes-1282020637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f8082a7-d67a-4c2f-b5cb-72244271279f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a34c6cfc-733d-49d3-ad12-9bf9e5b64683', 'volume_name': 'volume-a34c6cfc-733d-49d3-ad12-9bf9e5b64683', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:06:04 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-6da0dca1-db21-4901-8066-969884ddef06 tempest-TestInstancesWithCinderVolumes-1282020637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1338cb7-f612-4bbd-a9c1-84a61beba639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:06:04 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-6da0dca1-db21-4901-8066-969884ddef06 tempest-TestInstancesWithCinderVolumes-1282020637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1338cb7-f612-4bbd-a9c1-84a61beba639) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:06:04 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-6da0dca1-db21-4901-8066-969884ddef06 tempest-TestInstancesWithCinderVolumes-1282020637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0c517e5-13c8-4d1e-8251-5284e7388118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:06:04 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-6da0dca1-db21-4901-8066-969884ddef06 tempest-TestInstancesWithCinderVolumes-1282020637 None] Volume a34c6cfc-733d-49d3-ad12-9bf9e5b64683: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a34c6cfc-733d-49d3-ad12-9bf9e5b64683', 'volume_size': 1} Sep 17 22:06:04 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-6da0dca1-db21-4901-8066-969884ddef06 tempest-TestInstancesWithCinderVolumes-1282020637 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:06:04 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-54f00050-c8cf-4b5d-a9d3-242e08e2cedb tempest-TestShelveInstance-763943664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26b4fc98-44ef-45b7-b0c1-b16032c8a7ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5303dab-81aa-4558-b4a2-13fead2fa414', 'volume_size': 1, 'image_id': '764e44ff-49f7-469a-925c-23f254888b59', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/764e44ff-49f7-469a-925c-23f254888b59', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '530062d71c924da39eff46373302dc71', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '764e44ff-49f7-469a-925c-23f254888b59', 'created_at': datetime.datetime(2026, 9, 17, 19, 45, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 19, 45, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/764e44ff-49f7-469a-925c-23f254888b59/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:06:04 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-54f00050-c8cf-4b5d-a9d3-242e08e2cedb tempest-TestShelveInstance-763943664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64c98db9-88e0-4a42-8b9b-d7ea8d234d4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:06:04 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-54f00050-c8cf-4b5d-a9d3-242e08e2cedb tempest-TestShelveInstance-763943664 None] Volume volume-f5303dab-81aa-4558-b4a2-13fead2fa414 (f5303dab-81aa-4558-b4a2-13fead2fa414): created successfully Sep 17 22:06:04 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-54f00050-c8cf-4b5d-a9d3-242e08e2cedb tempest-TestShelveInstance-763943664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64c98db9-88e0-4a42-8b9b-d7ea8d234d4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:06:04 devstack sudo[100973]: pam_unix(sudo:session): session closed for user root Sep 17 22:06:04 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-54f00050-c8cf-4b5d-a9d3-242e08e2cedb tempest-TestShelveInstance-763943664 None] Flow 'volume_create_manager' (4d45ef6c-22d1-4b93-b383-2dff1ffcb58f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:06:04 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-ba6d464e-190e-464b-8013-e5113236f7f2 tempest-CinderUnicodeTest-224747412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-703b56e6-b34c-48dd-8ff2-250e4581cf31" returned: 0 in 0.333s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:06:04 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-ba6d464e-190e-464b-8013-e5113236f7f2 tempest-CinderUnicodeTest-224747412 None] <== create_volume: return (1056ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 22:06:04 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-ba6d464e-190e-464b-8013-e5113236f7f2 tempest-CinderUnicodeTest-224747412 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.060s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:06:04 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-6da0dca1-db21-4901-8066-969884ddef06 tempest-TestInstancesWithCinderVolumes-1282020637 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.114s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:06:04 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-6da0dca1-db21-4901-8066-969884ddef06 tempest-TestInstancesWithCinderVolumes-1282020637 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:06:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1825978348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a34c6cfc-733d-49d3-ad12-9bf9e5b64683,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa590d10f7ac435382709a76287685d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:06:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:06:04Z,use_quota=True,user_id='18182f2983b94be6a92e9cb0f86b042c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1eefb4cc-7393-49c5-9c1c-c69d053645f8),volume_type_id=1eefb4cc-7393-49c5-9c1c-c69d053645f8)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 22:06:04 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-6da0dca1-db21-4901-8066-969884ddef06 tempest-TestInstancesWithCinderVolumes-1282020637 None] Creating volume a34c6cfc-733d-49d3-ad12-9bf9e5b64683 {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 22:06:04 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-6da0dca1-db21-4901-8066-969884ddef06 tempest-TestInstancesWithCinderVolumes-1282020637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:06:04 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-6da0dca1-db21-4901-8066-969884ddef06 tempest-TestInstancesWithCinderVolumes-1282020637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:06:04 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-6da0dca1-db21-4901-8066-969884ddef06 tempest-TestInstancesWithCinderVolumes-1282020637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:06:04 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-6da0dca1-db21-4901-8066-969884ddef06 tempest-TestInstancesWithCinderVolumes-1282020637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:06:04 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-6da0dca1-db21-4901-8066-969884ddef06 tempest-TestInstancesWithCinderVolumes-1282020637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:06:04 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-6da0dca1-db21-4901-8066-969884ddef06 tempest-TestInstancesWithCinderVolumes-1282020637 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 22:06:04 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-6da0dca1-db21-4901-8066-969884ddef06 tempest-TestInstancesWithCinderVolumes-1282020637 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 22:06:04 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-6da0dca1-db21-4901-8066-969884ddef06 tempest-TestInstancesWithCinderVolumes-1282020637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a34c6cfc-733d-49d3-ad12-9bf9e5b64683 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:06:04 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-54f00050-c8cf-4b5d-a9d3-242e08e2cedb tempest-TestShelveInstance-763943664 None] Created volume successfully. Sep 17 22:06:04 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-ba6d464e-190e-464b-8013-e5113236f7f2 tempest-CinderUnicodeTest-224747412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99802e5f-173d-4fc9-9049-673c07b8e779) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-703b56e6-b34c-48dd-8ff2-250e4581cf31', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:06:04 devstack sudo[100978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a34c6cfc-733d-49d3-ad12-9bf9e5b64683 1073741824 Sep 17 22:06:04 devstack sudo[100978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:06:04 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-ba6d464e-190e-464b-8013-e5113236f7f2 tempest-CinderUnicodeTest-224747412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ce3ba5b-19f2-4d53-9689-a1a66c80eec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:06:04 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-ba6d464e-190e-464b-8013-e5113236f7f2 tempest-CinderUnicodeTest-224747412 None] Volume volume-703b56e6-b34c-48dd-8ff2-250e4581cf31 (703b56e6-b34c-48dd-8ff2-250e4581cf31): created successfully Sep 17 22:06:04 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-ba6d464e-190e-464b-8013-e5113236f7f2 tempest-CinderUnicodeTest-224747412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ce3ba5b-19f2-4d53-9689-a1a66c80eec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:06:04 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-ba6d464e-190e-464b-8013-e5113236f7f2 tempest-CinderUnicodeTest-224747412 None] Flow 'volume_create_manager' (d71d3625-a40e-495b-b6de-1a8a8453dfbf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:06:04 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-ba6d464e-190e-464b-8013-e5113236f7f2 tempest-CinderUnicodeTest-224747412 None] Created volume successfully. Sep 17 22:06:04 devstack sudo[100975]: pam_unix(sudo:session): session closed for user root Sep 17 22:06:04 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-9d659801-0949-4b61-9421-9581a3d2a8cd tempest-SnapshotDependencyTests-1307708626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.406s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:06:04 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-9d659801-0949-4b61-9421-9581a3d2a8cd tempest-SnapshotDependencyTests-1307708626 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:06:04 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-9d659801-0949-4b61-9421-9581a3d2a8cd tempest-SnapshotDependencyTests-1307708626 None] Deleted volume successfully. Sep 17 22:06:04 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-9d659801-0949-4b61-9421-9581a3d2a8cd tempest-SnapshotDependencyTests-1307708626 None] Lock "cinder-c342fb53-f7b6-4bd2-83a6-9ba2707a2ecd-delete_volume" released by "delete_volume" :: held 1.836s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:06:04 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-e80bf8f7-c0eb-4164-bac0-8d17f0c75241 tempest-TestInstancesWithCinderVolumes-1282020637 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 22:06:04 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e80bf8f7-c0eb-4164-bac0-8d17f0c75241 tempest-TestInstancesWithCinderVolumes-1282020637 None] Flow 'volume_create_manager' (080c9481-a65c-4acc-9db6-306581088f2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:06:05 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e80bf8f7-c0eb-4164-bac0-8d17f0c75241 tempest-TestInstancesWithCinderVolumes-1282020637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3df185c-0312-44e2-be21-81790980add2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:06:05 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e80bf8f7-c0eb-4164-bac0-8d17f0c75241 tempest-TestInstancesWithCinderVolumes-1282020637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3df185c-0312-44e2-be21-81790980add2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:06:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-202539238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c214cc59-ff16-4a9e-8f62-7a1b97190f8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa590d10f7ac435382709a76287685d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:06:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:06:05Z,use_quota=True,user_id='18182f2983b94be6a92e9cb0f86b042c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45bcc10b-f83c-40e2-893e-f9a48a597ba5),volume_type_id=45bcc10b-f83c-40e2-893e-f9a48a597ba5)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:06:05 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e80bf8f7-c0eb-4164-bac0-8d17f0c75241 tempest-TestInstancesWithCinderVolumes-1282020637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcf48350-2e60-4686-aac8-e6b8b5a269ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:06:05 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e80bf8f7-c0eb-4164-bac0-8d17f0c75241 tempest-TestInstancesWithCinderVolumes-1282020637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcf48350-2e60-4686-aac8-e6b8b5a269ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:06:05 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e80bf8f7-c0eb-4164-bac0-8d17f0c75241 tempest-TestInstancesWithCinderVolumes-1282020637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (414b9129-5b4c-47f6-b3df-96bf76138028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:06:05 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e80bf8f7-c0eb-4164-bac0-8d17f0c75241 tempest-TestInstancesWithCinderVolumes-1282020637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (414b9129-5b4c-47f6-b3df-96bf76138028) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c214cc59-ff16-4a9e-8f62-7a1b97190f8a', 'volume_name': 'volume-c214cc59-ff16-4a9e-8f62-7a1b97190f8a', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:06:05 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e80bf8f7-c0eb-4164-bac0-8d17f0c75241 tempest-TestInstancesWithCinderVolumes-1282020637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bf3de73-461c-42f9-a90d-828ad41a9fee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:06:05 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e80bf8f7-c0eb-4164-bac0-8d17f0c75241 tempest-TestInstancesWithCinderVolumes-1282020637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bf3de73-461c-42f9-a90d-828ad41a9fee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:06:05 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e80bf8f7-c0eb-4164-bac0-8d17f0c75241 tempest-TestInstancesWithCinderVolumes-1282020637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54b6b79c-01b5-4d5e-89b6-2cc40f32a387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:06:05 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-e80bf8f7-c0eb-4164-bac0-8d17f0c75241 tempest-TestInstancesWithCinderVolumes-1282020637 None] Volume c214cc59-ff16-4a9e-8f62-7a1b97190f8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c214cc59-ff16-4a9e-8f62-7a1b97190f8a', 'volume_size': 1} Sep 17 22:06:05 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e80bf8f7-c0eb-4164-bac0-8d17f0c75241 tempest-TestInstancesWithCinderVolumes-1282020637 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:06:05 devstack sudo[100978]: pam_unix(sudo:session): session closed for user root Sep 17 22:06:05 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-6da0dca1-db21-4901-8066-969884ddef06 tempest-TestInstancesWithCinderVolumes-1282020637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a34c6cfc-733d-49d3-ad12-9bf9e5b64683 1073741824" returned: 0 in 0.560s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:06:05 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-6da0dca1-db21-4901-8066-969884ddef06 tempest-TestInstancesWithCinderVolumes-1282020637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a34c6cfc-733d-49d3-ad12-9bf9e5b64683 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:06:05 devstack sudo[100985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a34c6cfc-733d-49d3-ad12-9bf9e5b64683 Sep 17 22:06:05 devstack sudo[100985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:06:05 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-c4f993ef-9ebb-4dc3-aebf-243ea5dd7def tempest-SnapshotDependencyTests-1307708626 None] Acquiring lock "cinder-4b2701a7-d34b-4b87-9189-9eff4e8f6f73-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:06:05 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-c4f993ef-9ebb-4dc3-aebf-243ea5dd7def tempest-SnapshotDependencyTests-1307708626 None] Lock "cinder-4b2701a7-d34b-4b87-9189-9eff4e8f6f73-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:06:05 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-c4f993ef-9ebb-4dc3-aebf-243ea5dd7def tempest-SnapshotDependencyTests-1307708626 None] Acquiring lock "cinder-quobyte-4b2701a7-d34b-4b87-9189-9eff4e8f6f73" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:06:05 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-c4f993ef-9ebb-4dc3-aebf-243ea5dd7def tempest-SnapshotDependencyTests-1307708626 None] Lock "cinder-quobyte-4b2701a7-d34b-4b87-9189-9eff4e8f6f73" acquired by "delete_volume" :: waited 0.040s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:06:05 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc3a2390-7636-4822-bfef-98d7c40a91cb]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:06:05 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-c4f993ef-9ebb-4dc3-aebf-243ea5dd7def tempest-SnapshotDependencyTests-1307708626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-4b2701a7-d34b-4b87-9189-9eff4e8f6f73 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:06:05 devstack sudo[100985]: pam_unix(sudo:session): session closed for user root Sep 17 22:06:05 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-6da0dca1-db21-4901-8066-969884ddef06 tempest-TestInstancesWithCinderVolumes-1282020637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a34c6cfc-733d-49d3-ad12-9bf9e5b64683" returned: 0 in 0.433s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:06:05 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-6da0dca1-db21-4901-8066-969884ddef06 tempest-TestInstancesWithCinderVolumes-1282020637 None] <== create_volume: return (1054ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 22:06:05 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-6da0dca1-db21-4901-8066-969884ddef06 tempest-TestInstancesWithCinderVolumes-1282020637 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.057s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:06:05 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e80bf8f7-c0eb-4164-bac0-8d17f0c75241 tempest-TestInstancesWithCinderVolumes-1282020637 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.647s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:06:05 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-e80bf8f7-c0eb-4164-bac0-8d17f0c75241 tempest-TestInstancesWithCinderVolumes-1282020637 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:06:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-202539238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c214cc59-ff16-4a9e-8f62-7a1b97190f8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa590d10f7ac435382709a76287685d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:06:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:06:05Z,use_quota=True,user_id='18182f2983b94be6a92e9cb0f86b042c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45bcc10b-f83c-40e2-893e-f9a48a597ba5),volume_type_id=45bcc10b-f83c-40e2-893e-f9a48a597ba5)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 22:06:05 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-e80bf8f7-c0eb-4164-bac0-8d17f0c75241 tempest-TestInstancesWithCinderVolumes-1282020637 None] Creating volume c214cc59-ff16-4a9e-8f62-7a1b97190f8a {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 22:06:05 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e80bf8f7-c0eb-4164-bac0-8d17f0c75241 tempest-TestInstancesWithCinderVolumes-1282020637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:06:05 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e80bf8f7-c0eb-4164-bac0-8d17f0c75241 tempest-TestInstancesWithCinderVolumes-1282020637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:06:05 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-e80bf8f7-c0eb-4164-bac0-8d17f0c75241 tempest-TestInstancesWithCinderVolumes-1282020637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:06:05 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-e80bf8f7-c0eb-4164-bac0-8d17f0c75241 tempest-TestInstancesWithCinderVolumes-1282020637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:06:05 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e80bf8f7-c0eb-4164-bac0-8d17f0c75241 tempest-TestInstancesWithCinderVolumes-1282020637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:06:05 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-e80bf8f7-c0eb-4164-bac0-8d17f0c75241 tempest-TestInstancesWithCinderVolumes-1282020637 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 22:06:05 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-e80bf8f7-c0eb-4164-bac0-8d17f0c75241 tempest-TestInstancesWithCinderVolumes-1282020637 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 22:06:05 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e80bf8f7-c0eb-4164-bac0-8d17f0c75241 tempest-TestInstancesWithCinderVolumes-1282020637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c214cc59-ff16-4a9e-8f62-7a1b97190f8a 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:06:05 devstack sudo[100989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c214cc59-ff16-4a9e-8f62-7a1b97190f8a 1073741824 Sep 17 22:06:05 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-6da0dca1-db21-4901-8066-969884ddef06 tempest-TestInstancesWithCinderVolumes-1282020637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0c517e5-13c8-4d1e-8251-5284e7388118) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a34c6cfc-733d-49d3-ad12-9bf9e5b64683', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:06:05 devstack sudo[100989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:06:05 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-6da0dca1-db21-4901-8066-969884ddef06 tempest-TestInstancesWithCinderVolumes-1282020637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc2597af-c6f6-4e46-b9eb-2cd25438d4d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:06:05 devstack sudo[100988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-4b2701a7-d34b-4b87-9189-9eff4e8f6f73 Sep 17 22:06:05 devstack sudo[100988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:06:05 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-6da0dca1-db21-4901-8066-969884ddef06 tempest-TestInstancesWithCinderVolumes-1282020637 None] Volume volume-a34c6cfc-733d-49d3-ad12-9bf9e5b64683 (a34c6cfc-733d-49d3-ad12-9bf9e5b64683): created successfully Sep 17 22:06:05 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-6da0dca1-db21-4901-8066-969884ddef06 tempest-TestInstancesWithCinderVolumes-1282020637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc2597af-c6f6-4e46-b9eb-2cd25438d4d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:06:05 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-6da0dca1-db21-4901-8066-969884ddef06 tempest-TestInstancesWithCinderVolumes-1282020637 None] Flow 'volume_create_manager' (753cc283-c097-4718-af68-2dff82ba56d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:06:05 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7886360-404d-4165-82ce-b4eaf93cbddc tempest-TestInstancesWithCinderVolumes-1282020637 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 22:06:05 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e7886360-404d-4165-82ce-b4eaf93cbddc tempest-TestInstancesWithCinderVolumes-1282020637 None] Flow 'volume_create_manager' (3155ec8f-69c5-4331-85fb-28596420c162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:06:05 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e7886360-404d-4165-82ce-b4eaf93cbddc tempest-TestInstancesWithCinderVolumes-1282020637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fb3b6b0-68d7-4c06-9074-1f8676f20607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:06:05 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-6da0dca1-db21-4901-8066-969884ddef06 tempest-TestInstancesWithCinderVolumes-1282020637 None] Created volume successfully. Sep 17 22:06:05 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e7886360-404d-4165-82ce-b4eaf93cbddc tempest-TestInstancesWithCinderVolumes-1282020637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fb3b6b0-68d7-4c06-9074-1f8676f20607) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:06:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1138625576',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91e47e7a-94a9-4dc9-baa2-582cab605241,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa590d10f7ac435382709a76287685d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:06:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:06:06Z,use_quota=True,user_id='18182f2983b94be6a92e9cb0f86b042c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0502ed2-c7e0-4a34-a038-633cb31e6247),volume_type_id=b0502ed2-c7e0-4a34-a038-633cb31e6247)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:06:05 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e7886360-404d-4165-82ce-b4eaf93cbddc tempest-TestInstancesWithCinderVolumes-1282020637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e671783e-41a9-408c-ad04-1712f233c726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:06:05 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e7886360-404d-4165-82ce-b4eaf93cbddc tempest-TestInstancesWithCinderVolumes-1282020637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e671783e-41a9-408c-ad04-1712f233c726) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:06:05 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e7886360-404d-4165-82ce-b4eaf93cbddc tempest-TestInstancesWithCinderVolumes-1282020637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6cd3223-4774-4bcb-9632-d306e5788629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:06:05 devstack cinder-volume[85458]: DEBUG cinder.image.glance [None req-e7886360-404d-4165-82ce-b4eaf93cbddc tempest-TestInstancesWithCinderVolumes-1282020637 None] Creating Keystone auth plugin from conf {{(pid=85458) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 17 22:06:06 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-a7d187f4-7242-4fb3-9743-c6f2d1b15ba1 tempest-CinderUnicodeTest-224747412 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:06:06 devstack sudo[100988]: pam_unix(sudo:session): session closed for user root Sep 17 22:06:06 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-c4f993ef-9ebb-4dc3-aebf-243ea5dd7def tempest-SnapshotDependencyTests-1307708626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-4b2701a7-d34b-4b87-9189-9eff4e8f6f73" returned: 0 in 0.535s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:06:06 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-c4f993ef-9ebb-4dc3-aebf-243ea5dd7def tempest-SnapshotDependencyTests-1307708626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-4b2701a7-d34b-4b87-9189-9eff4e8f6f73 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:06:06 devstack sudo[100999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-4b2701a7-d34b-4b87-9189-9eff4e8f6f73 Sep 17 22:06:06 devstack sudo[100999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:06:06 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e7886360-404d-4165-82ce-b4eaf93cbddc tempest-TestInstancesWithCinderVolumes-1282020637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6cd3223-4774-4bcb-9632-d306e5788629) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '91e47e7a-94a9-4dc9-baa2-582cab605241', 'volume_name': 'volume-91e47e7a-94a9-4dc9-baa2-582cab605241', 'volume_size': 1, 'image_id': '43ca8568-6628-4446-88f1-0d381b43ca3c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/43ca8568-6628-4446-88f1-0d381b43ca3c', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--340494043', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fa590d10f7ac435382709a76287685d1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '43ca8568-6628-4446-88f1-0d381b43ca3c', 'created_at': datetime.datetime(2026, 9, 17, 20, 6, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 20, 6, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/43ca8568-6628-4446-88f1-0d381b43ca3c/file', 'properties': {}}, 'image_service': }' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:06:06 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e7886360-404d-4165-82ce-b4eaf93cbddc tempest-TestInstancesWithCinderVolumes-1282020637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (844774cc-02aa-4313-b615-528cfd4b54cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:06:06 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e7886360-404d-4165-82ce-b4eaf93cbddc tempest-TestInstancesWithCinderVolumes-1282020637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (844774cc-02aa-4313-b615-528cfd4b54cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:06:06 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e7886360-404d-4165-82ce-b4eaf93cbddc tempest-TestInstancesWithCinderVolumes-1282020637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40bf8c45-239b-4762-a05a-44f9436d8395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:06:06 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-e7886360-404d-4165-82ce-b4eaf93cbddc tempest-TestInstancesWithCinderVolumes-1282020637 None] Volume 91e47e7a-94a9-4dc9-baa2-582cab605241: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-91e47e7a-94a9-4dc9-baa2-582cab605241', 'volume_size': 1, 'image_id': '43ca8568-6628-4446-88f1-0d381b43ca3c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/43ca8568-6628-4446-88f1-0d381b43ca3c', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--340494043', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fa590d10f7ac435382709a76287685d1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '43ca8568-6628-4446-88f1-0d381b43ca3c', 'created_at': datetime.datetime(2026, 9, 17, 20, 6, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 20, 6, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/43ca8568-6628-4446-88f1-0d381b43ca3c/file', 'properties': {}}, 'image_service': } Sep 17 22:06:06 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7886360-404d-4165-82ce-b4eaf93cbddc tempest-TestInstancesWithCinderVolumes-1282020637 None] Trying to clone 91e47e7a-94a9-4dc9-baa2-582cab605241 from image 43ca8568-6628-4446-88f1-0d381b43ca3c at location (None, [{'url': 'file:///opt/stack/data/glance/images/43ca8568-6628-4446-88f1-0d381b43ca3c', 'metadata': {}}]). {{(pid=85458) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 17 22:06:06 devstack sudo[100989]: pam_unix(sudo:session): session closed for user root Sep 17 22:06:06 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e80bf8f7-c0eb-4164-bac0-8d17f0c75241 tempest-TestInstancesWithCinderVolumes-1282020637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c214cc59-ff16-4a9e-8f62-7a1b97190f8a 1073741824" returned: 0 in 0.689s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:06:06 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e80bf8f7-c0eb-4164-bac0-8d17f0c75241 tempest-TestInstancesWithCinderVolumes-1282020637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c214cc59-ff16-4a9e-8f62-7a1b97190f8a {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:06:06 devstack sudo[101003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c214cc59-ff16-4a9e-8f62-7a1b97190f8a Sep 17 22:06:06 devstack sudo[101003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:06:06 devstack sudo[100999]: pam_unix(sudo:session): session closed for user root Sep 17 22:06:06 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-c4f993ef-9ebb-4dc3-aebf-243ea5dd7def tempest-SnapshotDependencyTests-1307708626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-4b2701a7-d34b-4b87-9189-9eff4e8f6f73" returned: 0 in 0.326s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:06:06 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-c4f993ef-9ebb-4dc3-aebf-243ea5dd7def tempest-SnapshotDependencyTests-1307708626 None] Lock "cinder-quobyte-4b2701a7-d34b-4b87-9189-9eff4e8f6f73" released by "delete_volume" :: held 0.941s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:06:06 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-c4f993ef-9ebb-4dc3-aebf-243ea5dd7def tempest-SnapshotDependencyTests-1307708626 None] Created reservations ['8dc2fc8c-065c-4175-bc35-4743b8132035', 'dd1cf0d0-ce02-4b32-9ca4-d116b36ede40', '78c30d23-5a37-4214-a970-3e0e3a765c19', 'c615e43f-ed3c-4042-abf9-05679624f518'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:06:06 devstack sudo[101003]: pam_unix(sudo:session): session closed for user root Sep 17 22:06:06 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-c4f993ef-9ebb-4dc3-aebf-243ea5dd7def tempest-SnapshotDependencyTests-1307708626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:06:06 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-c4f993ef-9ebb-4dc3-aebf-243ea5dd7def tempest-SnapshotDependencyTests-1307708626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:06:06 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-c4f993ef-9ebb-4dc3-aebf-243ea5dd7def tempest-SnapshotDependencyTests-1307708626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:06:06 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-c4f993ef-9ebb-4dc3-aebf-243ea5dd7def tempest-SnapshotDependencyTests-1307708626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:06:06 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-c4f993ef-9ebb-4dc3-aebf-243ea5dd7def tempest-SnapshotDependencyTests-1307708626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:06:06 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-c4f993ef-9ebb-4dc3-aebf-243ea5dd7def tempest-SnapshotDependencyTests-1307708626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:06:06 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e80bf8f7-c0eb-4164-bac0-8d17f0c75241 tempest-TestInstancesWithCinderVolumes-1282020637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c214cc59-ff16-4a9e-8f62-7a1b97190f8a" returned: 0 in 0.293s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:06:06 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-e80bf8f7-c0eb-4164-bac0-8d17f0c75241 tempest-TestInstancesWithCinderVolumes-1282020637 None] <== create_volume: return (1052ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 22:06:06 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e80bf8f7-c0eb-4164-bac0-8d17f0c75241 tempest-TestInstancesWithCinderVolumes-1282020637 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.055s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:06:06 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-a7d187f4-7242-4fb3-9743-c6f2d1b15ba1 tempest-CinderUnicodeTest-224747412 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.661s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:06:06 devstack sudo[101006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:06:06 devstack sudo[101006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:06:06 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-a7d187f4-7242-4fb3-9743-c6f2d1b15ba1 tempest-CinderUnicodeTest-224747412 None] Creating offline snapshot ce1d0b9b-ae53-4597-b623-7c35ee3e0850 of volume 703b56e6-b34c-48dd-8ff2-250e4581cf31 {{(pid=85458) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 22:06:06 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e80bf8f7-c0eb-4164-bac0-8d17f0c75241 tempest-TestInstancesWithCinderVolumes-1282020637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54b6b79c-01b5-4d5e-89b6-2cc40f32a387) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c214cc59-ff16-4a9e-8f62-7a1b97190f8a', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:06:06 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e80bf8f7-c0eb-4164-bac0-8d17f0c75241 tempest-TestInstancesWithCinderVolumes-1282020637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c4cbc5a-bf7d-46ce-beb2-df18eb703737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:06:06 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[720e2af5-bb30-4e57-bfba-3bd79cdd8eef]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:06:06 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a7d187f4-7242-4fb3-9743-c6f2d1b15ba1 tempest-CinderUnicodeTest-224747412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-703b56e6-b34c-48dd-8ff2-250e4581cf31 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:06:06 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-e80bf8f7-c0eb-4164-bac0-8d17f0c75241 tempest-TestInstancesWithCinderVolumes-1282020637 None] Volume volume-c214cc59-ff16-4a9e-8f62-7a1b97190f8a (c214cc59-ff16-4a9e-8f62-7a1b97190f8a): created successfully Sep 17 22:06:06 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e80bf8f7-c0eb-4164-bac0-8d17f0c75241 tempest-TestInstancesWithCinderVolumes-1282020637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c4cbc5a-bf7d-46ce-beb2-df18eb703737) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:06:06 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e80bf8f7-c0eb-4164-bac0-8d17f0c75241 tempest-TestInstancesWithCinderVolumes-1282020637 None] Flow 'volume_create_manager' (080c9481-a65c-4acc-9db6-306581088f2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:06:06 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-e80bf8f7-c0eb-4164-bac0-8d17f0c75241 tempest-TestInstancesWithCinderVolumes-1282020637 None] Created volume successfully. Sep 17 22:06:07 devstack sudo[101009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-703b56e6-b34c-48dd-8ff2-250e4581cf31 Sep 17 22:06:07 devstack sudo[101009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:06:07 devstack sudo[101006]: pam_unix(sudo:session): session closed for user root Sep 17 22:06:07 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-c4f993ef-9ebb-4dc3-aebf-243ea5dd7def tempest-SnapshotDependencyTests-1307708626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.310s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:06:07 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-c4f993ef-9ebb-4dc3-aebf-243ea5dd7def tempest-SnapshotDependencyTests-1307708626 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:06:07 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-c4f993ef-9ebb-4dc3-aebf-243ea5dd7def tempest-SnapshotDependencyTests-1307708626 None] Deleted volume successfully. Sep 17 22:06:07 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-c4f993ef-9ebb-4dc3-aebf-243ea5dd7def tempest-SnapshotDependencyTests-1307708626 None] Lock "cinder-4b2701a7-d34b-4b87-9189-9eff4e8f6f73-delete_volume" released by "delete_volume" :: held 1.641s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:06:07 devstack sudo[101009]: pam_unix(sudo:session): session closed for user root Sep 17 22:06:07 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a7d187f4-7242-4fb3-9743-c6f2d1b15ba1 tempest-CinderUnicodeTest-224747412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-703b56e6-b34c-48dd-8ff2-250e4581cf31" returned: 0 in 0.553s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:06:07 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a7d187f4-7242-4fb3-9743-c6f2d1b15ba1 tempest-CinderUnicodeTest-224747412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-703b56e6-b34c-48dd-8ff2-250e4581cf31,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-703b56e6-b34c-48dd-8ff2-250e4581cf31.ce1d0b9b-ae53-4597-b623-7c35ee3e0850 1G {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:06:07 devstack sudo[101017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-703b56e6-b34c-48dd-8ff2-250e4581cf31,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-703b56e6-b34c-48dd-8ff2-250e4581cf31.ce1d0b9b-ae53-4597-b623-7c35ee3e0850 1G Sep 17 22:06:07 devstack sudo[101017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:06:08 devstack sudo[101017]: pam_unix(sudo:session): session closed for user root Sep 17 22:06:08 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a7d187f4-7242-4fb3-9743-c6f2d1b15ba1 tempest-CinderUnicodeTest-224747412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-703b56e6-b34c-48dd-8ff2-250e4581cf31,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-703b56e6-b34c-48dd-8ff2-250e4581cf31.ce1d0b9b-ae53-4597-b623-7c35ee3e0850 1G" returned: 0 in 0.604s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:06:08 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a7d187f4-7242-4fb3-9743-c6f2d1b15ba1 tempest-CinderUnicodeTest-224747412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-703b56e6-b34c-48dd-8ff2-250e4581cf31 -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-703b56e6-b34c-48dd-8ff2-250e4581cf31.ce1d0b9b-ae53-4597-b623-7c35ee3e0850 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:06:08 devstack sudo[101023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-703b56e6-b34c-48dd-8ff2-250e4581cf31 -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-703b56e6-b34c-48dd-8ff2-250e4581cf31.ce1d0b9b-ae53-4597-b623-7c35ee3e0850 Sep 17 22:06:08 devstack sudo[101023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:06:08 devstack sudo[101023]: pam_unix(sudo:session): session closed for user root Sep 17 22:06:08 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a7d187f4-7242-4fb3-9743-c6f2d1b15ba1 tempest-CinderUnicodeTest-224747412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-703b56e6-b34c-48dd-8ff2-250e4581cf31 -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-703b56e6-b34c-48dd-8ff2-250e4581cf31.ce1d0b9b-ae53-4597-b623-7c35ee3e0850" returned: 0 in 0.405s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:06:08 devstack cinder-volume[85458]: WARNING cinder.volume.drivers.remotefs [None req-a7d187f4-7242-4fb3-9743-c6f2d1b15ba1 tempest-CinderUnicodeTest-224747412 None] /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-703b56e6-b34c-48dd-8ff2-250e4581cf31.ce1d0b9b-ae53-4597-b623-7c35ee3e0850 is being set with open permissions: ugo+rw Sep 17 22:06:08 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a7d187f4-7242-4fb3-9743-c6f2d1b15ba1 tempest-CinderUnicodeTest-224747412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-703b56e6-b34c-48dd-8ff2-250e4581cf31.ce1d0b9b-ae53-4597-b623-7c35ee3e0850 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:06:08 devstack sudo[101028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-703b56e6-b34c-48dd-8ff2-250e4581cf31.ce1d0b9b-ae53-4597-b623-7c35ee3e0850 Sep 17 22:06:08 devstack sudo[101028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:06:08 devstack sudo[101028]: pam_unix(sudo:session): session closed for user root Sep 17 22:06:08 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a7d187f4-7242-4fb3-9743-c6f2d1b15ba1 tempest-CinderUnicodeTest-224747412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-703b56e6-b34c-48dd-8ff2-250e4581cf31.ce1d0b9b-ae53-4597-b623-7c35ee3e0850" returned: 0 in 0.425s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:06:08 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a7d187f4-7242-4fb3-9743-c6f2d1b15ba1 tempest-CinderUnicodeTest-224747412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-703b56e6-b34c-48dd-8ff2-250e4581cf31.info {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:06:08 devstack sudo[101037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-703b56e6-b34c-48dd-8ff2-250e4581cf31.info Sep 17 22:06:08 devstack sudo[101037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:06:09 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [req-2b7ea0b7-89bc-4478-ae74-c8ab32d82623 req-6cf9c274-5c46-4e8d-838a-e6d78a69177d tempest-TestShelveInstance-763943664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:06:09 devstack sudo[101037]: pam_unix(sudo:session): session closed for user root Sep 17 22:06:09 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a7d187f4-7242-4fb3-9743-c6f2d1b15ba1 tempest-CinderUnicodeTest-224747412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-703b56e6-b34c-48dd-8ff2-250e4581cf31.info" returned: 0 in 0.477s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:06:09 devstack cinder-volume[85458]: WARNING cinder.volume.drivers.remotefs [None req-a7d187f4-7242-4fb3-9743-c6f2d1b15ba1 tempest-CinderUnicodeTest-224747412 None] /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-703b56e6-b34c-48dd-8ff2-250e4581cf31.info is being set with open permissions: ugo+rw Sep 17 22:06:09 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a7d187f4-7242-4fb3-9743-c6f2d1b15ba1 tempest-CinderUnicodeTest-224747412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-703b56e6-b34c-48dd-8ff2-250e4581cf31.info {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:06:09 devstack sudo[101043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-703b56e6-b34c-48dd-8ff2-250e4581cf31.info Sep 17 22:06:09 devstack sudo[101043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:06:09 devstack sudo[101043]: pam_unix(sudo:session): session closed for user root Sep 17 22:06:09 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a7d187f4-7242-4fb3-9743-c6f2d1b15ba1 tempest-CinderUnicodeTest-224747412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-703b56e6-b34c-48dd-8ff2-250e4581cf31.info" returned: 0 in 0.302s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:06:09 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-a7d187f4-7242-4fb3-9743-c6f2d1b15ba1 tempest-CinderUnicodeTest-224747412 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.923s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:06:09 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [req-2b7ea0b7-89bc-4478-ae74-c8ab32d82623 req-6cf9c274-5c46-4e8d-838a-e6d78a69177d tempest-TestShelveInstance-763943664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.435s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:06:09 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [req-2b7ea0b7-89bc-4478-ae74-c8ab32d82623 req-6cf9c274-5c46-4e8d-838a-e6d78a69177d tempest-TestShelveInstance-763943664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.033s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:06:09 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-a7d187f4-7242-4fb3-9743-c6f2d1b15ba1 tempest-CinderUnicodeTest-224747412 None] Create snapshot completed successfully Sep 17 22:06:09 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [req-2b7ea0b7-89bc-4478-ae74-c8ab32d82623 req-6cf9c274-5c46-4e8d-838a-e6d78a69177d tempest-TestShelveInstance-763943664 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5', 'name': 'volume-f5303dab-81aa-4558-b4a2-13fead2fa414', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'dee2b0dc-bec0-455a-ba32-243a39ffbaf6', 'enforce_multipath': True} {{(pid=85458) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 22:06:09 devstack cinder-volume[85458]: INFO cinder.volume.manager [req-2b7ea0b7-89bc-4478-ae74-c8ab32d82623 req-6cf9c274-5c46-4e8d-838a-e6d78a69177d tempest-TestShelveInstance-763943664 None] attachment_update completed successfully. Sep 17 22:06:10 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-a0116bc6-86be-4c14-bed1-402cdb0efc95 tempest-CinderUnicodeTest-224747412 None] Acquiring lock "cinder-ce1d0b9b-ae53-4597-b623-7c35ee3e0850-delete_snapshot" by "delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:06:10 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-a0116bc6-86be-4c14-bed1-402cdb0efc95 tempest-CinderUnicodeTest-224747412 None] Lock "cinder-ce1d0b9b-ae53-4597-b623-7c35ee3e0850-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:06:10 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-a0116bc6-86be-4c14-bed1-402cdb0efc95 tempest-CinderUnicodeTest-224747412 None] Acquiring lock "cinder-quobyte-703b56e6-b34c-48dd-8ff2-250e4581cf31" by "delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:06:10 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-a0116bc6-86be-4c14-bed1-402cdb0efc95 tempest-CinderUnicodeTest-224747412 None] Lock "cinder-quobyte-703b56e6-b34c-48dd-8ff2-250e4581cf31" acquired by "delete_snapshot" :: waited 0.023s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:06:10 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-a0116bc6-86be-4c14-bed1-402cdb0efc95 tempest-CinderUnicodeTest-224747412 None] Acquiring lock "cinder-quobyte-ce1d0b9b-ae53-4597-b623-7c35ee3e0850" by "_delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:06:10 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-a0116bc6-86be-4c14-bed1-402cdb0efc95 tempest-CinderUnicodeTest-224747412 None] Lock "cinder-quobyte-ce1d0b9b-ae53-4597-b623-7c35ee3e0850" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:06:10 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-a0116bc6-86be-4c14-bed1-402cdb0efc95 tempest-CinderUnicodeTest-224747412 None] Deleting offline snapshot ce1d0b9b-ae53-4597-b623-7c35ee3e0850 of volume 703b56e6-b34c-48dd-8ff2-250e4581cf31 {{(pid=85458) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 22:06:10 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-a0116bc6-86be-4c14-bed1-402cdb0efc95 tempest-CinderUnicodeTest-224747412 None] snapshot_file for this snap is: volume-703b56e6-b34c-48dd-8ff2-250e4581cf31.ce1d0b9b-ae53-4597-b623-7c35ee3e0850 {{(pid=85458) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 22:06:10 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f6e6069-cd8d-459e-8cf4-db826153d51d]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:06:10 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a0116bc6-86be-4c14-bed1-402cdb0efc95 tempest-CinderUnicodeTest-224747412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-703b56e6-b34c-48dd-8ff2-250e4581cf31.ce1d0b9b-ae53-4597-b623-7c35ee3e0850 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:06:10 devstack sudo[101047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-703b56e6-b34c-48dd-8ff2-250e4581cf31.ce1d0b9b-ae53-4597-b623-7c35ee3e0850 Sep 17 22:06:10 devstack sudo[101047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:06:11 devstack sudo[101047]: pam_unix(sudo:session): session closed for user root Sep 17 22:06:11 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a0116bc6-86be-4c14-bed1-402cdb0efc95 tempest-CinderUnicodeTest-224747412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-703b56e6-b34c-48dd-8ff2-250e4581cf31.ce1d0b9b-ae53-4597-b623-7c35ee3e0850" returned: 0 in 0.518s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:06:11 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-a0116bc6-86be-4c14-bed1-402cdb0efc95 tempest-CinderUnicodeTest-224747412 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-703b56e6-b34c-48dd-8ff2-250e4581cf31(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85458) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 22:06:11 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a353834-86df-41d7-acea-0b65eea350a3]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:06:11 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a0116bc6-86be-4c14-bed1-402cdb0efc95 tempest-CinderUnicodeTest-224747412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-703b56e6-b34c-48dd-8ff2-250e4581cf31 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:06:11 devstack sudo[101052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-703b56e6-b34c-48dd-8ff2-250e4581cf31 Sep 17 22:06:11 devstack sudo[101052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:06:11 devstack cinder-volume[85458]: DEBUG cinder.image.image_utils [None req-e7886360-404d-4165-82ce-b4eaf93cbddc tempest-TestInstancesWithCinderVolumes-1282020637 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_43ca8568-6628-4446-88f1-0d381b43ca3c_nab4s8k2devstack@QuobyteHD, size 20.69 MB, duration 5.22 sec {{(pid=85458) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 17 22:06:11 devstack cinder-volume[85458]: INFO cinder.image.image_utils [None req-e7886360-404d-4165-82ce-b4eaf93cbddc tempest-TestInstancesWithCinderVolumes-1282020637 None] Image download 20.69 MB at 3.96 MB/s Sep 17 22:06:11 devstack sudo[101052]: pam_unix(sudo:session): session closed for user root Sep 17 22:06:11 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a0116bc6-86be-4c14-bed1-402cdb0efc95 tempest-CinderUnicodeTest-224747412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-703b56e6-b34c-48dd-8ff2-250e4581cf31" returned: 0 in 0.493s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:06:11 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a0116bc6-86be-4c14-bed1-402cdb0efc95 tempest-CinderUnicodeTest-224747412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-703b56e6-b34c-48dd-8ff2-250e4581cf31.ce1d0b9b-ae53-4597-b623-7c35ee3e0850 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:06:11 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ed00a23-c5fc-40fd-8963-9bfe613041a0]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:06:11 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e7886360-404d-4165-82ce-b4eaf93cbddc tempest-TestInstancesWithCinderVolumes-1282020637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_43ca8568-6628-4446-88f1-0d381b43ca3c_nab4s8k2devstack@QuobyteHD {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:06:11 devstack sudo[101058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-703b56e6-b34c-48dd-8ff2-250e4581cf31.ce1d0b9b-ae53-4597-b623-7c35ee3e0850 Sep 17 22:06:11 devstack sudo[101058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:06:11 devstack sudo[101060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_43ca8568-6628-4446-88f1-0d381b43ca3c_nab4s8k2devstack@QuobyteHD Sep 17 22:06:11 devstack sudo[101060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:06:12 devstack sudo[101058]: pam_unix(sudo:session): session closed for user root Sep 17 22:06:12 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a0116bc6-86be-4c14-bed1-402cdb0efc95 tempest-CinderUnicodeTest-224747412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-703b56e6-b34c-48dd-8ff2-250e4581cf31.ce1d0b9b-ae53-4597-b623-7c35ee3e0850" returned: 0 in 0.390s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:06:12 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a0116bc6-86be-4c14-bed1-402cdb0efc95 tempest-CinderUnicodeTest-224747412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-703b56e6-b34c-48dd-8ff2-250e4581cf31.ce1d0b9b-ae53-4597-b623-7c35ee3e0850 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:06:12 devstack sudo[101060]: pam_unix(sudo:session): session closed for user root Sep 17 22:06:12 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e7886360-404d-4165-82ce-b4eaf93cbddc tempest-TestInstancesWithCinderVolumes-1282020637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_43ca8568-6628-4446-88f1-0d381b43ca3c_nab4s8k2devstack@QuobyteHD" returned: 0 in 0.378s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:06:12 devstack cinder-volume[85458]: DEBUG cinder.image.image_utils [None req-e7886360-404d-4165-82ce-b4eaf93cbddc tempest-TestInstancesWithCinderVolumes-1282020637 None] Temporary image 43ca8568-6628-4446-88f1-0d381b43ca3c is fetched for user 18182f2983b94be6a92e9cb0f86b042c. {{(pid=85458) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 17 22:06:12 devstack sudo[101068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-703b56e6-b34c-48dd-8ff2-250e4581cf31.ce1d0b9b-ae53-4597-b623-7c35ee3e0850 Sep 17 22:06:12 devstack sudo[101068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:06:12 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[db9fc6ba-8952-48bd-9c40-21b3d3bc5004]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:06:12 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e7886360-404d-4165-82ce-b4eaf93cbddc tempest-TestInstancesWithCinderVolumes-1282020637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_43ca8568-6628-4446-88f1-0d381b43ca3c_nab4s8k2devstack@QuobyteHD {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:06:12 devstack sudo[101070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_43ca8568-6628-4446-88f1-0d381b43ca3c_nab4s8k2devstack@QuobyteHD Sep 17 22:06:12 devstack sudo[101070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:06:12 devstack sudo[101068]: pam_unix(sudo:session): session closed for user root Sep 17 22:06:12 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a0116bc6-86be-4c14-bed1-402cdb0efc95 tempest-CinderUnicodeTest-224747412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-703b56e6-b34c-48dd-8ff2-250e4581cf31.ce1d0b9b-ae53-4597-b623-7c35ee3e0850" returned: 0 in 0.419s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:06:12 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-a0116bc6-86be-4c14-bed1-402cdb0efc95 tempest-CinderUnicodeTest-224747412 None] Lock "cinder-quobyte-ce1d0b9b-ae53-4597-b623-7c35ee3e0850" released by "_delete_snapshot" :: held 1.967s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:06:12 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-a0116bc6-86be-4c14-bed1-402cdb0efc95 tempest-CinderUnicodeTest-224747412 None] Lock "cinder-quobyte-703b56e6-b34c-48dd-8ff2-250e4581cf31" released by "delete_snapshot" :: held 2.009s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:06:12 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-a0116bc6-86be-4c14-bed1-402cdb0efc95 tempest-CinderUnicodeTest-224747412 None] Created reservations ['b1c1ab85-6170-4d85-9fdf-a9c756c7747f', 'de800169-9ccc-4c71-b489-1e811cc9f7fc', '078eea99-0d77-46a8-a7f6-ae1a14fc5c6c', '0a454b9c-52dc-48e0-b9a5-0abd3b221580'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:06:12 devstack sudo[101070]: pam_unix(sudo:session): session closed for user root Sep 17 22:06:12 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e7886360-404d-4165-82ce-b4eaf93cbddc tempest-TestInstancesWithCinderVolumes-1282020637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_43ca8568-6628-4446-88f1-0d381b43ca3c_nab4s8k2devstack@QuobyteHD" returned: 0 in 0.617s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:06:12 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e7886360-404d-4165-82ce-b4eaf93cbddc tempest-TestInstancesWithCinderVolumes-1282020637 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:06:12 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e7886360-404d-4165-82ce-b4eaf93cbddc tempest-TestInstancesWithCinderVolumes-1282020637 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:06:12 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-e7886360-404d-4165-82ce-b4eaf93cbddc tempest-TestInstancesWithCinderVolumes-1282020637 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:06:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1138625576',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91e47e7a-94a9-4dc9-baa2-582cab605241,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa590d10f7ac435382709a76287685d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:06:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:06:06Z,use_quota=True,user_id='18182f2983b94be6a92e9cb0f86b042c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0502ed2-c7e0-4a34-a038-633cb31e6247),volume_type_id=b0502ed2-c7e0-4a34-a038-633cb31e6247)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 22:06:12 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-e7886360-404d-4165-82ce-b4eaf93cbddc tempest-TestInstancesWithCinderVolumes-1282020637 None] Creating volume 91e47e7a-94a9-4dc9-baa2-582cab605241 {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 22:06:12 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e7886360-404d-4165-82ce-b4eaf93cbddc tempest-TestInstancesWithCinderVolumes-1282020637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:06:12 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e7886360-404d-4165-82ce-b4eaf93cbddc tempest-TestInstancesWithCinderVolumes-1282020637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:06:12 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-e7886360-404d-4165-82ce-b4eaf93cbddc tempest-TestInstancesWithCinderVolumes-1282020637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:06:12 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-e7886360-404d-4165-82ce-b4eaf93cbddc tempest-TestInstancesWithCinderVolumes-1282020637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:06:12 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e7886360-404d-4165-82ce-b4eaf93cbddc tempest-TestInstancesWithCinderVolumes-1282020637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:06:12 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-e7886360-404d-4165-82ce-b4eaf93cbddc tempest-TestInstancesWithCinderVolumes-1282020637 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 22:06:12 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-e7886360-404d-4165-82ce-b4eaf93cbddc tempest-TestInstancesWithCinderVolumes-1282020637 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 22:06:12 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e7886360-404d-4165-82ce-b4eaf93cbddc tempest-TestInstancesWithCinderVolumes-1282020637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-91e47e7a-94a9-4dc9-baa2-582cab605241 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:06:12 devstack sudo[101182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-91e47e7a-94a9-4dc9-baa2-582cab605241 1073741824 Sep 17 22:06:12 devstack sudo[101182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:06:13 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-a0116bc6-86be-4c14-bed1-402cdb0efc95 tempest-CinderUnicodeTest-224747412 None] Delete snapshot completed successfully. Sep 17 22:06:13 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-a0116bc6-86be-4c14-bed1-402cdb0efc95 tempest-CinderUnicodeTest-224747412 None] Lock "cinder-ce1d0b9b-ae53-4597-b623-7c35ee3e0850-delete_snapshot" released by "delete_snapshot" :: held 2.531s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:06:13 devstack sudo[101182]: pam_unix(sudo:session): session closed for user root Sep 17 22:06:13 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e7886360-404d-4165-82ce-b4eaf93cbddc tempest-TestInstancesWithCinderVolumes-1282020637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-91e47e7a-94a9-4dc9-baa2-582cab605241 1073741824" returned: 0 in 0.926s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:06:13 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-5b1f670b-08f1-4a93-8f93-d3f6c1e45726 tempest-CinderUnicodeTest-224747412 None] Acquiring lock "cinder-703b56e6-b34c-48dd-8ff2-250e4581cf31-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:06:13 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-5b1f670b-08f1-4a93-8f93-d3f6c1e45726 tempest-CinderUnicodeTest-224747412 None] Lock "cinder-703b56e6-b34c-48dd-8ff2-250e4581cf31-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:06:13 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e7886360-404d-4165-82ce-b4eaf93cbddc tempest-TestInstancesWithCinderVolumes-1282020637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-91e47e7a-94a9-4dc9-baa2-582cab605241 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:06:13 devstack sudo[101550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-91e47e7a-94a9-4dc9-baa2-582cab605241 Sep 17 22:06:13 devstack sudo[101550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:06:14 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-5b1f670b-08f1-4a93-8f93-d3f6c1e45726 tempest-CinderUnicodeTest-224747412 None] Acquiring lock "cinder-quobyte-703b56e6-b34c-48dd-8ff2-250e4581cf31" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:06:14 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-5b1f670b-08f1-4a93-8f93-d3f6c1e45726 tempest-CinderUnicodeTest-224747412 None] Lock "cinder-quobyte-703b56e6-b34c-48dd-8ff2-250e4581cf31" acquired by "delete_volume" :: waited 0.033s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:06:14 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e857cc2-1b77-4447-a891-b1601895669e]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:06:14 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-5b1f670b-08f1-4a93-8f93-d3f6c1e45726 tempest-CinderUnicodeTest-224747412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-703b56e6-b34c-48dd-8ff2-250e4581cf31 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:06:14 devstack sudo[101550]: pam_unix(sudo:session): session closed for user root Sep 17 22:06:14 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e7886360-404d-4165-82ce-b4eaf93cbddc tempest-TestInstancesWithCinderVolumes-1282020637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-91e47e7a-94a9-4dc9-baa2-582cab605241" returned: 0 in 0.489s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:06:14 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-e7886360-404d-4165-82ce-b4eaf93cbddc tempest-TestInstancesWithCinderVolumes-1282020637 None] <== create_volume: return (1572ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 22:06:14 devstack sudo[101555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-703b56e6-b34c-48dd-8ff2-250e4581cf31 Sep 17 22:06:14 devstack sudo[101555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:06:14 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e7886360-404d-4165-82ce-b4eaf93cbddc tempest-TestInstancesWithCinderVolumes-1282020637 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.583s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:06:14 devstack cinder-volume[85458]: DEBUG cinder.volume.volume_utils [None req-e7886360-404d-4165-82ce-b4eaf93cbddc tempest-TestInstancesWithCinderVolumes-1282020637 None] Attempting download of 43ca8568-6628-4446-88f1-0d381b43ca3c ((None, [{'url': 'file:///opt/stack/data/glance/images/43ca8568-6628-4446-88f1-0d381b43ca3c', 'metadata': {}}])) to volume 91e47e7a-94a9-4dc9-baa2-582cab605241. {{(pid=85458) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 17 22:06:14 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddc8634a-ddac-4c20-9311-8e3548bb4582]: (4, 'raw') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:06:14 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e7886360-404d-4165-82ce-b4eaf93cbddc tempest-TestInstancesWithCinderVolumes-1282020637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_43ca8568-6628-4446-88f1-0d381b43ca3c_huys958v {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:06:14 devstack sudo[101561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_43ca8568-6628-4446-88f1-0d381b43ca3c_huys958v Sep 17 22:06:14 devstack sudo[101561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:06:14 devstack sudo[101555]: pam_unix(sudo:session): session closed for user root Sep 17 22:06:14 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-5b1f670b-08f1-4a93-8f93-d3f6c1e45726 tempest-CinderUnicodeTest-224747412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-703b56e6-b34c-48dd-8ff2-250e4581cf31" returned: 0 in 0.723s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:06:14 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-5b1f670b-08f1-4a93-8f93-d3f6c1e45726 tempest-CinderUnicodeTest-224747412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-703b56e6-b34c-48dd-8ff2-250e4581cf31 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:06:14 devstack sudo[101568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-703b56e6-b34c-48dd-8ff2-250e4581cf31 Sep 17 22:06:14 devstack sudo[101568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:06:15 devstack sudo[101561]: pam_unix(sudo:session): session closed for user root Sep 17 22:06:15 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e7886360-404d-4165-82ce-b4eaf93cbddc tempest-TestInstancesWithCinderVolumes-1282020637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_43ca8568-6628-4446-88f1-0d381b43ca3c_huys958v" returned: 0 in 0.731s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:06:15 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e7886360-404d-4165-82ce-b4eaf93cbddc tempest-TestInstancesWithCinderVolumes-1282020637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_43ca8568-6628-4446-88f1-0d381b43ca3c_huys958v {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:06:15 devstack sudo[101573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_43ca8568-6628-4446-88f1-0d381b43ca3c_huys958v Sep 17 22:06:15 devstack sudo[101573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:06:15 devstack sudo[101568]: pam_unix(sudo:session): session closed for user root Sep 17 22:06:15 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-5b1f670b-08f1-4a93-8f93-d3f6c1e45726 tempest-CinderUnicodeTest-224747412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-703b56e6-b34c-48dd-8ff2-250e4581cf31" returned: 0 in 0.668s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:06:15 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-5b1f670b-08f1-4a93-8f93-d3f6c1e45726 tempest-CinderUnicodeTest-224747412 None] Lock "cinder-quobyte-703b56e6-b34c-48dd-8ff2-250e4581cf31" released by "delete_volume" :: held 1.519s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:06:15 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-5b1f670b-08f1-4a93-8f93-d3f6c1e45726 tempest-CinderUnicodeTest-224747412 None] Created reservations ['cce7693c-0493-41e7-9670-b63d07386a40', 'e926ec6f-e928-4bf3-b569-00bfa3323b10', '1d23ef6a-2949-4eea-9579-dc60bc30a2c4', '6043a110-248c-4220-800d-1c7a4cb9c6bb'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:06:15 devstack sudo[101573]: pam_unix(sudo:session): session closed for user root Sep 17 22:06:15 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e7886360-404d-4165-82ce-b4eaf93cbddc tempest-TestInstancesWithCinderVolumes-1282020637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_43ca8568-6628-4446-88f1-0d381b43ca3c_huys958v" returned: 1 in 0.483s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:06:15 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e7886360-404d-4165-82ce-b4eaf93cbddc tempest-TestInstancesWithCinderVolumes-1282020637 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_43ca8568-6628-4446-88f1-0d381b43ca3c_huys958v' failed. Not Retrying. {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 22:06:15 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[24b70b36-d874-4e04-9b72-d37db865ce3b]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:06:15 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e7886360-404d-4165-82ce-b4eaf93cbddc tempest-TestInstancesWithCinderVolumes-1282020637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_43ca8568-6628-4446-88f1-0d381b43ca3c_nab4s8k2devstack@QuobyteHD {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:06:15 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-5b1f670b-08f1-4a93-8f93-d3f6c1e45726 tempest-CinderUnicodeTest-224747412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:06:15 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-5b1f670b-08f1-4a93-8f93-d3f6c1e45726 tempest-CinderUnicodeTest-224747412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:06:15 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-5b1f670b-08f1-4a93-8f93-d3f6c1e45726 tempest-CinderUnicodeTest-224747412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:06:15 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-5b1f670b-08f1-4a93-8f93-d3f6c1e45726 tempest-CinderUnicodeTest-224747412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:06:15 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-5b1f670b-08f1-4a93-8f93-d3f6c1e45726 tempest-CinderUnicodeTest-224747412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:06:15 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-5b1f670b-08f1-4a93-8f93-d3f6c1e45726 tempest-CinderUnicodeTest-224747412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:06:15 devstack sudo[101578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_43ca8568-6628-4446-88f1-0d381b43ca3c_nab4s8k2devstack@QuobyteHD Sep 17 22:06:15 devstack sudo[101578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:06:15 devstack sudo[101579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:06:15 devstack sudo[101579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:06:16 devstack sudo[101579]: pam_unix(sudo:session): session closed for user root Sep 17 22:06:16 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-5b1f670b-08f1-4a93-8f93-d3f6c1e45726 tempest-CinderUnicodeTest-224747412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.366s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:06:16 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-5b1f670b-08f1-4a93-8f93-d3f6c1e45726 tempest-CinderUnicodeTest-224747412 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:06:16 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-5b1f670b-08f1-4a93-8f93-d3f6c1e45726 tempest-CinderUnicodeTest-224747412 None] Deleted volume successfully. Sep 17 22:06:16 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-5b1f670b-08f1-4a93-8f93-d3f6c1e45726 tempest-CinderUnicodeTest-224747412 None] Lock "cinder-703b56e6-b34c-48dd-8ff2-250e4581cf31-delete_volume" released by "delete_volume" :: held 2.444s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:06:16 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-7e65e929-c042-4894-a2c2-1f6d3d4842b9 tempest-CinderUnicodeTest-224747412 None] Acquiring lock "cinder-a5534812-1ebb-4810-b626-1ade0a260f0e-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:06:16 devstack sudo[101578]: pam_unix(sudo:session): session closed for user root Sep 17 22:06:16 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e7886360-404d-4165-82ce-b4eaf93cbddc tempest-TestInstancesWithCinderVolumes-1282020637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_43ca8568-6628-4446-88f1-0d381b43ca3c_nab4s8k2devstack@QuobyteHD" returned: 0 in 0.614s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:06:16 devstack cinder-volume[85458]: DEBUG cinder.image.image_utils [None req-e7886360-404d-4165-82ce-b4eaf93cbddc tempest-TestInstancesWithCinderVolumes-1282020637 None] 43ca8568-6628-4446-88f1-0d381b43ca3c was qcow2, converting to qcow2 {{(pid=85458) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 17 22:06:16 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e7886360-404d-4165-82ce-b4eaf93cbddc tempest-TestInstancesWithCinderVolumes-1282020637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_43ca8568-6628-4446-88f1-0d381b43ca3c_nab4s8k2devstack@QuobyteHD /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-91e47e7a-94a9-4dc9-baa2-582cab605241 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:06:16 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-7e65e929-c042-4894-a2c2-1f6d3d4842b9 tempest-CinderUnicodeTest-224747412 None] Lock "cinder-a5534812-1ebb-4810-b626-1ade0a260f0e-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:06:16 devstack sudo[101587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_43ca8568-6628-4446-88f1-0d381b43ca3c_nab4s8k2devstack@QuobyteHD /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-91e47e7a-94a9-4dc9-baa2-582cab605241 Sep 17 22:06:16 devstack sudo[101587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:06:16 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-7e65e929-c042-4894-a2c2-1f6d3d4842b9 tempest-CinderUnicodeTest-224747412 None] Acquiring lock "cinder-quobyte-a5534812-1ebb-4810-b626-1ade0a260f0e" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:06:16 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-7e65e929-c042-4894-a2c2-1f6d3d4842b9 tempest-CinderUnicodeTest-224747412 None] Lock "cinder-quobyte-a5534812-1ebb-4810-b626-1ade0a260f0e" acquired by "delete_volume" :: waited 0.033s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:06:16 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[794ff9b5-bdc4-490d-aef8-f8000948ba20]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:06:16 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-7e65e929-c042-4894-a2c2-1f6d3d4842b9 tempest-CinderUnicodeTest-224747412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a5534812-1ebb-4810-b626-1ade0a260f0e {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:06:16 devstack sudo[101589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a5534812-1ebb-4810-b626-1ade0a260f0e Sep 17 22:06:16 devstack sudo[101589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:06:17 devstack sudo[101589]: pam_unix(sudo:session): session closed for user root Sep 17 22:06:17 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-7e65e929-c042-4894-a2c2-1f6d3d4842b9 tempest-CinderUnicodeTest-224747412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a5534812-1ebb-4810-b626-1ade0a260f0e" returned: 0 in 0.811s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:06:17 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-7e65e929-c042-4894-a2c2-1f6d3d4842b9 tempest-CinderUnicodeTest-224747412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a5534812-1ebb-4810-b626-1ade0a260f0e {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:06:17 devstack sudo[101599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a5534812-1ebb-4810-b626-1ade0a260f0e Sep 17 22:06:17 devstack sudo[101599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:06:18 devstack sudo[101599]: pam_unix(sudo:session): session closed for user root Sep 17 22:06:18 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-7e65e929-c042-4894-a2c2-1f6d3d4842b9 tempest-CinderUnicodeTest-224747412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a5534812-1ebb-4810-b626-1ade0a260f0e" returned: 0 in 0.698s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:06:18 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-7e65e929-c042-4894-a2c2-1f6d3d4842b9 tempest-CinderUnicodeTest-224747412 None] Lock "cinder-quobyte-a5534812-1ebb-4810-b626-1ade0a260f0e" released by "delete_volume" :: held 1.626s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:06:18 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-7e65e929-c042-4894-a2c2-1f6d3d4842b9 tempest-CinderUnicodeTest-224747412 None] Created reservations ['60536b10-ffc6-4a46-b1bd-b4ffc93d744e', '63e6c12c-e101-4340-b3e6-85d28fa34779', 'e503bc18-5f89-4624-a744-ecfed38f06e9', '39c845c6-5f7b-4a89-92a5-cfb7a686522b'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:06:18 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-7e65e929-c042-4894-a2c2-1f6d3d4842b9 tempest-CinderUnicodeTest-224747412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:06:18 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-7e65e929-c042-4894-a2c2-1f6d3d4842b9 tempest-CinderUnicodeTest-224747412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:06:18 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-7e65e929-c042-4894-a2c2-1f6d3d4842b9 tempest-CinderUnicodeTest-224747412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:06:18 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-7e65e929-c042-4894-a2c2-1f6d3d4842b9 tempest-CinderUnicodeTest-224747412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:06:18 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-7e65e929-c042-4894-a2c2-1f6d3d4842b9 tempest-CinderUnicodeTest-224747412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:06:18 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-7e65e929-c042-4894-a2c2-1f6d3d4842b9 tempest-CinderUnicodeTest-224747412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:06:18 devstack sudo[101603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:06:18 devstack sudo[101603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:06:18 devstack sudo[101603]: pam_unix(sudo:session): session closed for user root Sep 17 22:06:18 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-7e65e929-c042-4894-a2c2-1f6d3d4842b9 tempest-CinderUnicodeTest-224747412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.378s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:06:18 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-7e65e929-c042-4894-a2c2-1f6d3d4842b9 tempest-CinderUnicodeTest-224747412 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:06:18 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-7e65e929-c042-4894-a2c2-1f6d3d4842b9 tempest-CinderUnicodeTest-224747412 None] Deleted volume successfully. Sep 17 22:06:18 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-7e65e929-c042-4894-a2c2-1f6d3d4842b9 tempest-CinderUnicodeTest-224747412 None] Lock "cinder-a5534812-1ebb-4810-b626-1ade0a260f0e-delete_volume" released by "delete_volume" :: held 2.401s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:06:19 devstack sudo[101587]: pam_unix(sudo:session): session closed for user root Sep 17 22:06:19 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e7886360-404d-4165-82ce-b4eaf93cbddc tempest-TestInstancesWithCinderVolumes-1282020637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_43ca8568-6628-4446-88f1-0d381b43ca3c_nab4s8k2devstack@QuobyteHD /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-91e47e7a-94a9-4dc9-baa2-582cab605241" returned: 0 in 3.069s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:06:19 devstack cinder-volume[85458]: DEBUG cinder.image.image_utils [None req-e7886360-404d-4165-82ce-b4eaf93cbddc tempest-TestInstancesWithCinderVolumes-1282020637 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_43ca8568-6628-4446-88f1-0d381b43ca3c_nab4s8k2devstack@QuobyteHD, size 112.00 MB, duration 3.07 sec, destination /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-91e47e7a-94a9-4dc9-baa2-582cab605241 {{(pid=85458) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 17 22:06:19 devstack cinder-volume[85458]: INFO cinder.image.image_utils [None req-e7886360-404d-4165-82ce-b4eaf93cbddc tempest-TestInstancesWithCinderVolumes-1282020637 None] Converted 112.00 MB image at 36.46 MB/s Sep 17 22:06:19 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e7886360-404d-4165-82ce-b4eaf93cbddc tempest-TestInstancesWithCinderVolumes-1282020637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-91e47e7a-94a9-4dc9-baa2-582cab605241 1G {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:06:19 devstack sudo[101608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-91e47e7a-94a9-4dc9-baa2-582cab605241 1G Sep 17 22:06:19 devstack sudo[101608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:06:19 devstack sudo[101608]: pam_unix(sudo:session): session closed for user root Sep 17 22:06:19 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e7886360-404d-4165-82ce-b4eaf93cbddc tempest-TestInstancesWithCinderVolumes-1282020637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-91e47e7a-94a9-4dc9-baa2-582cab605241 1G" returned: 0 in 0.582s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:06:19 devstack cinder-volume[85458]: DEBUG cinder.volume.volume_utils [None req-e7886360-404d-4165-82ce-b4eaf93cbddc tempest-TestInstancesWithCinderVolumes-1282020637 None] Downloaded image 43ca8568-6628-4446-88f1-0d381b43ca3c ((None, [{'url': 'file:///opt/stack/data/glance/images/43ca8568-6628-4446-88f1-0d381b43ca3c', 'metadata': {}}])) to volume 91e47e7a-94a9-4dc9-baa2-582cab605241 successfully. {{(pid=85458) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 17 22:06:19 devstack cinder-volume[85458]: DEBUG cinder.image.image_utils [None req-e7886360-404d-4165-82ce-b4eaf93cbddc tempest-TestInstancesWithCinderVolumes-1282020637 None] Temporary image 43ca8568-6628-4446-88f1-0d381b43ca3c for user 18182f2983b94be6a92e9cb0f86b042c is deleted. {{(pid=85458) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 17 22:06:19 devstack cinder-volume[85458]: DEBUG cinder.volume.volume_utils [None req-e7886360-404d-4165-82ce-b4eaf93cbddc tempest-TestInstancesWithCinderVolumes-1282020637 None] Marking volume 91e47e7a-94a9-4dc9-baa2-582cab605241 as bootable. {{(pid=85458) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 17 22:06:20 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7886360-404d-4165-82ce-b4eaf93cbddc tempest-TestInstancesWithCinderVolumes-1282020637 None] Copying metadata from image 43ca8568-6628-4446-88f1-0d381b43ca3c to 91e47e7a-94a9-4dc9-baa2-582cab605241. {{(pid=85458) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 17 22:06:20 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7886360-404d-4165-82ce-b4eaf93cbddc tempest-TestInstancesWithCinderVolumes-1282020637 None] Creating volume glance metadata for volume 91e47e7a-94a9-4dc9-baa2-582cab605241 backed by image 43ca8568-6628-4446-88f1-0d381b43ca3c with: {'image_id': '43ca8568-6628-4446-88f1-0d381b43ca3c', 'image_name': 'tempest-scenario-img--340494043', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=85458) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 17 22:06:20 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e7886360-404d-4165-82ce-b4eaf93cbddc tempest-TestInstancesWithCinderVolumes-1282020637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40bf8c45-239b-4762-a05a-44f9436d8395) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91e47e7a-94a9-4dc9-baa2-582cab605241', 'volume_size': 1, 'image_id': '43ca8568-6628-4446-88f1-0d381b43ca3c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/43ca8568-6628-4446-88f1-0d381b43ca3c', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--340494043', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fa590d10f7ac435382709a76287685d1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '43ca8568-6628-4446-88f1-0d381b43ca3c', 'created_at': datetime.datetime(2026, 9, 17, 20, 6, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 20, 6, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/43ca8568-6628-4446-88f1-0d381b43ca3c/file', 'properties': {}}, 'image_service': }' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:06:20 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e7886360-404d-4165-82ce-b4eaf93cbddc tempest-TestInstancesWithCinderVolumes-1282020637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63a5e0a1-e669-47ad-a122-f1e60ad53e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:06:20 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-e7886360-404d-4165-82ce-b4eaf93cbddc tempest-TestInstancesWithCinderVolumes-1282020637 None] Volume volume-91e47e7a-94a9-4dc9-baa2-582cab605241 (91e47e7a-94a9-4dc9-baa2-582cab605241): created successfully Sep 17 22:06:20 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e7886360-404d-4165-82ce-b4eaf93cbddc tempest-TestInstancesWithCinderVolumes-1282020637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63a5e0a1-e669-47ad-a122-f1e60ad53e71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:06:20 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e7886360-404d-4165-82ce-b4eaf93cbddc tempest-TestInstancesWithCinderVolumes-1282020637 None] Flow 'volume_create_manager' (3155ec8f-69c5-4331-85fb-28596420c162) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:06:20 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-e7886360-404d-4165-82ce-b4eaf93cbddc tempest-TestInstancesWithCinderVolumes-1282020637 None] Created volume successfully. Sep 17 22:06:26 devstack cinder-volume[85458]: DEBUG dbcounter [-] [85458] Writing DB stats cinder:UPDATE=78,cinder:SELECT=84,cinder:INSERT=27,cinder:DELETE=6 {{(pid=85458) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 22:06:26 devstack cinder-volume[85458]: DEBUG dbcounter [-] [85458] Writing DB stats cinder:SELECT=79,cinder:UPDATE=88,cinder:INSERT=33,cinder:DELETE=9 {{(pid=85458) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 22:06:26 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [req-9e6c5de4-6739-48c1-8b00-163cb4c740dd req-f034a36b-9a40-4dba-9a4f-a89c90aa9909 tempest-TestInstancesWithCinderVolumes-1282020637 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:06:26 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [req-9e6c5de4-6739-48c1-8b00-163cb4c740dd req-f034a36b-9a40-4dba-9a4f-a89c90aa9909 tempest-TestInstancesWithCinderVolumes-1282020637 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:06:26 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [req-9e6c5de4-6739-48c1-8b00-163cb4c740dd req-f034a36b-9a40-4dba-9a4f-a89c90aa9909 tempest-TestInstancesWithCinderVolumes-1282020637 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.049s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:06:26 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [req-9e6c5de4-6739-48c1-8b00-163cb4c740dd req-f034a36b-9a40-4dba-9a4f-a89c90aa9909 tempest-TestInstancesWithCinderVolumes-1282020637 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5', 'name': 'volume-91e47e7a-94a9-4dc9-baa2-582cab605241', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '41392ae1-5e85-408b-b5fc-32f568a6dd9d', 'enforce_multipath': True} {{(pid=85458) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 22:06:26 devstack cinder-volume[85458]: INFO cinder.volume.manager [req-9e6c5de4-6739-48c1-8b00-163cb4c740dd req-f034a36b-9a40-4dba-9a4f-a89c90aa9909 tempest-TestInstancesWithCinderVolumes-1282020637 None] attachment_update completed successfully. Sep 17 22:06:27 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-d998919c-db66-438c-9c46-c7047768dca4 tempest-ProjectReaderTests-78276122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 22:06:27 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-d998919c-db66-438c-9c46-c7047768dca4 tempest-ProjectReaderTests-78276122 None] Flow 'volume_create_manager' (e7b90ae2-b779-45e6-a97f-5b78e66481f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:06:27 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-d998919c-db66-438c-9c46-c7047768dca4 tempest-ProjectReaderTests-78276122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83551f81-f90b-4026-af48-6430f9904d62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:06:27 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-d998919c-db66-438c-9c46-c7047768dca4 tempest-ProjectReaderTests-78276122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83551f81-f90b-4026-af48-6430f9904d62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:06:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-273335664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78394534-ed29-4e35-a710-2fa18facd0bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af2138026d7e419195d512e4f2cd4ba9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:06:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:06:27Z,use_quota=True,user_id='313334b84b61486c9a2d765592e425e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:06:27 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-d998919c-db66-438c-9c46-c7047768dca4 tempest-ProjectReaderTests-78276122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e551f8d9-92c9-4f60-af07-82998bd292d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:06:27 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-d998919c-db66-438c-9c46-c7047768dca4 tempest-ProjectReaderTests-78276122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e551f8d9-92c9-4f60-af07-82998bd292d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:06:27 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-d998919c-db66-438c-9c46-c7047768dca4 tempest-ProjectReaderTests-78276122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4b9c786-6b3d-4797-81dd-275d29c7321e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:06:27 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-d998919c-db66-438c-9c46-c7047768dca4 tempest-ProjectReaderTests-78276122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4b9c786-6b3d-4797-81dd-275d29c7321e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78394534-ed29-4e35-a710-2fa18facd0bb', 'volume_name': 'volume-78394534-ed29-4e35-a710-2fa18facd0bb', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:06:27 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-d998919c-db66-438c-9c46-c7047768dca4 tempest-ProjectReaderTests-78276122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbd1841e-e214-4ede-8ec0-987a07d30ebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:06:27 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-d998919c-db66-438c-9c46-c7047768dca4 tempest-ProjectReaderTests-78276122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbd1841e-e214-4ede-8ec0-987a07d30ebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:06:27 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-d998919c-db66-438c-9c46-c7047768dca4 tempest-ProjectReaderTests-78276122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb314e28-0417-4573-8cb3-02b78cf08a13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:06:27 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-d998919c-db66-438c-9c46-c7047768dca4 tempest-ProjectReaderTests-78276122 None] Volume 78394534-ed29-4e35-a710-2fa18facd0bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78394534-ed29-4e35-a710-2fa18facd0bb', 'volume_size': 1} Sep 17 22:06:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-d998919c-db66-438c-9c46-c7047768dca4 tempest-ProjectReaderTests-78276122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:06:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-d998919c-db66-438c-9c46-c7047768dca4 tempest-ProjectReaderTests-78276122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:06:27 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-d998919c-db66-438c-9c46-c7047768dca4 tempest-ProjectReaderTests-78276122 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:06:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-273335664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78394534-ed29-4e35-a710-2fa18facd0bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af2138026d7e419195d512e4f2cd4ba9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:06:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:06:27Z,use_quota=True,user_id='313334b84b61486c9a2d765592e425e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 22:06:27 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-d998919c-db66-438c-9c46-c7047768dca4 tempest-ProjectReaderTests-78276122 None] Creating volume 78394534-ed29-4e35-a710-2fa18facd0bb {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 22:06:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-d998919c-db66-438c-9c46-c7047768dca4 tempest-ProjectReaderTests-78276122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:06:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-d998919c-db66-438c-9c46-c7047768dca4 tempest-ProjectReaderTests-78276122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:06:27 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-d998919c-db66-438c-9c46-c7047768dca4 tempest-ProjectReaderTests-78276122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:06:27 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-d998919c-db66-438c-9c46-c7047768dca4 tempest-ProjectReaderTests-78276122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:06:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-d998919c-db66-438c-9c46-c7047768dca4 tempest-ProjectReaderTests-78276122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:06:27 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-d998919c-db66-438c-9c46-c7047768dca4 tempest-ProjectReaderTests-78276122 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 22:06:27 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-d998919c-db66-438c-9c46-c7047768dca4 tempest-ProjectReaderTests-78276122 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 22:06:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-d998919c-db66-438c-9c46-c7047768dca4 tempest-ProjectReaderTests-78276122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-78394534-ed29-4e35-a710-2fa18facd0bb 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:06:27 devstack sudo[101663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-78394534-ed29-4e35-a710-2fa18facd0bb 1073741824 Sep 17 22:06:27 devstack sudo[101663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:06:27 devstack cinder-volume[85458]: DEBUG oslo_service.periodic_task [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85458) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 22:06:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:06:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:06:27 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:06:27 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:06:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:06:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:06:27 devstack sudo[101666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:06:27 devstack sudo[101666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:06:28 devstack sudo[101666]: pam_unix(sudo:session): session closed for user root Sep 17 22:06:28 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.394s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:06:28 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:06:28 devstack cinder-volume[85458]: DEBUG oslo_service.periodic_task [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Running periodic task VolumeManager._thread_info {{(pid=85458) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 22:06:28 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] thread count: 28 {{(pid=85458) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 22:06:28 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] thread info: [<_MainThread(MainThread, started 127546830999680)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85458) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 22:06:28 devstack sudo[101663]: pam_unix(sudo:session): session closed for user root Sep 17 22:06:28 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-d998919c-db66-438c-9c46-c7047768dca4 tempest-ProjectReaderTests-78276122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-78394534-ed29-4e35-a710-2fa18facd0bb 1073741824" returned: 0 in 0.576s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:06:28 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-d998919c-db66-438c-9c46-c7047768dca4 tempest-ProjectReaderTests-78276122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-78394534-ed29-4e35-a710-2fa18facd0bb {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:06:28 devstack sudo[101673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-78394534-ed29-4e35-a710-2fa18facd0bb Sep 17 22:06:28 devstack sudo[101673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:06:28 devstack sudo[101673]: pam_unix(sudo:session): session closed for user root Sep 17 22:06:28 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-d998919c-db66-438c-9c46-c7047768dca4 tempest-ProjectReaderTests-78276122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-78394534-ed29-4e35-a710-2fa18facd0bb" returned: 0 in 0.285s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:06:28 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-d998919c-db66-438c-9c46-c7047768dca4 tempest-ProjectReaderTests-78276122 None] <== create_volume: return (907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 22:06:28 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-d998919c-db66-438c-9c46-c7047768dca4 tempest-ProjectReaderTests-78276122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:06:28 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-d998919c-db66-438c-9c46-c7047768dca4 tempest-ProjectReaderTests-78276122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb314e28-0417-4573-8cb3-02b78cf08a13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78394534-ed29-4e35-a710-2fa18facd0bb', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:06:28 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-d998919c-db66-438c-9c46-c7047768dca4 tempest-ProjectReaderTests-78276122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dee1175-d49b-4991-88f6-40af18f7668f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:06:28 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-d998919c-db66-438c-9c46-c7047768dca4 tempest-ProjectReaderTests-78276122 None] Volume volume-78394534-ed29-4e35-a710-2fa18facd0bb (78394534-ed29-4e35-a710-2fa18facd0bb): created successfully Sep 17 22:06:28 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-d998919c-db66-438c-9c46-c7047768dca4 tempest-ProjectReaderTests-78276122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dee1175-d49b-4991-88f6-40af18f7668f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:06:28 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-d998919c-db66-438c-9c46-c7047768dca4 tempest-ProjectReaderTests-78276122 None] Flow 'volume_create_manager' (e7b90ae2-b779-45e6-a97f-5b78e66481f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:06:28 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-d998919c-db66-438c-9c46-c7047768dca4 tempest-ProjectReaderTests-78276122 None] Created volume successfully. Sep 17 22:06:30 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-aaee863e-5217-4006-bf40-62de76be88aa tempest-ProjectReaderTests-78276122 None] Acquiring lock "cinder-78394534-ed29-4e35-a710-2fa18facd0bb-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:06:30 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-aaee863e-5217-4006-bf40-62de76be88aa tempest-ProjectReaderTests-78276122 None] Lock "cinder-78394534-ed29-4e35-a710-2fa18facd0bb-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:06:30 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-aaee863e-5217-4006-bf40-62de76be88aa tempest-ProjectReaderTests-78276122 None] Acquiring lock "cinder-quobyte-78394534-ed29-4e35-a710-2fa18facd0bb" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:06:30 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-aaee863e-5217-4006-bf40-62de76be88aa tempest-ProjectReaderTests-78276122 None] Lock "cinder-quobyte-78394534-ed29-4e35-a710-2fa18facd0bb" acquired by "delete_volume" :: waited 0.026s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:06:30 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[136f2afc-77e2-4284-9c40-9bfba0eb5097]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:06:30 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-aaee863e-5217-4006-bf40-62de76be88aa tempest-ProjectReaderTests-78276122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-78394534-ed29-4e35-a710-2fa18facd0bb {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:06:30 devstack sudo[101738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-78394534-ed29-4e35-a710-2fa18facd0bb Sep 17 22:06:30 devstack sudo[101738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:06:31 devstack sudo[101738]: pam_unix(sudo:session): session closed for user root Sep 17 22:06:31 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-aaee863e-5217-4006-bf40-62de76be88aa tempest-ProjectReaderTests-78276122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-78394534-ed29-4e35-a710-2fa18facd0bb" returned: 0 in 0.562s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:06:31 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-aaee863e-5217-4006-bf40-62de76be88aa tempest-ProjectReaderTests-78276122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-78394534-ed29-4e35-a710-2fa18facd0bb {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:06:31 devstack sudo[101757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-78394534-ed29-4e35-a710-2fa18facd0bb Sep 17 22:06:31 devstack sudo[101757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:06:31 devstack sudo[101757]: pam_unix(sudo:session): session closed for user root Sep 17 22:06:31 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-aaee863e-5217-4006-bf40-62de76be88aa tempest-ProjectReaderTests-78276122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-78394534-ed29-4e35-a710-2fa18facd0bb" returned: 0 in 0.343s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:06:31 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-aaee863e-5217-4006-bf40-62de76be88aa tempest-ProjectReaderTests-78276122 None] Lock "cinder-quobyte-78394534-ed29-4e35-a710-2fa18facd0bb" released by "delete_volume" :: held 1.010s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:06:31 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-aaee863e-5217-4006-bf40-62de76be88aa tempest-ProjectReaderTests-78276122 None] Created reservations ['2a3802a5-899a-4085-b4ef-53cb98b1d58c', '5e08162b-ba85-4538-af81-e6749cdaef32', '6febb4db-ad5c-4bee-9e87-ffe44dd4d649', 'e9aff1a5-5c10-42a7-bf5f-f2198b4fb3ee'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:06:31 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-aaee863e-5217-4006-bf40-62de76be88aa tempest-ProjectReaderTests-78276122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:06:31 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-aaee863e-5217-4006-bf40-62de76be88aa tempest-ProjectReaderTests-78276122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:06:31 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-aaee863e-5217-4006-bf40-62de76be88aa tempest-ProjectReaderTests-78276122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:06:31 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-aaee863e-5217-4006-bf40-62de76be88aa tempest-ProjectReaderTests-78276122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:06:31 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-aaee863e-5217-4006-bf40-62de76be88aa tempest-ProjectReaderTests-78276122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:06:31 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-aaee863e-5217-4006-bf40-62de76be88aa tempest-ProjectReaderTests-78276122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:06:31 devstack sudo[101764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:06:31 devstack sudo[101764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:06:31 devstack sudo[101764]: pam_unix(sudo:session): session closed for user root Sep 17 22:06:31 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-aaee863e-5217-4006-bf40-62de76be88aa tempest-ProjectReaderTests-78276122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.273s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:06:31 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-aaee863e-5217-4006-bf40-62de76be88aa tempest-ProjectReaderTests-78276122 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:06:31 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-aaee863e-5217-4006-bf40-62de76be88aa tempest-ProjectReaderTests-78276122 None] Deleted volume successfully. Sep 17 22:06:31 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-aaee863e-5217-4006-bf40-62de76be88aa tempest-ProjectReaderTests-78276122 None] Lock "cinder-78394534-ed29-4e35-a710-2fa18facd0bb-delete_volume" released by "delete_volume" :: held 1.656s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:06:33 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb5724d1-0a7c-4308-8000-8e3bca150d9d tempest-ProjectReaderTests-78276122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 22:06:33 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-bb5724d1-0a7c-4308-8000-8e3bca150d9d tempest-ProjectReaderTests-78276122 None] Flow 'volume_create_manager' (5095195d-dc6c-4ca3-b7b9-f8b5aae60151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:06:33 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-bb5724d1-0a7c-4308-8000-8e3bca150d9d tempest-ProjectReaderTests-78276122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c70b0607-72cb-4bc7-a372-58ff5231d3f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:06:33 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-bb5724d1-0a7c-4308-8000-8e3bca150d9d tempest-ProjectReaderTests-78276122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c70b0607-72cb-4bc7-a372-58ff5231d3f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:06:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2130294012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf1bfb51-04c6-498e-b362-a8360744149d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af2138026d7e419195d512e4f2cd4ba9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:06:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:06:33Z,use_quota=True,user_id='313334b84b61486c9a2d765592e425e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:06:33 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-bb5724d1-0a7c-4308-8000-8e3bca150d9d tempest-ProjectReaderTests-78276122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecfaf2a0-ee28-4c9c-a13d-55eb2dac014b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:06:33 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-bb5724d1-0a7c-4308-8000-8e3bca150d9d tempest-ProjectReaderTests-78276122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecfaf2a0-ee28-4c9c-a13d-55eb2dac014b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:06:33 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-bb5724d1-0a7c-4308-8000-8e3bca150d9d tempest-ProjectReaderTests-78276122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a766f0c-cf81-426d-a82e-59a09fbf775c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:06:33 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-bb5724d1-0a7c-4308-8000-8e3bca150d9d tempest-ProjectReaderTests-78276122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a766f0c-cf81-426d-a82e-59a09fbf775c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf1bfb51-04c6-498e-b362-a8360744149d', 'volume_name': 'volume-bf1bfb51-04c6-498e-b362-a8360744149d', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:06:33 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-bb5724d1-0a7c-4308-8000-8e3bca150d9d tempest-ProjectReaderTests-78276122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3f7b204-03cd-415c-b4ce-82c0d1f9a108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:06:33 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-bb5724d1-0a7c-4308-8000-8e3bca150d9d tempest-ProjectReaderTests-78276122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3f7b204-03cd-415c-b4ce-82c0d1f9a108) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:06:33 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-bb5724d1-0a7c-4308-8000-8e3bca150d9d tempest-ProjectReaderTests-78276122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1335425-2421-4d7f-8443-fc5d66b9778a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:06:33 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-bb5724d1-0a7c-4308-8000-8e3bca150d9d tempest-ProjectReaderTests-78276122 None] Volume bf1bfb51-04c6-498e-b362-a8360744149d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf1bfb51-04c6-498e-b362-a8360744149d', 'volume_size': 1} Sep 17 22:06:33 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-bb5724d1-0a7c-4308-8000-8e3bca150d9d tempest-ProjectReaderTests-78276122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:06:33 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-bb5724d1-0a7c-4308-8000-8e3bca150d9d tempest-ProjectReaderTests-78276122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:06:33 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-bb5724d1-0a7c-4308-8000-8e3bca150d9d tempest-ProjectReaderTests-78276122 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:06:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2130294012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf1bfb51-04c6-498e-b362-a8360744149d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af2138026d7e419195d512e4f2cd4ba9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:06:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:06:33Z,use_quota=True,user_id='313334b84b61486c9a2d765592e425e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 22:06:33 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-bb5724d1-0a7c-4308-8000-8e3bca150d9d tempest-ProjectReaderTests-78276122 None] Creating volume bf1bfb51-04c6-498e-b362-a8360744149d {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 22:06:33 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-bb5724d1-0a7c-4308-8000-8e3bca150d9d tempest-ProjectReaderTests-78276122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:06:33 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-bb5724d1-0a7c-4308-8000-8e3bca150d9d tempest-ProjectReaderTests-78276122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:06:33 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-bb5724d1-0a7c-4308-8000-8e3bca150d9d tempest-ProjectReaderTests-78276122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:06:33 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-bb5724d1-0a7c-4308-8000-8e3bca150d9d tempest-ProjectReaderTests-78276122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:06:33 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-bb5724d1-0a7c-4308-8000-8e3bca150d9d tempest-ProjectReaderTests-78276122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:06:33 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-bb5724d1-0a7c-4308-8000-8e3bca150d9d tempest-ProjectReaderTests-78276122 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 22:06:33 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-bb5724d1-0a7c-4308-8000-8e3bca150d9d tempest-ProjectReaderTests-78276122 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 22:06:33 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-bb5724d1-0a7c-4308-8000-8e3bca150d9d tempest-ProjectReaderTests-78276122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-bf1bfb51-04c6-498e-b362-a8360744149d 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:06:33 devstack sudo[101804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-bf1bfb51-04c6-498e-b362-a8360744149d 1073741824 Sep 17 22:06:33 devstack sudo[101804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:06:34 devstack sudo[101804]: pam_unix(sudo:session): session closed for user root Sep 17 22:06:34 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-bb5724d1-0a7c-4308-8000-8e3bca150d9d tempest-ProjectReaderTests-78276122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-bf1bfb51-04c6-498e-b362-a8360744149d 1073741824" returned: 0 in 0.595s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:06:34 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-bb5724d1-0a7c-4308-8000-8e3bca150d9d tempest-ProjectReaderTests-78276122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-bf1bfb51-04c6-498e-b362-a8360744149d {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:06:34 devstack sudo[101810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-bf1bfb51-04c6-498e-b362-a8360744149d Sep 17 22:06:34 devstack sudo[101810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:06:34 devstack sudo[101810]: pam_unix(sudo:session): session closed for user root Sep 17 22:06:34 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-bb5724d1-0a7c-4308-8000-8e3bca150d9d tempest-ProjectReaderTests-78276122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-bf1bfb51-04c6-498e-b362-a8360744149d" returned: 0 in 0.309s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:06:34 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-bb5724d1-0a7c-4308-8000-8e3bca150d9d tempest-ProjectReaderTests-78276122 None] <== create_volume: return (969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 22:06:34 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-bb5724d1-0a7c-4308-8000-8e3bca150d9d tempest-ProjectReaderTests-78276122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.972s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:06:34 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-bb5724d1-0a7c-4308-8000-8e3bca150d9d tempest-ProjectReaderTests-78276122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1335425-2421-4d7f-8443-fc5d66b9778a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf1bfb51-04c6-498e-b362-a8360744149d', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:06:34 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-bb5724d1-0a7c-4308-8000-8e3bca150d9d tempest-ProjectReaderTests-78276122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (641211b0-37ea-47ed-98f9-6357bf4ea081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:06:34 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-bb5724d1-0a7c-4308-8000-8e3bca150d9d tempest-ProjectReaderTests-78276122 None] Volume volume-bf1bfb51-04c6-498e-b362-a8360744149d (bf1bfb51-04c6-498e-b362-a8360744149d): created successfully Sep 17 22:06:34 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-bb5724d1-0a7c-4308-8000-8e3bca150d9d tempest-ProjectReaderTests-78276122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (641211b0-37ea-47ed-98f9-6357bf4ea081) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:06:34 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-bb5724d1-0a7c-4308-8000-8e3bca150d9d tempest-ProjectReaderTests-78276122 None] Flow 'volume_create_manager' (5095195d-dc6c-4ca3-b7b9-f8b5aae60151) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:06:34 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-bb5724d1-0a7c-4308-8000-8e3bca150d9d tempest-ProjectReaderTests-78276122 None] Created volume successfully. Sep 17 22:06:35 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-16ec4fbf-84f4-44f6-b0cb-d50e4155fd8f tempest-ProjectReaderTests-78276122 None] Acquiring lock "cinder-bf1bfb51-04c6-498e-b362-a8360744149d-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:06:35 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-16ec4fbf-84f4-44f6-b0cb-d50e4155fd8f tempest-ProjectReaderTests-78276122 None] Lock "cinder-bf1bfb51-04c6-498e-b362-a8360744149d-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:06:35 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-16ec4fbf-84f4-44f6-b0cb-d50e4155fd8f tempest-ProjectReaderTests-78276122 None] Acquiring lock "cinder-quobyte-bf1bfb51-04c6-498e-b362-a8360744149d" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:06:35 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-16ec4fbf-84f4-44f6-b0cb-d50e4155fd8f tempest-ProjectReaderTests-78276122 None] Lock "cinder-quobyte-bf1bfb51-04c6-498e-b362-a8360744149d" acquired by "delete_volume" :: waited 0.021s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:06:35 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[400a1aba-0d0d-4a0f-a468-393236a29f89]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:06:35 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-16ec4fbf-84f4-44f6-b0cb-d50e4155fd8f tempest-ProjectReaderTests-78276122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-bf1bfb51-04c6-498e-b362-a8360744149d {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:06:36 devstack sudo[101815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-bf1bfb51-04c6-498e-b362-a8360744149d Sep 17 22:06:36 devstack sudo[101815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:06:36 devstack sudo[101815]: pam_unix(sudo:session): session closed for user root Sep 17 22:06:36 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-16ec4fbf-84f4-44f6-b0cb-d50e4155fd8f tempest-ProjectReaderTests-78276122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-bf1bfb51-04c6-498e-b362-a8360744149d" returned: 0 in 0.630s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:06:36 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-16ec4fbf-84f4-44f6-b0cb-d50e4155fd8f tempest-ProjectReaderTests-78276122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-bf1bfb51-04c6-498e-b362-a8360744149d {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:06:36 devstack sudo[101823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-bf1bfb51-04c6-498e-b362-a8360744149d Sep 17 22:06:36 devstack sudo[101823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:06:36 devstack sudo[101823]: pam_unix(sudo:session): session closed for user root Sep 17 22:06:36 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-16ec4fbf-84f4-44f6-b0cb-d50e4155fd8f tempest-ProjectReaderTests-78276122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-bf1bfb51-04c6-498e-b362-a8360744149d" returned: 0 in 0.350s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:06:36 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-16ec4fbf-84f4-44f6-b0cb-d50e4155fd8f tempest-ProjectReaderTests-78276122 None] Lock "cinder-quobyte-bf1bfb51-04c6-498e-b362-a8360744149d" released by "delete_volume" :: held 1.058s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:06:37 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-16ec4fbf-84f4-44f6-b0cb-d50e4155fd8f tempest-ProjectReaderTests-78276122 None] Created reservations ['ae715814-dbd4-48f7-a978-a6b945b708d1', 'fed56f38-31c4-44fb-b60d-d79af668e247', '282fbaee-85dc-484a-9564-099c6ba72b26', '0c305000-b8ed-44a2-9c1f-d73e6aa48300'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:06:37 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-16ec4fbf-84f4-44f6-b0cb-d50e4155fd8f tempest-ProjectReaderTests-78276122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:06:37 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-16ec4fbf-84f4-44f6-b0cb-d50e4155fd8f tempest-ProjectReaderTests-78276122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:06:37 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-16ec4fbf-84f4-44f6-b0cb-d50e4155fd8f tempest-ProjectReaderTests-78276122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:06:37 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-16ec4fbf-84f4-44f6-b0cb-d50e4155fd8f tempest-ProjectReaderTests-78276122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:06:37 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-16ec4fbf-84f4-44f6-b0cb-d50e4155fd8f tempest-ProjectReaderTests-78276122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:06:37 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-16ec4fbf-84f4-44f6-b0cb-d50e4155fd8f tempest-ProjectReaderTests-78276122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:06:37 devstack sudo[101826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:06:37 devstack sudo[101826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:06:37 devstack sudo[101826]: pam_unix(sudo:session): session closed for user root Sep 17 22:06:37 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-16ec4fbf-84f4-44f6-b0cb-d50e4155fd8f tempest-ProjectReaderTests-78276122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.371s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:06:37 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-16ec4fbf-84f4-44f6-b0cb-d50e4155fd8f tempest-ProjectReaderTests-78276122 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:06:37 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-16ec4fbf-84f4-44f6-b0cb-d50e4155fd8f tempest-ProjectReaderTests-78276122 None] Deleted volume successfully. Sep 17 22:06:37 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-16ec4fbf-84f4-44f6-b0cb-d50e4155fd8f tempest-ProjectReaderTests-78276122 None] Lock "cinder-bf1bfb51-04c6-498e-b362-a8360744149d-delete_volume" released by "delete_volume" :: held 1.747s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:06:46 devstack cinder-volume[85458]: INFO cinder.volume.manager [req-a335a7c3-478a-4b7f-b287-fc7321cd24af req-c11fa2ed-83b4-49c0-a078-79f023c1dab4 tempest-TestShelveInstance-763943664 None] Terminate volume connection completed successfully. Sep 17 22:06:46 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [req-a335a7c3-478a-4b7f-b287-fc7321cd24af req-c11fa2ed-83b4-49c0-a078-79f023c1dab4 tempest-TestShelveInstance-763943664 None] Deleting attachment dee2b0dc-bec0-455a-ba32-243a39ffbaf6. {{(pid=85458) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 22:06:47 devstack cinder-volume[85458]: DEBUG dbcounter [-] [85458] Writing DB stats cinder:SELECT=16,cinder:UPDATE=27,cinder:DELETE=3,cinder:INSERT=4 {{(pid=85458) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 22:06:48 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [req-b6009d13-1837-4caa-b4ec-5f44b28023e3 req-532c28d9-a60c-41a0-940f-ff72efeff157 tempest-TestShelveInstance-763943664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:06:48 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [req-b6009d13-1837-4caa-b4ec-5f44b28023e3 req-532c28d9-a60c-41a0-940f-ff72efeff157 tempest-TestShelveInstance-763943664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:06:48 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [req-b6009d13-1837-4caa-b4ec-5f44b28023e3 req-532c28d9-a60c-41a0-940f-ff72efeff157 tempest-TestShelveInstance-763943664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:06:48 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [req-b6009d13-1837-4caa-b4ec-5f44b28023e3 req-532c28d9-a60c-41a0-940f-ff72efeff157 tempest-TestShelveInstance-763943664 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5', 'name': 'volume-f5303dab-81aa-4558-b4a2-13fead2fa414', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a652041b-fa7f-4b4f-be2e-658ce09eaf0a', 'enforce_multipath': True} {{(pid=85458) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 22:06:49 devstack cinder-volume[85458]: INFO cinder.volume.manager [req-b6009d13-1837-4caa-b4ec-5f44b28023e3 req-532c28d9-a60c-41a0-940f-ff72efeff157 tempest-TestShelveInstance-763943664 None] attachment_update completed successfully. Sep 17 22:06:59 devstack cinder-volume[85458]: DEBUG dbcounter [-] [85458] Writing DB stats cinder:SELECT=30,cinder:UPDATE=22,cinder:INSERT=6,cinder:DELETE=1 {{(pid=85458) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 22:06:59 devstack cinder-volume[85458]: DEBUG dbcounter [-] [85458] Writing DB stats cinder:SELECT=9,cinder:UPDATE=2 {{(pid=85458) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 22:07:00 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [req-f2fc0994-676d-44d0-aba4-daa637c13c4f req-a3e817ef-21b8-48c8-8c7e-f66ee1beb2a4 tempest-TestInstancesWithCinderVolumes-1282020637 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:07:00 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [req-f2fc0994-676d-44d0-aba4-daa637c13c4f req-a3e817ef-21b8-48c8-8c7e-f66ee1beb2a4 tempest-TestInstancesWithCinderVolumes-1282020637 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:07:00 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [req-f2fc0994-676d-44d0-aba4-daa637c13c4f req-a3e817ef-21b8-48c8-8c7e-f66ee1beb2a4 tempest-TestInstancesWithCinderVolumes-1282020637 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:07:00 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [req-f2fc0994-676d-44d0-aba4-daa637c13c4f req-a3e817ef-21b8-48c8-8c7e-f66ee1beb2a4 tempest-TestInstancesWithCinderVolumes-1282020637 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5', 'name': 'volume-a34c6cfc-733d-49d3-ad12-9bf9e5b64683', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c690d4e4-0d75-4a63-a0ec-1d8a6157fc5a', 'enforce_multipath': True} {{(pid=85458) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 22:07:00 devstack cinder-volume[85458]: INFO cinder.volume.manager [req-f2fc0994-676d-44d0-aba4-daa637c13c4f req-a3e817ef-21b8-48c8-8c7e-f66ee1beb2a4 tempest-TestInstancesWithCinderVolumes-1282020637 None] attachment_update completed successfully. Sep 17 22:07:02 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [req-4960c94d-a82e-4bde-9bff-750c70931e4a req-45e33d2a-4c41-4c70-9935-dd3c5ee1ec01 tempest-TestInstancesWithCinderVolumes-1282020637 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:07:02 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [req-4960c94d-a82e-4bde-9bff-750c70931e4a req-45e33d2a-4c41-4c70-9935-dd3c5ee1ec01 tempest-TestInstancesWithCinderVolumes-1282020637 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:07:02 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [req-4960c94d-a82e-4bde-9bff-750c70931e4a req-45e33d2a-4c41-4c70-9935-dd3c5ee1ec01 tempest-TestInstancesWithCinderVolumes-1282020637 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:07:02 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [req-4960c94d-a82e-4bde-9bff-750c70931e4a req-45e33d2a-4c41-4c70-9935-dd3c5ee1ec01 tempest-TestInstancesWithCinderVolumes-1282020637 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5', 'name': 'volume-c214cc59-ff16-4a9e-8f62-7a1b97190f8a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3b0a94af-ee33-49bc-8dc7-137de963f47f', 'enforce_multipath': True} {{(pid=85458) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 22:07:02 devstack cinder-volume[85458]: INFO cinder.volume.manager [req-4960c94d-a82e-4bde-9bff-750c70931e4a req-45e33d2a-4c41-4c70-9935-dd3c5ee1ec01 tempest-TestInstancesWithCinderVolumes-1282020637 None] attachment_update completed successfully. Sep 17 22:07:07 devstack cinder-volume[85458]: INFO cinder.volume.manager [req-ab8d401b-7358-4037-afd9-d14dbe1d8a98 req-1c2eba8f-ca35-4a43-9ce4-e2f25ddecd31 tempest-TestInstancesWithCinderVolumes-1282020637 None] Terminate volume connection completed successfully. Sep 17 22:07:07 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [req-ab8d401b-7358-4037-afd9-d14dbe1d8a98 req-1c2eba8f-ca35-4a43-9ce4-e2f25ddecd31 tempest-TestInstancesWithCinderVolumes-1282020637 None] Deleting attachment c690d4e4-0d75-4a63-a0ec-1d8a6157fc5a. {{(pid=85458) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 22:07:08 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-a4f56414-fe7d-47fa-a013-f8c2252fec9d tempest-TestInstancesWithCinderVolumes-1282020637 None] Acquiring lock "cinder-a34c6cfc-733d-49d3-ad12-9bf9e5b64683-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:07:08 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-a4f56414-fe7d-47fa-a013-f8c2252fec9d tempest-TestInstancesWithCinderVolumes-1282020637 None] Lock "cinder-a34c6cfc-733d-49d3-ad12-9bf9e5b64683-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:07:08 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-a4f56414-fe7d-47fa-a013-f8c2252fec9d tempest-TestInstancesWithCinderVolumes-1282020637 None] Acquiring lock "cinder-quobyte-a34c6cfc-733d-49d3-ad12-9bf9e5b64683" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:07:08 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-a4f56414-fe7d-47fa-a013-f8c2252fec9d tempest-TestInstancesWithCinderVolumes-1282020637 None] Lock "cinder-quobyte-a34c6cfc-733d-49d3-ad12-9bf9e5b64683" acquired by "delete_volume" :: waited 0.015s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:07:08 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[9895106f-22ef-4de3-acd3-83d856bc092c]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:07:08 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a4f56414-fe7d-47fa-a013-f8c2252fec9d tempest-TestInstancesWithCinderVolumes-1282020637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a34c6cfc-733d-49d3-ad12-9bf9e5b64683 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:07:08 devstack sudo[102023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a34c6cfc-733d-49d3-ad12-9bf9e5b64683 Sep 17 22:07:08 devstack sudo[102023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:07:08 devstack sudo[102023]: pam_unix(sudo:session): session closed for user root Sep 17 22:07:08 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a4f56414-fe7d-47fa-a013-f8c2252fec9d tempest-TestInstancesWithCinderVolumes-1282020637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a34c6cfc-733d-49d3-ad12-9bf9e5b64683" returned: 0 in 0.386s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:07:08 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a4f56414-fe7d-47fa-a013-f8c2252fec9d tempest-TestInstancesWithCinderVolumes-1282020637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a34c6cfc-733d-49d3-ad12-9bf9e5b64683 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:07:08 devstack sudo[102028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a34c6cfc-733d-49d3-ad12-9bf9e5b64683 Sep 17 22:07:08 devstack sudo[102028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:07:08 devstack sudo[102028]: pam_unix(sudo:session): session closed for user root Sep 17 22:07:08 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a4f56414-fe7d-47fa-a013-f8c2252fec9d tempest-TestInstancesWithCinderVolumes-1282020637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a34c6cfc-733d-49d3-ad12-9bf9e5b64683" returned: 0 in 0.274s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:07:08 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-a4f56414-fe7d-47fa-a013-f8c2252fec9d tempest-TestInstancesWithCinderVolumes-1282020637 None] Lock "cinder-quobyte-a34c6cfc-733d-49d3-ad12-9bf9e5b64683" released by "delete_volume" :: held 0.701s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:07:08 devstack cinder-volume[85458]: WARNING cinder.quota [None req-a4f56414-fe7d-47fa-a013-f8c2252fec9d tempest-TestInstancesWithCinderVolumes-1282020637 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2040995932-1652609077 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2040995932-1652609077, it is now deprecated. Please use the default quota class for default quota. Sep 17 22:07:08 devstack cinder-volume[85458]: WARNING cinder.quota [None req-a4f56414-fe7d-47fa-a013-f8c2252fec9d tempest-TestInstancesWithCinderVolumes-1282020637 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2040995932-1652609077 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2040995932-1652609077, it is now deprecated. Please use the default quota class for default quota. Sep 17 22:07:08 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-a4f56414-fe7d-47fa-a013-f8c2252fec9d tempest-TestInstancesWithCinderVolumes-1282020637 None] Created reservations ['22b37a40-a278-4534-ba71-2b6e90d325ea', 'ac1d15dc-1a88-4d2e-9fc9-e5638a257b27', '2283dc0a-6420-4453-b155-1092b681bed8', 'f43c9095-e3f5-428d-923f-8e93e43c4985'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:07:08 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-a4f56414-fe7d-47fa-a013-f8c2252fec9d tempest-TestInstancesWithCinderVolumes-1282020637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:07:08 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-a4f56414-fe7d-47fa-a013-f8c2252fec9d tempest-TestInstancesWithCinderVolumes-1282020637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:07:08 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-a4f56414-fe7d-47fa-a013-f8c2252fec9d tempest-TestInstancesWithCinderVolumes-1282020637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:07:08 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-a4f56414-fe7d-47fa-a013-f8c2252fec9d tempest-TestInstancesWithCinderVolumes-1282020637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:07:08 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-a4f56414-fe7d-47fa-a013-f8c2252fec9d tempest-TestInstancesWithCinderVolumes-1282020637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:07:08 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a4f56414-fe7d-47fa-a013-f8c2252fec9d tempest-TestInstancesWithCinderVolumes-1282020637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:07:08 devstack sudo[102031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:07:08 devstack sudo[102031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:07:09 devstack sudo[102031]: pam_unix(sudo:session): session closed for user root Sep 17 22:07:09 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a4f56414-fe7d-47fa-a013-f8c2252fec9d tempest-TestInstancesWithCinderVolumes-1282020637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.253s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:07:09 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-a4f56414-fe7d-47fa-a013-f8c2252fec9d tempest-TestInstancesWithCinderVolumes-1282020637 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:07:09 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-a4f56414-fe7d-47fa-a013-f8c2252fec9d tempest-TestInstancesWithCinderVolumes-1282020637 None] Deleted volume successfully. Sep 17 22:07:09 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-a4f56414-fe7d-47fa-a013-f8c2252fec9d tempest-TestInstancesWithCinderVolumes-1282020637 None] Lock "cinder-a34c6cfc-733d-49d3-ad12-9bf9e5b64683-delete_volume" released by "delete_volume" :: held 1.157s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:07:11 devstack cinder-volume[85458]: INFO cinder.volume.manager [req-f54d1f42-42b9-4156-a657-a9770829fa1d req-f73c5f12-f6cf-4881-8318-2b006ea8ea80 tempest-TestInstancesWithCinderVolumes-1282020637 None] Terminate volume connection completed successfully. Sep 17 22:07:11 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [req-f54d1f42-42b9-4156-a657-a9770829fa1d req-f73c5f12-f6cf-4881-8318-2b006ea8ea80 tempest-TestInstancesWithCinderVolumes-1282020637 None] Deleting attachment 3b0a94af-ee33-49bc-8dc7-137de963f47f. {{(pid=85458) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 22:07:12 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-1bd539db-c814-4c36-bd0d-207896e43cea tempest-TestInstancesWithCinderVolumes-1282020637 None] Acquiring lock "cinder-c214cc59-ff16-4a9e-8f62-7a1b97190f8a-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:07:12 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-1bd539db-c814-4c36-bd0d-207896e43cea tempest-TestInstancesWithCinderVolumes-1282020637 None] Lock "cinder-c214cc59-ff16-4a9e-8f62-7a1b97190f8a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:07:12 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-1bd539db-c814-4c36-bd0d-207896e43cea tempest-TestInstancesWithCinderVolumes-1282020637 None] Acquiring lock "cinder-quobyte-c214cc59-ff16-4a9e-8f62-7a1b97190f8a" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:07:12 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-1bd539db-c814-4c36-bd0d-207896e43cea tempest-TestInstancesWithCinderVolumes-1282020637 None] Lock "cinder-quobyte-c214cc59-ff16-4a9e-8f62-7a1b97190f8a" acquired by "delete_volume" :: waited 0.016s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:07:12 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[763ec1c9-2f6b-4296-bbb3-2b2fb5aba451]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:07:12 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-1bd539db-c814-4c36-bd0d-207896e43cea tempest-TestInstancesWithCinderVolumes-1282020637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c214cc59-ff16-4a9e-8f62-7a1b97190f8a {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:07:12 devstack sudo[102058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c214cc59-ff16-4a9e-8f62-7a1b97190f8a Sep 17 22:07:12 devstack sudo[102058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:07:12 devstack sudo[102058]: pam_unix(sudo:session): session closed for user root Sep 17 22:07:12 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-1bd539db-c814-4c36-bd0d-207896e43cea tempest-TestInstancesWithCinderVolumes-1282020637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c214cc59-ff16-4a9e-8f62-7a1b97190f8a" returned: 0 in 0.386s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:07:12 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-1bd539db-c814-4c36-bd0d-207896e43cea tempest-TestInstancesWithCinderVolumes-1282020637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c214cc59-ff16-4a9e-8f62-7a1b97190f8a {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:07:12 devstack sudo[102063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c214cc59-ff16-4a9e-8f62-7a1b97190f8a Sep 17 22:07:12 devstack sudo[102063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:07:12 devstack sudo[102063]: pam_unix(sudo:session): session closed for user root Sep 17 22:07:12 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-1bd539db-c814-4c36-bd0d-207896e43cea tempest-TestInstancesWithCinderVolumes-1282020637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c214cc59-ff16-4a9e-8f62-7a1b97190f8a" returned: 0 in 0.270s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:07:12 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-1bd539db-c814-4c36-bd0d-207896e43cea tempest-TestInstancesWithCinderVolumes-1282020637 None] Lock "cinder-quobyte-c214cc59-ff16-4a9e-8f62-7a1b97190f8a" released by "delete_volume" :: held 0.710s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:07:12 devstack cinder-volume[85458]: WARNING cinder.quota [None req-1bd539db-c814-4c36-bd0d-207896e43cea tempest-TestInstancesWithCinderVolumes-1282020637 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2135596305-2000928310 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2135596305-2000928310, it is now deprecated. Please use the default quota class for default quota. Sep 17 22:07:12 devstack cinder-volume[85458]: WARNING cinder.quota [None req-1bd539db-c814-4c36-bd0d-207896e43cea tempest-TestInstancesWithCinderVolumes-1282020637 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2135596305-2000928310 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2135596305-2000928310, it is now deprecated. Please use the default quota class for default quota. Sep 17 22:07:12 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-1bd539db-c814-4c36-bd0d-207896e43cea tempest-TestInstancesWithCinderVolumes-1282020637 None] Created reservations ['c3c1d158-2276-4bd7-9100-222e259f3524', '4a1af8c9-61b1-4e06-8238-270728bdde39', '7593a639-954b-4565-b037-89e1ab9864c1', 'a3dc4059-084c-4fbf-b939-332b6efcebe9'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:07:12 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-1bd539db-c814-4c36-bd0d-207896e43cea tempest-TestInstancesWithCinderVolumes-1282020637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:07:12 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-1bd539db-c814-4c36-bd0d-207896e43cea tempest-TestInstancesWithCinderVolumes-1282020637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:07:12 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-1bd539db-c814-4c36-bd0d-207896e43cea tempest-TestInstancesWithCinderVolumes-1282020637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:07:12 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-1bd539db-c814-4c36-bd0d-207896e43cea tempest-TestInstancesWithCinderVolumes-1282020637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:07:12 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-1bd539db-c814-4c36-bd0d-207896e43cea tempest-TestInstancesWithCinderVolumes-1282020637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:07:12 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-1bd539db-c814-4c36-bd0d-207896e43cea tempest-TestInstancesWithCinderVolumes-1282020637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:07:13 devstack sudo[102067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:07:13 devstack sudo[102067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:07:13 devstack sudo[102067]: pam_unix(sudo:session): session closed for user root Sep 17 22:07:13 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-1bd539db-c814-4c36-bd0d-207896e43cea tempest-TestInstancesWithCinderVolumes-1282020637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.266s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:07:13 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-1bd539db-c814-4c36-bd0d-207896e43cea tempest-TestInstancesWithCinderVolumes-1282020637 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:07:13 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-1bd539db-c814-4c36-bd0d-207896e43cea tempest-TestInstancesWithCinderVolumes-1282020637 None] Deleted volume successfully. Sep 17 22:07:13 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-1bd539db-c814-4c36-bd0d-207896e43cea tempest-TestInstancesWithCinderVolumes-1282020637 None] Lock "cinder-c214cc59-ff16-4a9e-8f62-7a1b97190f8a-delete_volume" released by "delete_volume" :: held 1.212s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:07:16 devstack cinder-volume[85458]: INFO cinder.volume.manager [req-92d8a972-d7cd-4b7c-9ad3-7ad5b991f6b6 req-ec344820-9f45-4595-9718-a0906da5a0ab tempest-TestInstancesWithCinderVolumes-1282020637 None] Terminate volume connection completed successfully. Sep 17 22:07:16 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [req-92d8a972-d7cd-4b7c-9ad3-7ad5b991f6b6 req-ec344820-9f45-4595-9718-a0906da5a0ab tempest-TestInstancesWithCinderVolumes-1282020637 None] Deleting attachment 41392ae1-5e85-408b-b5fc-32f568a6dd9d. {{(pid=85458) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 22:07:17 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-c2531079-24fe-45b0-be9b-62b7d23a4055 tempest-TestInstancesWithCinderVolumes-1282020637 None] Acquiring lock "cinder-91e47e7a-94a9-4dc9-baa2-582cab605241-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:07:17 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-c2531079-24fe-45b0-be9b-62b7d23a4055 tempest-TestInstancesWithCinderVolumes-1282020637 None] Lock "cinder-91e47e7a-94a9-4dc9-baa2-582cab605241-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:07:17 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-c2531079-24fe-45b0-be9b-62b7d23a4055 tempest-TestInstancesWithCinderVolumes-1282020637 None] Acquiring lock "cinder-quobyte-91e47e7a-94a9-4dc9-baa2-582cab605241" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:07:17 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-c2531079-24fe-45b0-be9b-62b7d23a4055 tempest-TestInstancesWithCinderVolumes-1282020637 None] Lock "cinder-quobyte-91e47e7a-94a9-4dc9-baa2-582cab605241" acquired by "delete_volume" :: waited 0.016s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:07:17 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[27512726-69ce-48f7-bb23-32b413806472]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:07:17 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-c2531079-24fe-45b0-be9b-62b7d23a4055 tempest-TestInstancesWithCinderVolumes-1282020637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-91e47e7a-94a9-4dc9-baa2-582cab605241 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:07:17 devstack sudo[102097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-91e47e7a-94a9-4dc9-baa2-582cab605241 Sep 17 22:07:17 devstack sudo[102097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:07:17 devstack sudo[102097]: pam_unix(sudo:session): session closed for user root Sep 17 22:07:17 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-c2531079-24fe-45b0-be9b-62b7d23a4055 tempest-TestInstancesWithCinderVolumes-1282020637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-91e47e7a-94a9-4dc9-baa2-582cab605241" returned: 0 in 0.358s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:07:17 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-c2531079-24fe-45b0-be9b-62b7d23a4055 tempest-TestInstancesWithCinderVolumes-1282020637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-91e47e7a-94a9-4dc9-baa2-582cab605241 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:07:17 devstack sudo[102102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-91e47e7a-94a9-4dc9-baa2-582cab605241 Sep 17 22:07:17 devstack sudo[102102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:07:17 devstack sudo[102102]: pam_unix(sudo:session): session closed for user root Sep 17 22:07:17 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-c2531079-24fe-45b0-be9b-62b7d23a4055 tempest-TestInstancesWithCinderVolumes-1282020637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-91e47e7a-94a9-4dc9-baa2-582cab605241" returned: 0 in 0.240s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:07:17 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-c2531079-24fe-45b0-be9b-62b7d23a4055 tempest-TestInstancesWithCinderVolumes-1282020637 None] Lock "cinder-quobyte-91e47e7a-94a9-4dc9-baa2-582cab605241" released by "delete_volume" :: held 0.641s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:07:17 devstack cinder-volume[85458]: WARNING cinder.quota [None req-c2531079-24fe-45b0-be9b-62b7d23a4055 tempest-TestInstancesWithCinderVolumes-1282020637 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-539696416-1842584392 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-539696416-1842584392, it is now deprecated. Please use the default quota class for default quota. Sep 17 22:07:17 devstack cinder-volume[85458]: WARNING cinder.quota [None req-c2531079-24fe-45b0-be9b-62b7d23a4055 tempest-TestInstancesWithCinderVolumes-1282020637 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-539696416-1842584392 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-539696416-1842584392, it is now deprecated. Please use the default quota class for default quota. Sep 17 22:07:17 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-c2531079-24fe-45b0-be9b-62b7d23a4055 tempest-TestInstancesWithCinderVolumes-1282020637 None] Created reservations ['fb0e5a7a-e4b7-4149-9017-1a7ffa2c4863', 'a168d7b1-6f4e-43a2-9894-db928c4dcc0d', 'ecda40fc-7468-4e8e-89ba-8df88f9bb2fd', 'f166c662-561c-46d6-ae78-acdaa1db14f6'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:07:17 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-c2531079-24fe-45b0-be9b-62b7d23a4055 tempest-TestInstancesWithCinderVolumes-1282020637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:07:17 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-c2531079-24fe-45b0-be9b-62b7d23a4055 tempest-TestInstancesWithCinderVolumes-1282020637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:07:17 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-c2531079-24fe-45b0-be9b-62b7d23a4055 tempest-TestInstancesWithCinderVolumes-1282020637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:07:17 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-c2531079-24fe-45b0-be9b-62b7d23a4055 tempest-TestInstancesWithCinderVolumes-1282020637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:07:17 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-c2531079-24fe-45b0-be9b-62b7d23a4055 tempest-TestInstancesWithCinderVolumes-1282020637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:07:17 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-c2531079-24fe-45b0-be9b-62b7d23a4055 tempest-TestInstancesWithCinderVolumes-1282020637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:07:17 devstack sudo[102105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:07:17 devstack sudo[102105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:07:18 devstack sudo[102105]: pam_unix(sudo:session): session closed for user root Sep 17 22:07:18 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-c2531079-24fe-45b0-be9b-62b7d23a4055 tempest-TestInstancesWithCinderVolumes-1282020637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.246s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:07:18 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-c2531079-24fe-45b0-be9b-62b7d23a4055 tempest-TestInstancesWithCinderVolumes-1282020637 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:07:18 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-c2531079-24fe-45b0-be9b-62b7d23a4055 tempest-TestInstancesWithCinderVolumes-1282020637 None] Deleted volume successfully. Sep 17 22:07:18 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-c2531079-24fe-45b0-be9b-62b7d23a4055 tempest-TestInstancesWithCinderVolumes-1282020637 None] Lock "cinder-91e47e7a-94a9-4dc9-baa2-582cab605241-delete_volume" released by "delete_volume" :: held 1.082s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:07:27 devstack cinder-volume[85458]: DEBUG oslo_service.periodic_task [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85458) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 22:07:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:07:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:07:27 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:07:27 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:07:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:07:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:07:27 devstack sudo[102149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:07:27 devstack sudo[102149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:07:27 devstack cinder-volume[85458]: DEBUG dbcounter [-] [85458] Writing DB stats cinder:SELECT=29,cinder:UPDATE=32,cinder:INSERT=5,cinder:DELETE=2 {{(pid=85458) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 22:07:28 devstack sudo[102149]: pam_unix(sudo:session): session closed for user root Sep 17 22:07:28 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.267s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:07:28 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:07:28 devstack cinder-volume[85458]: DEBUG oslo_service.periodic_task [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Running periodic task VolumeManager._thread_info {{(pid=85458) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 22:07:28 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] thread count: 28 {{(pid=85458) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 22:07:28 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] thread info: [<_MainThread(MainThread, started 127546830999680)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85458) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 22:07:28 devstack cinder-volume[85458]: DEBUG dbcounter [-] [85458] Writing DB stats cinder:SELECT=33,cinder:INSERT=7,cinder:UPDATE=22,cinder:DELETE=1 {{(pid=85458) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 22:07:31 devstack cinder-volume[85458]: INFO cinder.volume.manager [req-950c4a18-7731-47d7-96e3-b9884cb96ff2 req-af73c450-c244-4437-91b2-493a83061b2f tempest-TestShelveInstance-763943664 None] Terminate volume connection completed successfully. Sep 17 22:07:31 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [req-950c4a18-7731-47d7-96e3-b9884cb96ff2 req-af73c450-c244-4437-91b2-493a83061b2f tempest-TestShelveInstance-763943664 None] Deleting attachment a652041b-fa7f-4b4f-be2e-658ce09eaf0a. {{(pid=85458) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 22:07:32 devstack cinder-volume[85458]: DEBUG cinder.coordination [req-950c4a18-7731-47d7-96e3-b9884cb96ff2 req-961b425f-417c-446c-91fe-010f9737e5a6 tempest-TestShelveInstance-763943664 None] Acquiring lock "cinder-f5303dab-81aa-4558-b4a2-13fead2fa414-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:07:32 devstack cinder-volume[85458]: DEBUG cinder.coordination [req-950c4a18-7731-47d7-96e3-b9884cb96ff2 req-961b425f-417c-446c-91fe-010f9737e5a6 tempest-TestShelveInstance-763943664 None] Lock "cinder-f5303dab-81aa-4558-b4a2-13fead2fa414-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:07:32 devstack cinder-volume[85458]: DEBUG cinder.coordination [req-950c4a18-7731-47d7-96e3-b9884cb96ff2 req-961b425f-417c-446c-91fe-010f9737e5a6 tempest-TestShelveInstance-763943664 None] Acquiring lock "cinder-quobyte-f5303dab-81aa-4558-b4a2-13fead2fa414" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:07:32 devstack cinder-volume[85458]: DEBUG cinder.coordination [req-950c4a18-7731-47d7-96e3-b9884cb96ff2 req-961b425f-417c-446c-91fe-010f9737e5a6 tempest-TestShelveInstance-763943664 None] Lock "cinder-quobyte-f5303dab-81aa-4558-b4a2-13fead2fa414" acquired by "delete_volume" :: waited 0.021s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:07:32 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[29cdcbc1-f9fa-49fe-a1c6-93febdd1e112]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:07:32 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [req-950c4a18-7731-47d7-96e3-b9884cb96ff2 req-961b425f-417c-446c-91fe-010f9737e5a6 tempest-TestShelveInstance-763943664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f5303dab-81aa-4558-b4a2-13fead2fa414 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:07:32 devstack sudo[102193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f5303dab-81aa-4558-b4a2-13fead2fa414 Sep 17 22:07:32 devstack sudo[102193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:07:32 devstack sudo[102193]: pam_unix(sudo:session): session closed for user root Sep 17 22:07:32 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [req-950c4a18-7731-47d7-96e3-b9884cb96ff2 req-961b425f-417c-446c-91fe-010f9737e5a6 tempest-TestShelveInstance-763943664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f5303dab-81aa-4558-b4a2-13fead2fa414" returned: 0 in 0.412s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:07:32 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [req-950c4a18-7731-47d7-96e3-b9884cb96ff2 req-961b425f-417c-446c-91fe-010f9737e5a6 tempest-TestShelveInstance-763943664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f5303dab-81aa-4558-b4a2-13fead2fa414 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:07:32 devstack sudo[102198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f5303dab-81aa-4558-b4a2-13fead2fa414 Sep 17 22:07:32 devstack sudo[102198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:07:32 devstack sudo[102198]: pam_unix(sudo:session): session closed for user root Sep 17 22:07:32 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [req-950c4a18-7731-47d7-96e3-b9884cb96ff2 req-961b425f-417c-446c-91fe-010f9737e5a6 tempest-TestShelveInstance-763943664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f5303dab-81aa-4558-b4a2-13fead2fa414" returned: 0 in 0.277s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:07:32 devstack cinder-volume[85458]: DEBUG cinder.coordination [req-950c4a18-7731-47d7-96e3-b9884cb96ff2 req-961b425f-417c-446c-91fe-010f9737e5a6 tempest-TestShelveInstance-763943664 None] Lock "cinder-quobyte-f5303dab-81aa-4558-b4a2-13fead2fa414" released by "delete_volume" :: held 0.741s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:07:33 devstack cinder-volume[85458]: DEBUG cinder.quota [req-950c4a18-7731-47d7-96e3-b9884cb96ff2 req-961b425f-417c-446c-91fe-010f9737e5a6 tempest-TestShelveInstance-763943664 None] Created reservations ['a08b969d-24b3-4a06-964c-86c9d9ec8c90', '4032e136-df45-4513-b1e4-1bb56de46413', '445491ab-1f0a-4d45-95b9-ba34ea03140b', 'd9a49b4a-b4a5-4e20-b079-b03f1e519105'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:07:33 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [req-950c4a18-7731-47d7-96e3-b9884cb96ff2 req-961b425f-417c-446c-91fe-010f9737e5a6 tempest-TestShelveInstance-763943664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:07:33 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [req-950c4a18-7731-47d7-96e3-b9884cb96ff2 req-961b425f-417c-446c-91fe-010f9737e5a6 tempest-TestShelveInstance-763943664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:07:33 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [req-950c4a18-7731-47d7-96e3-b9884cb96ff2 req-961b425f-417c-446c-91fe-010f9737e5a6 tempest-TestShelveInstance-763943664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:07:33 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [req-950c4a18-7731-47d7-96e3-b9884cb96ff2 req-961b425f-417c-446c-91fe-010f9737e5a6 tempest-TestShelveInstance-763943664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:07:33 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [req-950c4a18-7731-47d7-96e3-b9884cb96ff2 req-961b425f-417c-446c-91fe-010f9737e5a6 tempest-TestShelveInstance-763943664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:07:33 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [req-950c4a18-7731-47d7-96e3-b9884cb96ff2 req-961b425f-417c-446c-91fe-010f9737e5a6 tempest-TestShelveInstance-763943664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:07:33 devstack sudo[102201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:07:33 devstack sudo[102201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:07:33 devstack sudo[102201]: pam_unix(sudo:session): session closed for user root Sep 17 22:07:33 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [req-950c4a18-7731-47d7-96e3-b9884cb96ff2 req-961b425f-417c-446c-91fe-010f9737e5a6 tempest-TestShelveInstance-763943664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.299s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:07:33 devstack cinder-volume[85458]: DEBUG cinder.manager [req-950c4a18-7731-47d7-96e3-b9884cb96ff2 req-961b425f-417c-446c-91fe-010f9737e5a6 tempest-TestShelveInstance-763943664 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:07:33 devstack cinder-volume[85458]: INFO cinder.volume.manager [req-950c4a18-7731-47d7-96e3-b9884cb96ff2 req-961b425f-417c-446c-91fe-010f9737e5a6 tempest-TestShelveInstance-763943664 None] Deleted volume successfully. Sep 17 22:07:33 devstack cinder-volume[85458]: DEBUG cinder.coordination [req-950c4a18-7731-47d7-96e3-b9884cb96ff2 req-961b425f-417c-446c-91fe-010f9737e5a6 tempest-TestShelveInstance-763943664 None] Lock "cinder-f5303dab-81aa-4558-b4a2-13fead2fa414-delete_volume" released by "delete_volume" :: held 1.342s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:07:43 devstack cinder-volume[85458]: DEBUG dbcounter [-] [85458] Writing DB stats cinder:SELECT=6,cinder:UPDATE=10,cinder:INSERT=3 {{(pid=85458) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 22:07:43 devstack cinder-volume[85458]: DEBUG dbcounter [-] [85458] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=6,cinder:DELETE=1 {{(pid=85458) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 22:07:47 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bb63ccf-7eb3-4be2-8160-705e35c67c82 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 22:07:47 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-5bb63ccf-7eb3-4be2-8160-705e35c67c82 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Flow 'volume_create_manager' (f864db27-ab39-4702-8d5c-0b96eb176653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:07:47 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-5bb63ccf-7eb3-4be2-8160-705e35c67c82 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d14e915d-0f96-464a-b86a-e5f84f3992f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:07:47 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-5bb63ccf-7eb3-4be2-8160-705e35c67c82 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d14e915d-0f96-464a-b86a-e5f84f3992f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:07:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-464466993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36f5ad83-8f19-48b8-83ca-8f14e75a15f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d4602971df149beacf2a0dd50f14efc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:07:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:07:47Z,use_quota=True,user_id='e2698ea034ed4df1960551e2ea80a9c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:07:47 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-5bb63ccf-7eb3-4be2-8160-705e35c67c82 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a700808a-fc27-4578-af5f-4bf09ebb42d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:07:47 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-5bb63ccf-7eb3-4be2-8160-705e35c67c82 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a700808a-fc27-4578-af5f-4bf09ebb42d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:07:47 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-5bb63ccf-7eb3-4be2-8160-705e35c67c82 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ec43df8-b547-4627-9942-c48ea28e8874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:07:47 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-5bb63ccf-7eb3-4be2-8160-705e35c67c82 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ec43df8-b547-4627-9942-c48ea28e8874) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36f5ad83-8f19-48b8-83ca-8f14e75a15f5', 'volume_name': 'volume-36f5ad83-8f19-48b8-83ca-8f14e75a15f5', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:07:47 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-5bb63ccf-7eb3-4be2-8160-705e35c67c82 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6b9b0eb-10c9-469a-acb6-fd2300a80780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:07:47 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-5bb63ccf-7eb3-4be2-8160-705e35c67c82 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6b9b0eb-10c9-469a-acb6-fd2300a80780) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:07:47 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-5bb63ccf-7eb3-4be2-8160-705e35c67c82 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9423d22-0a2b-44d4-a04a-25fe2f9bb962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:07:47 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-5bb63ccf-7eb3-4be2-8160-705e35c67c82 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Volume 36f5ad83-8f19-48b8-83ca-8f14e75a15f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36f5ad83-8f19-48b8-83ca-8f14e75a15f5', 'volume_size': 1} Sep 17 22:07:47 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-5bb63ccf-7eb3-4be2-8160-705e35c67c82 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:07:47 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-5bb63ccf-7eb3-4be2-8160-705e35c67c82 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:07:47 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-5bb63ccf-7eb3-4be2-8160-705e35c67c82 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:07:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-464466993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36f5ad83-8f19-48b8-83ca-8f14e75a15f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d4602971df149beacf2a0dd50f14efc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:07:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:07:47Z,use_quota=True,user_id='e2698ea034ed4df1960551e2ea80a9c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 22:07:47 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-5bb63ccf-7eb3-4be2-8160-705e35c67c82 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Creating volume 36f5ad83-8f19-48b8-83ca-8f14e75a15f5 {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 22:07:47 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-5bb63ccf-7eb3-4be2-8160-705e35c67c82 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:07:47 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-5bb63ccf-7eb3-4be2-8160-705e35c67c82 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:07:47 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-5bb63ccf-7eb3-4be2-8160-705e35c67c82 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:07:47 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-5bb63ccf-7eb3-4be2-8160-705e35c67c82 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:07:47 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-5bb63ccf-7eb3-4be2-8160-705e35c67c82 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:07:47 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-5bb63ccf-7eb3-4be2-8160-705e35c67c82 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 22:07:47 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-5bb63ccf-7eb3-4be2-8160-705e35c67c82 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 22:07:47 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-5bb63ccf-7eb3-4be2-8160-705e35c67c82 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-36f5ad83-8f19-48b8-83ca-8f14e75a15f5 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:07:47 devstack sudo[102211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-36f5ad83-8f19-48b8-83ca-8f14e75a15f5 1073741824 Sep 17 22:07:47 devstack sudo[102211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:07:47 devstack sudo[102211]: pam_unix(sudo:session): session closed for user root Sep 17 22:07:47 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-5bb63ccf-7eb3-4be2-8160-705e35c67c82 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-36f5ad83-8f19-48b8-83ca-8f14e75a15f5 1073741824" returned: 0 in 0.499s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:07:47 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-5bb63ccf-7eb3-4be2-8160-705e35c67c82 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-36f5ad83-8f19-48b8-83ca-8f14e75a15f5 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:07:47 devstack sudo[102217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-36f5ad83-8f19-48b8-83ca-8f14e75a15f5 Sep 17 22:07:47 devstack sudo[102217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:07:47 devstack sudo[102217]: pam_unix(sudo:session): session closed for user root Sep 17 22:07:47 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-5bb63ccf-7eb3-4be2-8160-705e35c67c82 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-36f5ad83-8f19-48b8-83ca-8f14e75a15f5" returned: 0 in 0.270s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:07:47 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-5bb63ccf-7eb3-4be2-8160-705e35c67c82 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] <== create_volume: return (865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 22:07:47 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-5bb63ccf-7eb3-4be2-8160-705e35c67c82 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.869s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:07:47 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-5bb63ccf-7eb3-4be2-8160-705e35c67c82 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9423d22-0a2b-44d4-a04a-25fe2f9bb962) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36f5ad83-8f19-48b8-83ca-8f14e75a15f5', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:07:47 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-5bb63ccf-7eb3-4be2-8160-705e35c67c82 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (136ab88b-b649-4129-b06e-39b4352d251f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:07:48 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-5bb63ccf-7eb3-4be2-8160-705e35c67c82 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Volume volume-36f5ad83-8f19-48b8-83ca-8f14e75a15f5 (36f5ad83-8f19-48b8-83ca-8f14e75a15f5): created successfully Sep 17 22:07:48 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-5bb63ccf-7eb3-4be2-8160-705e35c67c82 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (136ab88b-b649-4129-b06e-39b4352d251f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:07:48 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-5bb63ccf-7eb3-4be2-8160-705e35c67c82 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Flow 'volume_create_manager' (f864db27-ab39-4702-8d5c-0b96eb176653) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:07:48 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-5bb63ccf-7eb3-4be2-8160-705e35c67c82 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Created volume successfully. Sep 17 22:07:49 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d0a726a-f1f2-4e54-91b3-3022b99396f4 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 22:07:49 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-5d0a726a-f1f2-4e54-91b3-3022b99396f4 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Flow 'volume_create_manager' (e06db62c-cf8b-4bbe-953f-ddd09e172612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:07:49 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-5d0a726a-f1f2-4e54-91b3-3022b99396f4 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f7ed533-4cd6-4ec2-b95a-03a5a9c4b681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:07:49 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-5d0a726a-f1f2-4e54-91b3-3022b99396f4 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f7ed533-4cd6-4ec2-b95a-03a5a9c4b681) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:07:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1488937929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df2a272a-1aef-4ccd-8de4-b16427bd257e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d4602971df149beacf2a0dd50f14efc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:07:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:07:50Z,use_quota=True,user_id='e2698ea034ed4df1960551e2ea80a9c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:07:49 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-5d0a726a-f1f2-4e54-91b3-3022b99396f4 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7218d9c-1b16-4959-8224-2cf11e6a2fde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:07:49 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-5d0a726a-f1f2-4e54-91b3-3022b99396f4 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7218d9c-1b16-4959-8224-2cf11e6a2fde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:07:49 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-5d0a726a-f1f2-4e54-91b3-3022b99396f4 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f10537c1-b0d1-4717-beb5-f4ec2a5c385c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:07:49 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-5d0a726a-f1f2-4e54-91b3-3022b99396f4 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f10537c1-b0d1-4717-beb5-f4ec2a5c385c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df2a272a-1aef-4ccd-8de4-b16427bd257e', 'volume_name': 'volume-df2a272a-1aef-4ccd-8de4-b16427bd257e', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:07:49 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-5d0a726a-f1f2-4e54-91b3-3022b99396f4 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (530b5be0-cacd-4ee6-b4ab-7786a3238216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:07:49 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-5d0a726a-f1f2-4e54-91b3-3022b99396f4 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (530b5be0-cacd-4ee6-b4ab-7786a3238216) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:07:49 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-5d0a726a-f1f2-4e54-91b3-3022b99396f4 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48c22012-f5d9-4f00-adc4-8d4bf6326386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:07:49 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-5d0a726a-f1f2-4e54-91b3-3022b99396f4 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Volume df2a272a-1aef-4ccd-8de4-b16427bd257e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df2a272a-1aef-4ccd-8de4-b16427bd257e', 'volume_size': 1} Sep 17 22:07:49 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-5d0a726a-f1f2-4e54-91b3-3022b99396f4 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:07:49 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-5d0a726a-f1f2-4e54-91b3-3022b99396f4 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:07:49 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-5d0a726a-f1f2-4e54-91b3-3022b99396f4 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:07:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1488937929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df2a272a-1aef-4ccd-8de4-b16427bd257e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d4602971df149beacf2a0dd50f14efc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:07:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:07:50Z,use_quota=True,user_id='e2698ea034ed4df1960551e2ea80a9c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 22:07:49 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-5d0a726a-f1f2-4e54-91b3-3022b99396f4 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Creating volume df2a272a-1aef-4ccd-8de4-b16427bd257e {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 22:07:49 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-5d0a726a-f1f2-4e54-91b3-3022b99396f4 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:07:49 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-5d0a726a-f1f2-4e54-91b3-3022b99396f4 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:07:49 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-5d0a726a-f1f2-4e54-91b3-3022b99396f4 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:07:49 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-5d0a726a-f1f2-4e54-91b3-3022b99396f4 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:07:49 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-5d0a726a-f1f2-4e54-91b3-3022b99396f4 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:07:49 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-5d0a726a-f1f2-4e54-91b3-3022b99396f4 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 22:07:49 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-5d0a726a-f1f2-4e54-91b3-3022b99396f4 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 22:07:49 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-5d0a726a-f1f2-4e54-91b3-3022b99396f4 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-df2a272a-1aef-4ccd-8de4-b16427bd257e 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:07:49 devstack sudo[102222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-df2a272a-1aef-4ccd-8de4-b16427bd257e 1073741824 Sep 17 22:07:49 devstack sudo[102222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:07:50 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6e84bc2-ed92-4362-8ef2-8a98ffe99846 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 22:07:50 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e6e84bc2-ed92-4362-8ef2-8a98ffe99846 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Flow 'volume_create_manager' (1c8d1c3d-e2f5-4537-b88a-4f66438010bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:07:50 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e6e84bc2-ed92-4362-8ef2-8a98ffe99846 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fc6eba9-80ca-4292-9591-4fa4e5f6ce31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:07:50 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e6e84bc2-ed92-4362-8ef2-8a98ffe99846 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fc6eba9-80ca-4292-9591-4fa4e5f6ce31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:07:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-726879395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09bfcdfa-54af-41a0-9bb7-27ee8b6c5989,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d4602971df149beacf2a0dd50f14efc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:07:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:07:50Z,use_quota=True,user_id='e2698ea034ed4df1960551e2ea80a9c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:07:50 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e6e84bc2-ed92-4362-8ef2-8a98ffe99846 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dda7b9d2-2fe8-4a99-9b71-f4daf956c032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:07:50 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e6e84bc2-ed92-4362-8ef2-8a98ffe99846 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dda7b9d2-2fe8-4a99-9b71-f4daf956c032) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:07:50 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e6e84bc2-ed92-4362-8ef2-8a98ffe99846 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (847d448b-1f7a-49cb-ab49-f30ca0a74044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:07:50 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e6e84bc2-ed92-4362-8ef2-8a98ffe99846 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (847d448b-1f7a-49cb-ab49-f30ca0a74044) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09bfcdfa-54af-41a0-9bb7-27ee8b6c5989', 'volume_name': 'volume-09bfcdfa-54af-41a0-9bb7-27ee8b6c5989', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:07:50 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e6e84bc2-ed92-4362-8ef2-8a98ffe99846 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b3ab093-01b3-483e-bf70-7fd0bfffed5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:07:50 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e6e84bc2-ed92-4362-8ef2-8a98ffe99846 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b3ab093-01b3-483e-bf70-7fd0bfffed5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:07:50 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e6e84bc2-ed92-4362-8ef2-8a98ffe99846 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84a4b00d-27dd-4987-a96e-230c1fd80ac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:07:50 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-e6e84bc2-ed92-4362-8ef2-8a98ffe99846 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Volume 09bfcdfa-54af-41a0-9bb7-27ee8b6c5989: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09bfcdfa-54af-41a0-9bb7-27ee8b6c5989', 'volume_size': 1} Sep 17 22:07:50 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e6e84bc2-ed92-4362-8ef2-8a98ffe99846 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:07:50 devstack sudo[102222]: pam_unix(sudo:session): session closed for user root Sep 17 22:07:50 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-5d0a726a-f1f2-4e54-91b3-3022b99396f4 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-df2a272a-1aef-4ccd-8de4-b16427bd257e 1073741824" returned: 0 in 0.607s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:07:50 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-5d0a726a-f1f2-4e54-91b3-3022b99396f4 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-df2a272a-1aef-4ccd-8de4-b16427bd257e {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:07:50 devstack sudo[102228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-df2a272a-1aef-4ccd-8de4-b16427bd257e Sep 17 22:07:50 devstack sudo[102228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:07:50 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff7268d2-d0a6-45a9-9b5e-c487b486c0df tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 22:07:50 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-ff7268d2-d0a6-45a9-9b5e-c487b486c0df tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Flow 'volume_create_manager' (c3b48e3a-7f37-409c-a9cd-2f881468c77f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:07:50 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-ff7268d2-d0a6-45a9-9b5e-c487b486c0df tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bddb4135-fc0e-400d-a878-a9707a0f175b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:07:50 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-ff7268d2-d0a6-45a9-9b5e-c487b486c0df tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bddb4135-fc0e-400d-a878-a9707a0f175b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:07:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-114333529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46c7c4d1-c3cc-4a33-926a-9d3573fdccd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d4602971df149beacf2a0dd50f14efc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:07:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:07:51Z,use_quota=True,user_id='e2698ea034ed4df1960551e2ea80a9c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:07:50 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-ff7268d2-d0a6-45a9-9b5e-c487b486c0df tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2db2a86a-36f3-4d53-8f4a-bc61b37c15af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:07:50 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-ff7268d2-d0a6-45a9-9b5e-c487b486c0df tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2db2a86a-36f3-4d53-8f4a-bc61b37c15af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:07:50 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-ff7268d2-d0a6-45a9-9b5e-c487b486c0df tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f7c1dd1-6611-42ca-b4c2-db4ab13e6d4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:07:50 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-ff7268d2-d0a6-45a9-9b5e-c487b486c0df tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f7c1dd1-6611-42ca-b4c2-db4ab13e6d4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46c7c4d1-c3cc-4a33-926a-9d3573fdccd6', 'volume_name': 'volume-46c7c4d1-c3cc-4a33-926a-9d3573fdccd6', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:07:50 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-ff7268d2-d0a6-45a9-9b5e-c487b486c0df tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51c2a43c-6284-4aa7-a275-dd2ca0d32868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:07:50 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-ff7268d2-d0a6-45a9-9b5e-c487b486c0df tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51c2a43c-6284-4aa7-a275-dd2ca0d32868) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:07:50 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-ff7268d2-d0a6-45a9-9b5e-c487b486c0df tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3e8804d-74a7-4a1b-8860-1d713e52469c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:07:50 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-ff7268d2-d0a6-45a9-9b5e-c487b486c0df tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Volume 46c7c4d1-c3cc-4a33-926a-9d3573fdccd6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46c7c4d1-c3cc-4a33-926a-9d3573fdccd6', 'volume_size': 1} Sep 17 22:07:50 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-ff7268d2-d0a6-45a9-9b5e-c487b486c0df tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:07:50 devstack sudo[102228]: pam_unix(sudo:session): session closed for user root Sep 17 22:07:50 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-5d0a726a-f1f2-4e54-91b3-3022b99396f4 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-df2a272a-1aef-4ccd-8de4-b16427bd257e" returned: 0 in 0.300s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:07:50 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-5d0a726a-f1f2-4e54-91b3-3022b99396f4 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] <== create_volume: return (963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 22:07:50 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-5d0a726a-f1f2-4e54-91b3-3022b99396f4 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.966s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:07:50 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e6e84bc2-ed92-4362-8ef2-8a98ffe99846 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.559s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:07:50 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-e6e84bc2-ed92-4362-8ef2-8a98ffe99846 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:07:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-726879395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09bfcdfa-54af-41a0-9bb7-27ee8b6c5989,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d4602971df149beacf2a0dd50f14efc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:07:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:07:50Z,use_quota=True,user_id='e2698ea034ed4df1960551e2ea80a9c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 22:07:50 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-e6e84bc2-ed92-4362-8ef2-8a98ffe99846 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Creating volume 09bfcdfa-54af-41a0-9bb7-27ee8b6c5989 {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 22:07:50 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e6e84bc2-ed92-4362-8ef2-8a98ffe99846 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:07:50 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e6e84bc2-ed92-4362-8ef2-8a98ffe99846 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:07:50 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-e6e84bc2-ed92-4362-8ef2-8a98ffe99846 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:07:50 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-e6e84bc2-ed92-4362-8ef2-8a98ffe99846 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:07:50 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e6e84bc2-ed92-4362-8ef2-8a98ffe99846 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:07:50 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-e6e84bc2-ed92-4362-8ef2-8a98ffe99846 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 22:07:50 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-e6e84bc2-ed92-4362-8ef2-8a98ffe99846 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 22:07:50 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e6e84bc2-ed92-4362-8ef2-8a98ffe99846 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-09bfcdfa-54af-41a0-9bb7-27ee8b6c5989 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:07:50 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-5d0a726a-f1f2-4e54-91b3-3022b99396f4 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48c22012-f5d9-4f00-adc4-8d4bf6326386) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df2a272a-1aef-4ccd-8de4-b16427bd257e', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:07:50 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-5d0a726a-f1f2-4e54-91b3-3022b99396f4 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (065299f9-b005-4bad-8dda-f36cd8ea758f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:07:50 devstack sudo[102231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-09bfcdfa-54af-41a0-9bb7-27ee8b6c5989 1073741824 Sep 17 22:07:50 devstack sudo[102231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:07:50 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-5d0a726a-f1f2-4e54-91b3-3022b99396f4 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Volume volume-df2a272a-1aef-4ccd-8de4-b16427bd257e (df2a272a-1aef-4ccd-8de4-b16427bd257e): created successfully Sep 17 22:07:50 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-5d0a726a-f1f2-4e54-91b3-3022b99396f4 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (065299f9-b005-4bad-8dda-f36cd8ea758f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:07:50 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-5d0a726a-f1f2-4e54-91b3-3022b99396f4 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Flow 'volume_create_manager' (e06db62c-cf8b-4bbe-953f-ddd09e172612) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:07:50 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-5d0a726a-f1f2-4e54-91b3-3022b99396f4 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Created volume successfully. Sep 17 22:07:50 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-54318645-2b90-419b-a112-62741682a901 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 22:07:51 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-54318645-2b90-419b-a112-62741682a901 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Flow 'volume_create_manager' (37a76ae1-0022-4322-a6f9-147cd835a5f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:07:51 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-54318645-2b90-419b-a112-62741682a901 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0067a6c8-9cf8-4742-83fd-a0ec23dbbdc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:07:51 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-54318645-2b90-419b-a112-62741682a901 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0067a6c8-9cf8-4742-83fd-a0ec23dbbdc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:07:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-688233964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d13b042b-d1dc-45f9-bc38-0fc7de266d84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d4602971df149beacf2a0dd50f14efc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:07:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:07:51Z,use_quota=True,user_id='e2698ea034ed4df1960551e2ea80a9c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:07:51 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-54318645-2b90-419b-a112-62741682a901 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a324eab8-bd4f-43bb-a0b2-04d4c75596c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:07:51 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-54318645-2b90-419b-a112-62741682a901 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a324eab8-bd4f-43bb-a0b2-04d4c75596c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:07:51 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-54318645-2b90-419b-a112-62741682a901 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2f421f3-154d-4562-ae18-f2bc7009d549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:07:51 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-54318645-2b90-419b-a112-62741682a901 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2f421f3-154d-4562-ae18-f2bc7009d549) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd13b042b-d1dc-45f9-bc38-0fc7de266d84', 'volume_name': 'volume-d13b042b-d1dc-45f9-bc38-0fc7de266d84', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:07:51 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-54318645-2b90-419b-a112-62741682a901 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7e71669-c3df-4be0-9c5e-648f655471a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:07:51 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-54318645-2b90-419b-a112-62741682a901 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7e71669-c3df-4be0-9c5e-648f655471a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:07:51 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-54318645-2b90-419b-a112-62741682a901 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8fdf2ea-d93f-42b3-8cca-eb47a29b700a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:07:51 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-54318645-2b90-419b-a112-62741682a901 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Volume d13b042b-d1dc-45f9-bc38-0fc7de266d84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d13b042b-d1dc-45f9-bc38-0fc7de266d84', 'volume_size': 1} Sep 17 22:07:51 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-54318645-2b90-419b-a112-62741682a901 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:07:51 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-50d60dd2-cd36-4215-a6e4-d771a83a9712 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 22:07:51 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-50d60dd2-cd36-4215-a6e4-d771a83a9712 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Flow 'volume_create_manager' (287a1ea2-f15c-4bf3-9a9b-45ef1b2bdeab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:07:51 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-50d60dd2-cd36-4215-a6e4-d771a83a9712 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4655e784-9c10-4325-bd54-99e10e74c8fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:07:51 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-50d60dd2-cd36-4215-a6e4-d771a83a9712 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4655e784-9c10-4325-bd54-99e10e74c8fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:07:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-402758014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7eb0c5f2-d021-4e52-82fb-118cc87c728b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d4602971df149beacf2a0dd50f14efc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:07:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:07:51Z,use_quota=True,user_id='e2698ea034ed4df1960551e2ea80a9c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:07:51 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-50d60dd2-cd36-4215-a6e4-d771a83a9712 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64270f8c-b75c-4714-a1d7-4034bff0b075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:07:51 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-50d60dd2-cd36-4215-a6e4-d771a83a9712 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64270f8c-b75c-4714-a1d7-4034bff0b075) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:07:51 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-50d60dd2-cd36-4215-a6e4-d771a83a9712 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca1ef828-2739-4c96-8851-51ba17481729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:07:51 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-50d60dd2-cd36-4215-a6e4-d771a83a9712 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca1ef828-2739-4c96-8851-51ba17481729) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7eb0c5f2-d021-4e52-82fb-118cc87c728b', 'volume_name': 'volume-7eb0c5f2-d021-4e52-82fb-118cc87c728b', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:07:51 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-50d60dd2-cd36-4215-a6e4-d771a83a9712 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d8b99bb-14ac-4510-97c5-031a80d5df93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:07:51 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-50d60dd2-cd36-4215-a6e4-d771a83a9712 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d8b99bb-14ac-4510-97c5-031a80d5df93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:07:51 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-50d60dd2-cd36-4215-a6e4-d771a83a9712 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61b62c54-c040-471a-9f22-0e8a812beeed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:07:51 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-50d60dd2-cd36-4215-a6e4-d771a83a9712 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Volume 7eb0c5f2-d021-4e52-82fb-118cc87c728b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7eb0c5f2-d021-4e52-82fb-118cc87c728b', 'volume_size': 1} Sep 17 22:07:51 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-50d60dd2-cd36-4215-a6e4-d771a83a9712 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:07:51 devstack sudo[102231]: pam_unix(sudo:session): session closed for user root Sep 17 22:07:51 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e6e84bc2-ed92-4362-8ef2-8a98ffe99846 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-09bfcdfa-54af-41a0-9bb7-27ee8b6c5989 1073741824" returned: 0 in 0.715s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:07:51 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e6e84bc2-ed92-4362-8ef2-8a98ffe99846 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-09bfcdfa-54af-41a0-9bb7-27ee8b6c5989 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:07:51 devstack sudo[102237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-09bfcdfa-54af-41a0-9bb7-27ee8b6c5989 Sep 17 22:07:51 devstack sudo[102237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:07:51 devstack sudo[102237]: pam_unix(sudo:session): session closed for user root Sep 17 22:07:51 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e6e84bc2-ed92-4362-8ef2-8a98ffe99846 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-09bfcdfa-54af-41a0-9bb7-27ee8b6c5989" returned: 0 in 0.273s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:07:51 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-e6e84bc2-ed92-4362-8ef2-8a98ffe99846 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] <== create_volume: return (1039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 22:07:51 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e6e84bc2-ed92-4362-8ef2-8a98ffe99846 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.045s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:07:51 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-ff7268d2-d0a6-45a9-9b5e-c487b486c0df tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.141s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:07:51 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-ff7268d2-d0a6-45a9-9b5e-c487b486c0df tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:07:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-114333529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46c7c4d1-c3cc-4a33-926a-9d3573fdccd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d4602971df149beacf2a0dd50f14efc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:07:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:07:51Z,use_quota=True,user_id='e2698ea034ed4df1960551e2ea80a9c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 22:07:51 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-ff7268d2-d0a6-45a9-9b5e-c487b486c0df tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Creating volume 46c7c4d1-c3cc-4a33-926a-9d3573fdccd6 {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 22:07:51 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-ff7268d2-d0a6-45a9-9b5e-c487b486c0df tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:07:51 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-ff7268d2-d0a6-45a9-9b5e-c487b486c0df tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:07:51 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-ff7268d2-d0a6-45a9-9b5e-c487b486c0df tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:07:51 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-ff7268d2-d0a6-45a9-9b5e-c487b486c0df tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:07:51 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-ff7268d2-d0a6-45a9-9b5e-c487b486c0df tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:07:51 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-ff7268d2-d0a6-45a9-9b5e-c487b486c0df tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 22:07:51 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-ff7268d2-d0a6-45a9-9b5e-c487b486c0df tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 22:07:51 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-ff7268d2-d0a6-45a9-9b5e-c487b486c0df tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-46c7c4d1-c3cc-4a33-926a-9d3573fdccd6 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:07:51 devstack sudo[102240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-46c7c4d1-c3cc-4a33-926a-9d3573fdccd6 1073741824 Sep 17 22:07:51 devstack sudo[102240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:07:51 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e6e84bc2-ed92-4362-8ef2-8a98ffe99846 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84a4b00d-27dd-4987-a96e-230c1fd80ac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09bfcdfa-54af-41a0-9bb7-27ee8b6c5989', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:07:51 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e6e84bc2-ed92-4362-8ef2-8a98ffe99846 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3d04d27-365e-4e3b-af7f-93c3ed221a0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:07:51 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-e6e84bc2-ed92-4362-8ef2-8a98ffe99846 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Volume volume-09bfcdfa-54af-41a0-9bb7-27ee8b6c5989 (09bfcdfa-54af-41a0-9bb7-27ee8b6c5989): created successfully Sep 17 22:07:51 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e6e84bc2-ed92-4362-8ef2-8a98ffe99846 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3d04d27-365e-4e3b-af7f-93c3ed221a0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:07:51 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e6e84bc2-ed92-4362-8ef2-8a98ffe99846 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Flow 'volume_create_manager' (1c8d1c3d-e2f5-4537-b88a-4f66438010bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:07:51 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-e6e84bc2-ed92-4362-8ef2-8a98ffe99846 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Created volume successfully. Sep 17 22:07:52 devstack sudo[102240]: pam_unix(sudo:session): session closed for user root Sep 17 22:07:52 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-ff7268d2-d0a6-45a9-9b5e-c487b486c0df tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-46c7c4d1-c3cc-4a33-926a-9d3573fdccd6 1073741824" returned: 0 in 0.584s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:07:52 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-ff7268d2-d0a6-45a9-9b5e-c487b486c0df tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-46c7c4d1-c3cc-4a33-926a-9d3573fdccd6 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:07:52 devstack sudo[102246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-46c7c4d1-c3cc-4a33-926a-9d3573fdccd6 Sep 17 22:07:52 devstack sudo[102246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:07:52 devstack sudo[102246]: pam_unix(sudo:session): session closed for user root Sep 17 22:07:52 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-ff7268d2-d0a6-45a9-9b5e-c487b486c0df tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-46c7c4d1-c3cc-4a33-926a-9d3573fdccd6" returned: 0 in 0.286s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:07:52 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-ff7268d2-d0a6-45a9-9b5e-c487b486c0df tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] <== create_volume: return (926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 22:07:52 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-ff7268d2-d0a6-45a9-9b5e-c487b486c0df tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.928s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:07:52 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-54318645-2b90-419b-a112-62741682a901 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.699s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:07:52 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-54318645-2b90-419b-a112-62741682a901 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:07:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-688233964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d13b042b-d1dc-45f9-bc38-0fc7de266d84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d4602971df149beacf2a0dd50f14efc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:07:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:07:51Z,use_quota=True,user_id='e2698ea034ed4df1960551e2ea80a9c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 22:07:52 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-54318645-2b90-419b-a112-62741682a901 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Creating volume d13b042b-d1dc-45f9-bc38-0fc7de266d84 {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 22:07:52 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-54318645-2b90-419b-a112-62741682a901 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:07:52 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-54318645-2b90-419b-a112-62741682a901 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:07:52 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-54318645-2b90-419b-a112-62741682a901 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:07:52 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-54318645-2b90-419b-a112-62741682a901 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:07:52 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-54318645-2b90-419b-a112-62741682a901 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:07:52 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-54318645-2b90-419b-a112-62741682a901 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 22:07:52 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-54318645-2b90-419b-a112-62741682a901 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 22:07:52 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-54318645-2b90-419b-a112-62741682a901 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-d13b042b-d1dc-45f9-bc38-0fc7de266d84 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:07:52 devstack sudo[102249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-d13b042b-d1dc-45f9-bc38-0fc7de266d84 1073741824 Sep 17 22:07:52 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-ff7268d2-d0a6-45a9-9b5e-c487b486c0df tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3e8804d-74a7-4a1b-8860-1d713e52469c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46c7c4d1-c3cc-4a33-926a-9d3573fdccd6', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:07:52 devstack sudo[102249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:07:52 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-ff7268d2-d0a6-45a9-9b5e-c487b486c0df tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30409ddd-4741-4137-b987-e651b5801abd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:07:52 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-ff7268d2-d0a6-45a9-9b5e-c487b486c0df tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Volume volume-46c7c4d1-c3cc-4a33-926a-9d3573fdccd6 (46c7c4d1-c3cc-4a33-926a-9d3573fdccd6): created successfully Sep 17 22:07:52 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-ff7268d2-d0a6-45a9-9b5e-c487b486c0df tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30409ddd-4741-4137-b987-e651b5801abd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:07:52 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-ff7268d2-d0a6-45a9-9b5e-c487b486c0df tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Flow 'volume_create_manager' (c3b48e3a-7f37-409c-a9cd-2f881468c77f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:07:52 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-ff7268d2-d0a6-45a9-9b5e-c487b486c0df tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Created volume successfully. Sep 17 22:07:53 devstack sudo[102249]: pam_unix(sudo:session): session closed for user root Sep 17 22:07:53 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-54318645-2b90-419b-a112-62741682a901 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-d13b042b-d1dc-45f9-bc38-0fc7de266d84 1073741824" returned: 0 in 0.483s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:07:53 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-54318645-2b90-419b-a112-62741682a901 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-d13b042b-d1dc-45f9-bc38-0fc7de266d84 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:07:53 devstack sudo[102255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-d13b042b-d1dc-45f9-bc38-0fc7de266d84 Sep 17 22:07:53 devstack sudo[102255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:07:53 devstack sudo[102255]: pam_unix(sudo:session): session closed for user root Sep 17 22:07:53 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-54318645-2b90-419b-a112-62741682a901 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-d13b042b-d1dc-45f9-bc38-0fc7de266d84" returned: 0 in 0.284s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:07:53 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-54318645-2b90-419b-a112-62741682a901 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] <== create_volume: return (808ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 22:07:53 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-54318645-2b90-419b-a112-62741682a901 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.811s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:07:53 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-50d60dd2-cd36-4215-a6e4-d771a83a9712 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.134s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:07:53 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-50d60dd2-cd36-4215-a6e4-d771a83a9712 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:07:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-402758014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7eb0c5f2-d021-4e52-82fb-118cc87c728b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d4602971df149beacf2a0dd50f14efc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:07:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:07:51Z,use_quota=True,user_id='e2698ea034ed4df1960551e2ea80a9c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 22:07:53 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-50d60dd2-cd36-4215-a6e4-d771a83a9712 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Creating volume 7eb0c5f2-d021-4e52-82fb-118cc87c728b {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 22:07:53 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-50d60dd2-cd36-4215-a6e4-d771a83a9712 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:07:53 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-50d60dd2-cd36-4215-a6e4-d771a83a9712 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:07:53 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-50d60dd2-cd36-4215-a6e4-d771a83a9712 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:07:53 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-50d60dd2-cd36-4215-a6e4-d771a83a9712 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:07:53 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-50d60dd2-cd36-4215-a6e4-d771a83a9712 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:07:53 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-50d60dd2-cd36-4215-a6e4-d771a83a9712 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 22:07:53 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-50d60dd2-cd36-4215-a6e4-d771a83a9712 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 22:07:53 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-50d60dd2-cd36-4215-a6e4-d771a83a9712 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7eb0c5f2-d021-4e52-82fb-118cc87c728b 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:07:53 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-54318645-2b90-419b-a112-62741682a901 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8fdf2ea-d93f-42b3-8cca-eb47a29b700a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d13b042b-d1dc-45f9-bc38-0fc7de266d84', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:07:53 devstack sudo[102258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7eb0c5f2-d021-4e52-82fb-118cc87c728b 1073741824 Sep 17 22:07:53 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-54318645-2b90-419b-a112-62741682a901 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a268b4e-9ab9-428e-b14e-4ffe6f54a915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:07:53 devstack sudo[102258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:07:53 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-54318645-2b90-419b-a112-62741682a901 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Volume volume-d13b042b-d1dc-45f9-bc38-0fc7de266d84 (d13b042b-d1dc-45f9-bc38-0fc7de266d84): created successfully Sep 17 22:07:53 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-54318645-2b90-419b-a112-62741682a901 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a268b4e-9ab9-428e-b14e-4ffe6f54a915) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:07:53 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-54318645-2b90-419b-a112-62741682a901 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Flow 'volume_create_manager' (37a76ae1-0022-4322-a6f9-147cd835a5f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:07:53 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-54318645-2b90-419b-a112-62741682a901 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Created volume successfully. Sep 17 22:07:54 devstack sudo[102258]: pam_unix(sudo:session): session closed for user root Sep 17 22:07:54 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-50d60dd2-cd36-4215-a6e4-d771a83a9712 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7eb0c5f2-d021-4e52-82fb-118cc87c728b 1073741824" returned: 0 in 0.470s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:07:54 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-50d60dd2-cd36-4215-a6e4-d771a83a9712 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7eb0c5f2-d021-4e52-82fb-118cc87c728b {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:07:54 devstack sudo[102264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7eb0c5f2-d021-4e52-82fb-118cc87c728b Sep 17 22:07:54 devstack sudo[102264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:07:54 devstack sudo[102264]: pam_unix(sudo:session): session closed for user root Sep 17 22:07:54 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-50d60dd2-cd36-4215-a6e4-d771a83a9712 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7eb0c5f2-d021-4e52-82fb-118cc87c728b" returned: 0 in 0.253s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:07:54 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-50d60dd2-cd36-4215-a6e4-d771a83a9712 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] <== create_volume: return (774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 22:07:54 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-50d60dd2-cd36-4215-a6e4-d771a83a9712 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.778s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:07:54 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-50d60dd2-cd36-4215-a6e4-d771a83a9712 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61b62c54-c040-471a-9f22-0e8a812beeed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7eb0c5f2-d021-4e52-82fb-118cc87c728b', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:07:54 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-50d60dd2-cd36-4215-a6e4-d771a83a9712 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d515826f-c843-4118-9447-f4fc1d04f490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:07:54 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-50d60dd2-cd36-4215-a6e4-d771a83a9712 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Volume volume-7eb0c5f2-d021-4e52-82fb-118cc87c728b (7eb0c5f2-d021-4e52-82fb-118cc87c728b): created successfully Sep 17 22:07:54 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-50d60dd2-cd36-4215-a6e4-d771a83a9712 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d515826f-c843-4118-9447-f4fc1d04f490) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:07:54 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-50d60dd2-cd36-4215-a6e4-d771a83a9712 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Flow 'volume_create_manager' (287a1ea2-f15c-4bf3-9a9b-45ef1b2bdeab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:07:54 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-50d60dd2-cd36-4215-a6e4-d771a83a9712 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Created volume successfully. Sep 17 22:07:54 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-7809ca6a-6728-4c69-a733-8bed7b398ce6 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Acquiring lock "cinder-7eb0c5f2-d021-4e52-82fb-118cc87c728b-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:07:54 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-7809ca6a-6728-4c69-a733-8bed7b398ce6 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Lock "cinder-7eb0c5f2-d021-4e52-82fb-118cc87c728b-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:07:54 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-7809ca6a-6728-4c69-a733-8bed7b398ce6 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Acquiring lock "cinder-quobyte-7eb0c5f2-d021-4e52-82fb-118cc87c728b" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:07:54 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-7809ca6a-6728-4c69-a733-8bed7b398ce6 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Lock "cinder-quobyte-7eb0c5f2-d021-4e52-82fb-118cc87c728b" acquired by "delete_volume" :: waited 0.018s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:07:54 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbb56061-74c3-4c80-b2bd-321fa244ac7f]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:07:54 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-7809ca6a-6728-4c69-a733-8bed7b398ce6 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7eb0c5f2-d021-4e52-82fb-118cc87c728b {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:07:54 devstack sudo[102267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7eb0c5f2-d021-4e52-82fb-118cc87c728b Sep 17 22:07:54 devstack sudo[102267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:07:55 devstack sudo[102267]: pam_unix(sudo:session): session closed for user root Sep 17 22:07:55 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-7809ca6a-6728-4c69-a733-8bed7b398ce6 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7eb0c5f2-d021-4e52-82fb-118cc87c728b" returned: 0 in 0.397s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:07:55 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-7809ca6a-6728-4c69-a733-8bed7b398ce6 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7eb0c5f2-d021-4e52-82fb-118cc87c728b {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:07:55 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a443d92-cca5-429e-9ea4-4888a74f5e11 tempest-TestStampPattern-697373642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 22:07:55 devstack sudo[102272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7eb0c5f2-d021-4e52-82fb-118cc87c728b Sep 17 22:07:55 devstack sudo[102272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:07:55 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-2a443d92-cca5-429e-9ea4-4888a74f5e11 tempest-TestStampPattern-697373642 None] Flow 'volume_create_manager' (c75361d0-29ba-4f9a-b850-4489b8400347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:07:55 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-2a443d92-cca5-429e-9ea4-4888a74f5e11 tempest-TestStampPattern-697373642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca25568d-3947-4afd-94ee-45e5abffecbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:07:55 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-2a443d92-cca5-429e-9ea4-4888a74f5e11 tempest-TestStampPattern-697373642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca25568d-3947-4afd-94ee-45e5abffecbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:07:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1785616929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fdddd6e-df91-4f6e-bb35-5a58bd44e4a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6777ab0c6b148c5b376765ae8a03324',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:07:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:07:55Z,use_quota=True,user_id='2324371e38894b318bf30069915dd800',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:07:55 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-2a443d92-cca5-429e-9ea4-4888a74f5e11 tempest-TestStampPattern-697373642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fa8870c-72e9-41b4-9ca1-9d168e0bc233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:07:55 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-2a443d92-cca5-429e-9ea4-4888a74f5e11 tempest-TestStampPattern-697373642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fa8870c-72e9-41b4-9ca1-9d168e0bc233) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:07:55 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-2a443d92-cca5-429e-9ea4-4888a74f5e11 tempest-TestStampPattern-697373642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ef0d173-70b2-4535-90b7-59d2b935c5af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:07:55 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-2a443d92-cca5-429e-9ea4-4888a74f5e11 tempest-TestStampPattern-697373642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ef0d173-70b2-4535-90b7-59d2b935c5af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8fdddd6e-df91-4f6e-bb35-5a58bd44e4a8', 'volume_name': 'volume-8fdddd6e-df91-4f6e-bb35-5a58bd44e4a8', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:07:55 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-2a443d92-cca5-429e-9ea4-4888a74f5e11 tempest-TestStampPattern-697373642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (933b813f-a9c7-40ff-994d-ddb9b5e62aa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:07:55 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-2a443d92-cca5-429e-9ea4-4888a74f5e11 tempest-TestStampPattern-697373642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (933b813f-a9c7-40ff-994d-ddb9b5e62aa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:07:55 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-2a443d92-cca5-429e-9ea4-4888a74f5e11 tempest-TestStampPattern-697373642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8d6f6a9-e7f7-4d24-9a5d-21f1519180e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:07:55 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-2a443d92-cca5-429e-9ea4-4888a74f5e11 tempest-TestStampPattern-697373642 None] Volume 8fdddd6e-df91-4f6e-bb35-5a58bd44e4a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8fdddd6e-df91-4f6e-bb35-5a58bd44e4a8', 'volume_size': 1} Sep 17 22:07:55 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-2a443d92-cca5-429e-9ea4-4888a74f5e11 tempest-TestStampPattern-697373642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:07:55 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-2a443d92-cca5-429e-9ea4-4888a74f5e11 tempest-TestStampPattern-697373642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:07:55 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-2a443d92-cca5-429e-9ea4-4888a74f5e11 tempest-TestStampPattern-697373642 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:07:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1785616929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fdddd6e-df91-4f6e-bb35-5a58bd44e4a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6777ab0c6b148c5b376765ae8a03324',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:07:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:07:55Z,use_quota=True,user_id='2324371e38894b318bf30069915dd800',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 22:07:55 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-2a443d92-cca5-429e-9ea4-4888a74f5e11 tempest-TestStampPattern-697373642 None] Creating volume 8fdddd6e-df91-4f6e-bb35-5a58bd44e4a8 {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 22:07:55 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-2a443d92-cca5-429e-9ea4-4888a74f5e11 tempest-TestStampPattern-697373642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:07:55 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-2a443d92-cca5-429e-9ea4-4888a74f5e11 tempest-TestStampPattern-697373642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:07:55 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-2a443d92-cca5-429e-9ea4-4888a74f5e11 tempest-TestStampPattern-697373642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:07:55 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-2a443d92-cca5-429e-9ea4-4888a74f5e11 tempest-TestStampPattern-697373642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:07:55 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-2a443d92-cca5-429e-9ea4-4888a74f5e11 tempest-TestStampPattern-697373642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:07:55 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-2a443d92-cca5-429e-9ea4-4888a74f5e11 tempest-TestStampPattern-697373642 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 22:07:55 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-2a443d92-cca5-429e-9ea4-4888a74f5e11 tempest-TestStampPattern-697373642 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 22:07:55 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-2a443d92-cca5-429e-9ea4-4888a74f5e11 tempest-TestStampPattern-697373642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8fdddd6e-df91-4f6e-bb35-5a58bd44e4a8 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:07:55 devstack sudo[102274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8fdddd6e-df91-4f6e-bb35-5a58bd44e4a8 1073741824 Sep 17 22:07:55 devstack sudo[102274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:07:55 devstack sudo[102272]: pam_unix(sudo:session): session closed for user root Sep 17 22:07:55 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-7809ca6a-6728-4c69-a733-8bed7b398ce6 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7eb0c5f2-d021-4e52-82fb-118cc87c728b" returned: 0 in 0.300s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:07:55 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-7809ca6a-6728-4c69-a733-8bed7b398ce6 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Lock "cinder-quobyte-7eb0c5f2-d021-4e52-82fb-118cc87c728b" released by "delete_volume" :: held 0.742s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:07:55 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-7809ca6a-6728-4c69-a733-8bed7b398ce6 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Created reservations ['da756f02-d5c3-4bdf-9408-a61615e80136', 'd43a92c5-ffb0-4d98-aafe-be0e6a609508', 'a761d210-8ce7-4e2f-8b5e-9af537507c5f', 'ebdb5c09-447f-4f09-8d33-0017bb717815'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:07:55 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-7809ca6a-6728-4c69-a733-8bed7b398ce6 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:07:55 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-7809ca6a-6728-4c69-a733-8bed7b398ce6 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:07:55 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-7809ca6a-6728-4c69-a733-8bed7b398ce6 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:07:55 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-7809ca6a-6728-4c69-a733-8bed7b398ce6 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:07:55 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-7809ca6a-6728-4c69-a733-8bed7b398ce6 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:07:55 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-7809ca6a-6728-4c69-a733-8bed7b398ce6 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:07:55 devstack sudo[102280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:07:55 devstack sudo[102280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:07:55 devstack sudo[102274]: pam_unix(sudo:session): session closed for user root Sep 17 22:07:55 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-2a443d92-cca5-429e-9ea4-4888a74f5e11 tempest-TestStampPattern-697373642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8fdddd6e-df91-4f6e-bb35-5a58bd44e4a8 1073741824" returned: 0 in 0.551s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:07:55 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-fa5c746a-dae7-4da0-bcfa-d983bdb4834c tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Acquiring lock "cinder-d13b042b-d1dc-45f9-bc38-0fc7de266d84-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:07:55 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-fa5c746a-dae7-4da0-bcfa-d983bdb4834c tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Lock "cinder-d13b042b-d1dc-45f9-bc38-0fc7de266d84-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:07:56 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-2a443d92-cca5-429e-9ea4-4888a74f5e11 tempest-TestStampPattern-697373642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8fdddd6e-df91-4f6e-bb35-5a58bd44e4a8 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:07:56 devstack sudo[102280]: pam_unix(sudo:session): session closed for user root Sep 17 22:07:56 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-7809ca6a-6728-4c69-a733-8bed7b398ce6 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.315s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:07:56 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-7809ca6a-6728-4c69-a733-8bed7b398ce6 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:07:56 devstack sudo[102285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8fdddd6e-df91-4f6e-bb35-5a58bd44e4a8 Sep 17 22:07:56 devstack sudo[102285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:07:56 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-7809ca6a-6728-4c69-a733-8bed7b398ce6 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Deleted volume successfully. Sep 17 22:07:56 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-fa5c746a-dae7-4da0-bcfa-d983bdb4834c tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Acquiring lock "cinder-quobyte-d13b042b-d1dc-45f9-bc38-0fc7de266d84" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:07:56 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-7809ca6a-6728-4c69-a733-8bed7b398ce6 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Lock "cinder-7eb0c5f2-d021-4e52-82fb-118cc87c728b-delete_volume" released by "delete_volume" :: held 1.363s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:07:56 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-fa5c746a-dae7-4da0-bcfa-d983bdb4834c tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Lock "cinder-quobyte-d13b042b-d1dc-45f9-bc38-0fc7de266d84" acquired by "delete_volume" :: waited 0.033s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:07:56 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[b63125dd-f667-4e3b-8504-f5ff81685063]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:07:56 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-fa5c746a-dae7-4da0-bcfa-d983bdb4834c tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-d13b042b-d1dc-45f9-bc38-0fc7de266d84 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:07:56 devstack sudo[102289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-d13b042b-d1dc-45f9-bc38-0fc7de266d84 Sep 17 22:07:56 devstack sudo[102289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:07:56 devstack sudo[102285]: pam_unix(sudo:session): session closed for user root Sep 17 22:07:56 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-2a443d92-cca5-429e-9ea4-4888a74f5e11 tempest-TestStampPattern-697373642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8fdddd6e-df91-4f6e-bb35-5a58bd44e4a8" returned: 0 in 0.325s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:07:56 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-2a443d92-cca5-429e-9ea4-4888a74f5e11 tempest-TestStampPattern-697373642 None] <== create_volume: return (952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 22:07:56 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-2a443d92-cca5-429e-9ea4-4888a74f5e11 tempest-TestStampPattern-697373642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.955s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:07:56 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-2a443d92-cca5-429e-9ea4-4888a74f5e11 tempest-TestStampPattern-697373642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8d6f6a9-e7f7-4d24-9a5d-21f1519180e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fdddd6e-df91-4f6e-bb35-5a58bd44e4a8', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:07:56 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-2a443d92-cca5-429e-9ea4-4888a74f5e11 tempest-TestStampPattern-697373642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fba3463-c061-4b3f-a61c-aa75e252a230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:07:56 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-2a443d92-cca5-429e-9ea4-4888a74f5e11 tempest-TestStampPattern-697373642 None] Volume volume-8fdddd6e-df91-4f6e-bb35-5a58bd44e4a8 (8fdddd6e-df91-4f6e-bb35-5a58bd44e4a8): created successfully Sep 17 22:07:56 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-2a443d92-cca5-429e-9ea4-4888a74f5e11 tempest-TestStampPattern-697373642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fba3463-c061-4b3f-a61c-aa75e252a230) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:07:56 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-2a443d92-cca5-429e-9ea4-4888a74f5e11 tempest-TestStampPattern-697373642 None] Flow 'volume_create_manager' (c75361d0-29ba-4f9a-b850-4489b8400347) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:07:56 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-2a443d92-cca5-429e-9ea4-4888a74f5e11 tempest-TestStampPattern-697373642 None] Created volume successfully. Sep 17 22:07:56 devstack sudo[102289]: pam_unix(sudo:session): session closed for user root Sep 17 22:07:56 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-fa5c746a-dae7-4da0-bcfa-d983bdb4834c tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-d13b042b-d1dc-45f9-bc38-0fc7de266d84" returned: 0 in 0.387s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:07:56 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-fa5c746a-dae7-4da0-bcfa-d983bdb4834c tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-d13b042b-d1dc-45f9-bc38-0fc7de266d84 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:07:56 devstack sudo[102295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-d13b042b-d1dc-45f9-bc38-0fc7de266d84 Sep 17 22:07:56 devstack sudo[102295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:07:56 devstack sudo[102295]: pam_unix(sudo:session): session closed for user root Sep 17 22:07:56 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-fa5c746a-dae7-4da0-bcfa-d983bdb4834c tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-d13b042b-d1dc-45f9-bc38-0fc7de266d84" returned: 0 in 0.258s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:07:56 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-fa5c746a-dae7-4da0-bcfa-d983bdb4834c tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Lock "cinder-quobyte-d13b042b-d1dc-45f9-bc38-0fc7de266d84" released by "delete_volume" :: held 0.704s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:07:56 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-fa5c746a-dae7-4da0-bcfa-d983bdb4834c tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Created reservations ['fdd8cc60-df06-4d25-bbc1-c5e7dbeb1757', 'd329580b-e411-4926-9eb8-2a1b366fa9a1', '642ac05e-f62c-4452-ae60-3f713093e05f', '3209dd36-a765-4efe-829b-99f327733ea7'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:07:56 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-fa5c746a-dae7-4da0-bcfa-d983bdb4834c tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:07:56 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-fa5c746a-dae7-4da0-bcfa-d983bdb4834c tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:07:56 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-fa5c746a-dae7-4da0-bcfa-d983bdb4834c tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:07:56 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-fa5c746a-dae7-4da0-bcfa-d983bdb4834c tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:07:56 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-fa5c746a-dae7-4da0-bcfa-d983bdb4834c tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:07:56 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-fa5c746a-dae7-4da0-bcfa-d983bdb4834c tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:07:57 devstack sudo[102298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:07:57 devstack sudo[102298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:07:57 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-9374ac10-cd97-4e65-9a12-10b59ca146c3 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Acquiring lock "cinder-46c7c4d1-c3cc-4a33-926a-9d3573fdccd6-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:07:57 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-9374ac10-cd97-4e65-9a12-10b59ca146c3 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Lock "cinder-46c7c4d1-c3cc-4a33-926a-9d3573fdccd6-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:07:57 devstack sudo[102298]: pam_unix(sudo:session): session closed for user root Sep 17 22:07:57 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-9374ac10-cd97-4e65-9a12-10b59ca146c3 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Acquiring lock "cinder-quobyte-46c7c4d1-c3cc-4a33-926a-9d3573fdccd6" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:07:57 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-fa5c746a-dae7-4da0-bcfa-d983bdb4834c tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.310s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:07:57 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-fa5c746a-dae7-4da0-bcfa-d983bdb4834c tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:07:57 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-fa5c746a-dae7-4da0-bcfa-d983bdb4834c tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Deleted volume successfully. Sep 17 22:07:57 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-9374ac10-cd97-4e65-9a12-10b59ca146c3 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Lock "cinder-quobyte-46c7c4d1-c3cc-4a33-926a-9d3573fdccd6" acquired by "delete_volume" :: waited 0.030s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:07:57 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-fa5c746a-dae7-4da0-bcfa-d983bdb4834c tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Lock "cinder-d13b042b-d1dc-45f9-bc38-0fc7de266d84-delete_volume" released by "delete_volume" :: held 1.371s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:07:57 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ba1e7bd-02c0-4405-ac41-3d5f216f4ea2]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:07:57 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-9374ac10-cd97-4e65-9a12-10b59ca146c3 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-46c7c4d1-c3cc-4a33-926a-9d3573fdccd6 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:07:57 devstack sudo[102301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-46c7c4d1-c3cc-4a33-926a-9d3573fdccd6 Sep 17 22:07:57 devstack sudo[102301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:07:57 devstack sudo[102301]: pam_unix(sudo:session): session closed for user root Sep 17 22:07:57 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-9374ac10-cd97-4e65-9a12-10b59ca146c3 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-46c7c4d1-c3cc-4a33-926a-9d3573fdccd6" returned: 0 in 0.408s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:07:57 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-9374ac10-cd97-4e65-9a12-10b59ca146c3 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-46c7c4d1-c3cc-4a33-926a-9d3573fdccd6 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:07:57 devstack sudo[102307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-46c7c4d1-c3cc-4a33-926a-9d3573fdccd6 Sep 17 22:07:57 devstack sudo[102307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:07:58 devstack sudo[102307]: pam_unix(sudo:session): session closed for user root Sep 17 22:07:58 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-9374ac10-cd97-4e65-9a12-10b59ca146c3 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-46c7c4d1-c3cc-4a33-926a-9d3573fdccd6" returned: 0 in 0.275s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:07:58 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-9374ac10-cd97-4e65-9a12-10b59ca146c3 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Lock "cinder-quobyte-46c7c4d1-c3cc-4a33-926a-9d3573fdccd6" released by "delete_volume" :: held 0.755s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:07:58 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-9374ac10-cd97-4e65-9a12-10b59ca146c3 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Created reservations ['c788d8a2-2f65-419e-9238-0a4ca1241a93', '1c4b1246-42aa-4b2b-84fc-0d28ee29e9c0', '5540ddd3-7d98-4077-8c3e-a4f2b1df9c28', '5920e53e-20ce-44af-8c57-fd6315cea572'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:07:58 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-9374ac10-cd97-4e65-9a12-10b59ca146c3 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:07:58 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-9374ac10-cd97-4e65-9a12-10b59ca146c3 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:07:58 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-9374ac10-cd97-4e65-9a12-10b59ca146c3 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:07:58 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-9374ac10-cd97-4e65-9a12-10b59ca146c3 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:07:58 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-9374ac10-cd97-4e65-9a12-10b59ca146c3 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:07:58 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-9374ac10-cd97-4e65-9a12-10b59ca146c3 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:07:58 devstack sudo[102320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:07:58 devstack sudo[102320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:07:58 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-69558818-4f3c-44c0-9706-935f02d9924f tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Acquiring lock "cinder-09bfcdfa-54af-41a0-9bb7-27ee8b6c5989-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:07:58 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-69558818-4f3c-44c0-9706-935f02d9924f tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Lock "cinder-09bfcdfa-54af-41a0-9bb7-27ee8b6c5989-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:07:58 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-69558818-4f3c-44c0-9706-935f02d9924f tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Acquiring lock "cinder-quobyte-09bfcdfa-54af-41a0-9bb7-27ee8b6c5989" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:07:58 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-69558818-4f3c-44c0-9706-935f02d9924f tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Lock "cinder-quobyte-09bfcdfa-54af-41a0-9bb7-27ee8b6c5989" acquired by "delete_volume" :: waited 0.024s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:07:58 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[20b4e51e-5eb9-4bb8-992c-73246cf2abf0]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:07:58 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-69558818-4f3c-44c0-9706-935f02d9924f tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-09bfcdfa-54af-41a0-9bb7-27ee8b6c5989 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:07:58 devstack sudo[102320]: pam_unix(sudo:session): session closed for user root Sep 17 22:07:58 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-9374ac10-cd97-4e65-9a12-10b59ca146c3 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.423s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:07:58 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-9374ac10-cd97-4e65-9a12-10b59ca146c3 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:07:58 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-9374ac10-cd97-4e65-9a12-10b59ca146c3 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Deleted volume successfully. Sep 17 22:07:58 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-9374ac10-cd97-4e65-9a12-10b59ca146c3 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Lock "cinder-46c7c4d1-c3cc-4a33-926a-9d3573fdccd6-delete_volume" released by "delete_volume" :: held 1.447s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:07:58 devstack sudo[102328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-09bfcdfa-54af-41a0-9bb7-27ee8b6c5989 Sep 17 22:07:58 devstack sudo[102328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:07:59 devstack sudo[102328]: pam_unix(sudo:session): session closed for user root Sep 17 22:07:59 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-69558818-4f3c-44c0-9706-935f02d9924f tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-09bfcdfa-54af-41a0-9bb7-27ee8b6c5989" returned: 0 in 0.408s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:07:59 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-69558818-4f3c-44c0-9706-935f02d9924f tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-09bfcdfa-54af-41a0-9bb7-27ee8b6c5989 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:07:59 devstack sudo[102333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-09bfcdfa-54af-41a0-9bb7-27ee8b6c5989 Sep 17 22:07:59 devstack sudo[102333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:07:59 devstack sudo[102333]: pam_unix(sudo:session): session closed for user root Sep 17 22:07:59 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-69558818-4f3c-44c0-9706-935f02d9924f tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-09bfcdfa-54af-41a0-9bb7-27ee8b6c5989" returned: 0 in 0.273s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:07:59 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-69558818-4f3c-44c0-9706-935f02d9924f tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Lock "cinder-quobyte-09bfcdfa-54af-41a0-9bb7-27ee8b6c5989" released by "delete_volume" :: held 0.754s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:07:59 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-69558818-4f3c-44c0-9706-935f02d9924f tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Created reservations ['b65ac0b8-d4b9-4ab1-bb22-a406444a76b6', '5b586889-17b5-4b7f-8ece-7f281d8312cf', '3d441fd3-78d6-4fcc-a610-e7108ef92942', '1b8ad110-2ac6-4f83-89a9-8cad94e37f39'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:07:59 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-69558818-4f3c-44c0-9706-935f02d9924f tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:07:59 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-69558818-4f3c-44c0-9706-935f02d9924f tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:07:59 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-69558818-4f3c-44c0-9706-935f02d9924f tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:07:59 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-69558818-4f3c-44c0-9706-935f02d9924f tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:07:59 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-69558818-4f3c-44c0-9706-935f02d9924f tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:07:59 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-69558818-4f3c-44c0-9706-935f02d9924f tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:07:59 devstack sudo[102337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:07:59 devstack sudo[102337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:07:59 devstack sudo[102337]: pam_unix(sudo:session): session closed for user root Sep 17 22:07:59 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-69558818-4f3c-44c0-9706-935f02d9924f tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.260s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:07:59 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-69558818-4f3c-44c0-9706-935f02d9924f tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:07:59 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-2b43700e-b545-40ba-a595-fb089d18314a tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Acquiring lock "cinder-df2a272a-1aef-4ccd-8de4-b16427bd257e-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:07:59 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-69558818-4f3c-44c0-9706-935f02d9924f tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Deleted volume successfully. Sep 17 22:07:59 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-2b43700e-b545-40ba-a595-fb089d18314a tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Lock "cinder-df2a272a-1aef-4ccd-8de4-b16427bd257e-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:07:59 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-69558818-4f3c-44c0-9706-935f02d9924f tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Lock "cinder-09bfcdfa-54af-41a0-9bb7-27ee8b6c5989-delete_volume" released by "delete_volume" :: held 1.280s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:07:59 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-2b43700e-b545-40ba-a595-fb089d18314a tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Acquiring lock "cinder-quobyte-df2a272a-1aef-4ccd-8de4-b16427bd257e" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:07:59 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-2b43700e-b545-40ba-a595-fb089d18314a tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Lock "cinder-quobyte-df2a272a-1aef-4ccd-8de4-b16427bd257e" acquired by "delete_volume" :: waited 0.019s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:07:59 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8d07345-a70c-4892-a950-f1ad5cdc26bd]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:07:59 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-2b43700e-b545-40ba-a595-fb089d18314a tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-df2a272a-1aef-4ccd-8de4-b16427bd257e {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:07:59 devstack sudo[102340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-df2a272a-1aef-4ccd-8de4-b16427bd257e Sep 17 22:07:59 devstack sudo[102340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:08:00 devstack sudo[102340]: pam_unix(sudo:session): session closed for user root Sep 17 22:08:00 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-2b43700e-b545-40ba-a595-fb089d18314a tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-df2a272a-1aef-4ccd-8de4-b16427bd257e" returned: 0 in 0.386s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:08:00 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-2b43700e-b545-40ba-a595-fb089d18314a tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-df2a272a-1aef-4ccd-8de4-b16427bd257e {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:08:00 devstack sudo[102346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-df2a272a-1aef-4ccd-8de4-b16427bd257e Sep 17 22:08:00 devstack sudo[102346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:08:00 devstack sudo[102346]: pam_unix(sudo:session): session closed for user root Sep 17 22:08:00 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-2b43700e-b545-40ba-a595-fb089d18314a tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-df2a272a-1aef-4ccd-8de4-b16427bd257e" returned: 0 in 0.282s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:08:00 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-2b43700e-b545-40ba-a595-fb089d18314a tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Lock "cinder-quobyte-df2a272a-1aef-4ccd-8de4-b16427bd257e" released by "delete_volume" :: held 0.730s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:08:00 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-2b43700e-b545-40ba-a595-fb089d18314a tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Created reservations ['fff53349-004e-4119-beb4-d3d46419898f', 'cbeb410e-e799-4e69-9b1a-e82cbd421eb3', 'f0b060ae-91e7-4ac2-95b8-747e39d331ab', '174ae735-69bd-47f6-81dd-3146e01e7134'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:08:00 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-2b43700e-b545-40ba-a595-fb089d18314a tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:08:00 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-2b43700e-b545-40ba-a595-fb089d18314a tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:08:00 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-2b43700e-b545-40ba-a595-fb089d18314a tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:08:00 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-2b43700e-b545-40ba-a595-fb089d18314a tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:08:00 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-2b43700e-b545-40ba-a595-fb089d18314a tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:08:00 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-2b43700e-b545-40ba-a595-fb089d18314a tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:08:00 devstack sudo[102371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:08:00 devstack sudo[102371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:08:01 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-bdc9c39c-205f-4a31-a59c-0cd3b2c4bbb4 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Acquiring lock "cinder-36f5ad83-8f19-48b8-83ca-8f14e75a15f5-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:08:01 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-bdc9c39c-205f-4a31-a59c-0cd3b2c4bbb4 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Lock "cinder-36f5ad83-8f19-48b8-83ca-8f14e75a15f5-delete_volume" acquired by "delete_volume" :: waited 0.155s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:08:01 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-bdc9c39c-205f-4a31-a59c-0cd3b2c4bbb4 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Acquiring lock "cinder-quobyte-36f5ad83-8f19-48b8-83ca-8f14e75a15f5" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:08:01 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-bdc9c39c-205f-4a31-a59c-0cd3b2c4bbb4 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Lock "cinder-quobyte-36f5ad83-8f19-48b8-83ca-8f14e75a15f5" acquired by "delete_volume" :: waited 0.039s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:08:01 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[495a992a-ab5d-4ee9-a862-7433cd1cd1ac]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:08:01 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-bdc9c39c-205f-4a31-a59c-0cd3b2c4bbb4 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-36f5ad83-8f19-48b8-83ca-8f14e75a15f5 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:08:01 devstack sudo[102371]: pam_unix(sudo:session): session closed for user root Sep 17 22:08:01 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-2b43700e-b545-40ba-a595-fb089d18314a tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.591s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:08:01 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-2b43700e-b545-40ba-a595-fb089d18314a tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:08:01 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-2b43700e-b545-40ba-a595-fb089d18314a tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Deleted volume successfully. Sep 17 22:08:01 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-2b43700e-b545-40ba-a595-fb089d18314a tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Lock "cinder-df2a272a-1aef-4ccd-8de4-b16427bd257e-delete_volume" released by "delete_volume" :: held 1.744s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:08:01 devstack sudo[102406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-36f5ad83-8f19-48b8-83ca-8f14e75a15f5 Sep 17 22:08:01 devstack sudo[102406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:08:01 devstack sudo[102406]: pam_unix(sudo:session): session closed for user root Sep 17 22:08:01 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-bdc9c39c-205f-4a31-a59c-0cd3b2c4bbb4 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-36f5ad83-8f19-48b8-83ca-8f14e75a15f5" returned: 0 in 0.617s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:08:01 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-bdc9c39c-205f-4a31-a59c-0cd3b2c4bbb4 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-36f5ad83-8f19-48b8-83ca-8f14e75a15f5 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:08:02 devstack sudo[102424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-36f5ad83-8f19-48b8-83ca-8f14e75a15f5 Sep 17 22:08:02 devstack sudo[102424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:08:02 devstack sudo[102424]: pam_unix(sudo:session): session closed for user root Sep 17 22:08:02 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-bdc9c39c-205f-4a31-a59c-0cd3b2c4bbb4 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-36f5ad83-8f19-48b8-83ca-8f14e75a15f5" returned: 0 in 0.271s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:08:02 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-bdc9c39c-205f-4a31-a59c-0cd3b2c4bbb4 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Lock "cinder-quobyte-36f5ad83-8f19-48b8-83ca-8f14e75a15f5" released by "delete_volume" :: held 0.989s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:08:02 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-bdc9c39c-205f-4a31-a59c-0cd3b2c4bbb4 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Created reservations ['8790a9c3-990a-4675-ad1f-6d277f741e29', '6104b513-b2aa-4d7f-9eb0-3c365a1e8ead', '314d77af-a3da-41ff-9b94-89f5ab61ddf2', '04ada48d-d3a9-4877-8cbb-0695bef70822'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:08:02 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-bdc9c39c-205f-4a31-a59c-0cd3b2c4bbb4 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:08:02 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-bdc9c39c-205f-4a31-a59c-0cd3b2c4bbb4 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:08:02 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-bdc9c39c-205f-4a31-a59c-0cd3b2c4bbb4 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:08:02 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-bdc9c39c-205f-4a31-a59c-0cd3b2c4bbb4 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:08:02 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-bdc9c39c-205f-4a31-a59c-0cd3b2c4bbb4 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:08:02 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-bdc9c39c-205f-4a31-a59c-0cd3b2c4bbb4 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:08:02 devstack sudo[102429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:08:02 devstack sudo[102429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:08:02 devstack sudo[102429]: pam_unix(sudo:session): session closed for user root Sep 17 22:08:02 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-bdc9c39c-205f-4a31-a59c-0cd3b2c4bbb4 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.298s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:08:02 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-bdc9c39c-205f-4a31-a59c-0cd3b2c4bbb4 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:08:02 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-bdc9c39c-205f-4a31-a59c-0cd3b2c4bbb4 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Deleted volume successfully. Sep 17 22:08:02 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-bdc9c39c-205f-4a31-a59c-0cd3b2c4bbb4 tempest-CreateVolumesFromSourceVolumeTest-1404758084 None] Lock "cinder-36f5ad83-8f19-48b8-83ca-8f14e75a15f5-delete_volume" released by "delete_volume" :: held 1.600s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:08:06 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-219c7bf8-7d4e-4f3c-8fc7-bad47f8be4dc tempest-VolumeDependencyTests-1576157633 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 22:08:06 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-219c7bf8-7d4e-4f3c-8fc7-bad47f8be4dc tempest-VolumeDependencyTests-1576157633 None] Flow 'volume_create_manager' (d355d0bc-de2a-47cc-839d-51ce8b976678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:08:06 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-219c7bf8-7d4e-4f3c-8fc7-bad47f8be4dc tempest-VolumeDependencyTests-1576157633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d9acd8f-5e80-4a27-a431-5d0c05711e50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:08:06 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-219c7bf8-7d4e-4f3c-8fc7-bad47f8be4dc tempest-VolumeDependencyTests-1576157633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d9acd8f-5e80-4a27-a431-5d0c05711e50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:08:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1313449790',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4baebf5-9190-403c-b335-de97fff4c901,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='affbbe9ecd734f1ab683cc98eeb2f984',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:08:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:08:07Z,use_quota=True,user_id='45daa0519c9f4ca6bffecad0a7d22b87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:08:06 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-219c7bf8-7d4e-4f3c-8fc7-bad47f8be4dc tempest-VolumeDependencyTests-1576157633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcb7b8fd-a1f7-4bc4-93e6-4b28d20938b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:08:06 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-219c7bf8-7d4e-4f3c-8fc7-bad47f8be4dc tempest-VolumeDependencyTests-1576157633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcb7b8fd-a1f7-4bc4-93e6-4b28d20938b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:08:06 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-219c7bf8-7d4e-4f3c-8fc7-bad47f8be4dc tempest-VolumeDependencyTests-1576157633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6eb4f4c-9d55-42ca-b4eb-4064abf664f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:08:06 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-219c7bf8-7d4e-4f3c-8fc7-bad47f8be4dc tempest-VolumeDependencyTests-1576157633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6eb4f4c-9d55-42ca-b4eb-4064abf664f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4baebf5-9190-403c-b335-de97fff4c901', 'volume_name': 'volume-e4baebf5-9190-403c-b335-de97fff4c901', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:08:06 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-219c7bf8-7d4e-4f3c-8fc7-bad47f8be4dc tempest-VolumeDependencyTests-1576157633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8828885-0b52-4b84-bfb9-e98eb5c6192c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:08:06 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-219c7bf8-7d4e-4f3c-8fc7-bad47f8be4dc tempest-VolumeDependencyTests-1576157633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8828885-0b52-4b84-bfb9-e98eb5c6192c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:08:06 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-219c7bf8-7d4e-4f3c-8fc7-bad47f8be4dc tempest-VolumeDependencyTests-1576157633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a17255f-dc75-48e3-97e9-dcb6cf849660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:08:06 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-219c7bf8-7d4e-4f3c-8fc7-bad47f8be4dc tempest-VolumeDependencyTests-1576157633 None] Volume e4baebf5-9190-403c-b335-de97fff4c901: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4baebf5-9190-403c-b335-de97fff4c901', 'volume_size': 1} Sep 17 22:08:06 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-219c7bf8-7d4e-4f3c-8fc7-bad47f8be4dc tempest-VolumeDependencyTests-1576157633 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:08:06 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-219c7bf8-7d4e-4f3c-8fc7-bad47f8be4dc tempest-VolumeDependencyTests-1576157633 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:08:06 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-219c7bf8-7d4e-4f3c-8fc7-bad47f8be4dc tempest-VolumeDependencyTests-1576157633 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:08:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1313449790',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4baebf5-9190-403c-b335-de97fff4c901,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='affbbe9ecd734f1ab683cc98eeb2f984',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:08:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:08:07Z,use_quota=True,user_id='45daa0519c9f4ca6bffecad0a7d22b87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 22:08:06 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-219c7bf8-7d4e-4f3c-8fc7-bad47f8be4dc tempest-VolumeDependencyTests-1576157633 None] Creating volume e4baebf5-9190-403c-b335-de97fff4c901 {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 22:08:06 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-219c7bf8-7d4e-4f3c-8fc7-bad47f8be4dc tempest-VolumeDependencyTests-1576157633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:08:06 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-219c7bf8-7d4e-4f3c-8fc7-bad47f8be4dc tempest-VolumeDependencyTests-1576157633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:08:06 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-219c7bf8-7d4e-4f3c-8fc7-bad47f8be4dc tempest-VolumeDependencyTests-1576157633 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:08:06 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-219c7bf8-7d4e-4f3c-8fc7-bad47f8be4dc tempest-VolumeDependencyTests-1576157633 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:08:06 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-219c7bf8-7d4e-4f3c-8fc7-bad47f8be4dc tempest-VolumeDependencyTests-1576157633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:08:06 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-219c7bf8-7d4e-4f3c-8fc7-bad47f8be4dc tempest-VolumeDependencyTests-1576157633 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 22:08:06 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-219c7bf8-7d4e-4f3c-8fc7-bad47f8be4dc tempest-VolumeDependencyTests-1576157633 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 22:08:06 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-219c7bf8-7d4e-4f3c-8fc7-bad47f8be4dc tempest-VolumeDependencyTests-1576157633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e4baebf5-9190-403c-b335-de97fff4c901 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:08:06 devstack sudo[102434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e4baebf5-9190-403c-b335-de97fff4c901 1073741824 Sep 17 22:08:06 devstack sudo[102434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:08:07 devstack sudo[102434]: pam_unix(sudo:session): session closed for user root Sep 17 22:08:07 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-219c7bf8-7d4e-4f3c-8fc7-bad47f8be4dc tempest-VolumeDependencyTests-1576157633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e4baebf5-9190-403c-b335-de97fff4c901 1073741824" returned: 0 in 0.430s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:08:07 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-219c7bf8-7d4e-4f3c-8fc7-bad47f8be4dc tempest-VolumeDependencyTests-1576157633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e4baebf5-9190-403c-b335-de97fff4c901 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:08:07 devstack sudo[102440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e4baebf5-9190-403c-b335-de97fff4c901 Sep 17 22:08:07 devstack sudo[102440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:08:07 devstack sudo[102440]: pam_unix(sudo:session): session closed for user root Sep 17 22:08:07 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-219c7bf8-7d4e-4f3c-8fc7-bad47f8be4dc tempest-VolumeDependencyTests-1576157633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e4baebf5-9190-403c-b335-de97fff4c901" returned: 0 in 0.250s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:08:07 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-219c7bf8-7d4e-4f3c-8fc7-bad47f8be4dc tempest-VolumeDependencyTests-1576157633 None] <== create_volume: return (731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 22:08:07 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-219c7bf8-7d4e-4f3c-8fc7-bad47f8be4dc tempest-VolumeDependencyTests-1576157633 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.735s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:08:07 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-219c7bf8-7d4e-4f3c-8fc7-bad47f8be4dc tempest-VolumeDependencyTests-1576157633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a17255f-dc75-48e3-97e9-dcb6cf849660) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4baebf5-9190-403c-b335-de97fff4c901', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:08:07 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-219c7bf8-7d4e-4f3c-8fc7-bad47f8be4dc tempest-VolumeDependencyTests-1576157633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04094c4b-04d1-4b93-90b6-3d678900430f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:08:07 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-219c7bf8-7d4e-4f3c-8fc7-bad47f8be4dc tempest-VolumeDependencyTests-1576157633 None] Volume volume-e4baebf5-9190-403c-b335-de97fff4c901 (e4baebf5-9190-403c-b335-de97fff4c901): created successfully Sep 17 22:08:07 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-219c7bf8-7d4e-4f3c-8fc7-bad47f8be4dc tempest-VolumeDependencyTests-1576157633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04094c4b-04d1-4b93-90b6-3d678900430f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:08:07 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-219c7bf8-7d4e-4f3c-8fc7-bad47f8be4dc tempest-VolumeDependencyTests-1576157633 None] Flow 'volume_create_manager' (d355d0bc-de2a-47cc-839d-51ce8b976678) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:08:07 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-219c7bf8-7d4e-4f3c-8fc7-bad47f8be4dc tempest-VolumeDependencyTests-1576157633 None] Created volume successfully. Sep 17 22:08:07 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-391e5e3d-71b2-4f4d-a034-f1895e3f38d3 tempest-VolumeDependencyTests-1576157633 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:08:07 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-391e5e3d-71b2-4f4d-a034-f1895e3f38d3 tempest-VolumeDependencyTests-1576157633 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:08:07 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-391e5e3d-71b2-4f4d-a034-f1895e3f38d3 tempest-VolumeDependencyTests-1576157633 None] Creating offline snapshot 3b7e8064-a055-4933-9468-cc764affa81a of volume e4baebf5-9190-403c-b335-de97fff4c901 {{(pid=85458) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 22:08:07 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[754080ef-ca86-42d4-8925-1ee4349c4e4c]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:08:07 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-391e5e3d-71b2-4f4d-a034-f1895e3f38d3 tempest-VolumeDependencyTests-1576157633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e4baebf5-9190-403c-b335-de97fff4c901 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:08:08 devstack sudo[102443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e4baebf5-9190-403c-b335-de97fff4c901 Sep 17 22:08:08 devstack sudo[102443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:08:08 devstack sudo[102443]: pam_unix(sudo:session): session closed for user root Sep 17 22:08:08 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-391e5e3d-71b2-4f4d-a034-f1895e3f38d3 tempest-VolumeDependencyTests-1576157633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e4baebf5-9190-403c-b335-de97fff4c901" returned: 0 in 0.367s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:08:08 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-391e5e3d-71b2-4f4d-a034-f1895e3f38d3 tempest-VolumeDependencyTests-1576157633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e4baebf5-9190-403c-b335-de97fff4c901,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e4baebf5-9190-403c-b335-de97fff4c901.3b7e8064-a055-4933-9468-cc764affa81a 1G {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:08:08 devstack sudo[102448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e4baebf5-9190-403c-b335-de97fff4c901,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e4baebf5-9190-403c-b335-de97fff4c901.3b7e8064-a055-4933-9468-cc764affa81a 1G Sep 17 22:08:08 devstack sudo[102448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:08:08 devstack sudo[102448]: pam_unix(sudo:session): session closed for user root Sep 17 22:08:08 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-391e5e3d-71b2-4f4d-a034-f1895e3f38d3 tempest-VolumeDependencyTests-1576157633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e4baebf5-9190-403c-b335-de97fff4c901,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e4baebf5-9190-403c-b335-de97fff4c901.3b7e8064-a055-4933-9468-cc764affa81a 1G" returned: 0 in 0.406s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:08:08 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-391e5e3d-71b2-4f4d-a034-f1895e3f38d3 tempest-VolumeDependencyTests-1576157633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4baebf5-9190-403c-b335-de97fff4c901 -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e4baebf5-9190-403c-b335-de97fff4c901.3b7e8064-a055-4933-9468-cc764affa81a {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:08:08 devstack sudo[102453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4baebf5-9190-403c-b335-de97fff4c901 -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e4baebf5-9190-403c-b335-de97fff4c901.3b7e8064-a055-4933-9468-cc764affa81a Sep 17 22:08:08 devstack sudo[102453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:08:08 devstack sudo[102453]: pam_unix(sudo:session): session closed for user root Sep 17 22:08:08 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-391e5e3d-71b2-4f4d-a034-f1895e3f38d3 tempest-VolumeDependencyTests-1576157633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4baebf5-9190-403c-b335-de97fff4c901 -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e4baebf5-9190-403c-b335-de97fff4c901.3b7e8064-a055-4933-9468-cc764affa81a" returned: 0 in 0.290s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:08:08 devstack cinder-volume[85458]: WARNING cinder.volume.drivers.remotefs [None req-391e5e3d-71b2-4f4d-a034-f1895e3f38d3 tempest-VolumeDependencyTests-1576157633 None] /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e4baebf5-9190-403c-b335-de97fff4c901.3b7e8064-a055-4933-9468-cc764affa81a is being set with open permissions: ugo+rw Sep 17 22:08:08 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-391e5e3d-71b2-4f4d-a034-f1895e3f38d3 tempest-VolumeDependencyTests-1576157633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e4baebf5-9190-403c-b335-de97fff4c901.3b7e8064-a055-4933-9468-cc764affa81a {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:08:09 devstack sudo[102458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e4baebf5-9190-403c-b335-de97fff4c901.3b7e8064-a055-4933-9468-cc764affa81a Sep 17 22:08:09 devstack sudo[102458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:08:09 devstack sudo[102458]: pam_unix(sudo:session): session closed for user root Sep 17 22:08:09 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-391e5e3d-71b2-4f4d-a034-f1895e3f38d3 tempest-VolumeDependencyTests-1576157633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e4baebf5-9190-403c-b335-de97fff4c901.3b7e8064-a055-4933-9468-cc764affa81a" returned: 0 in 0.248s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:08:09 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-391e5e3d-71b2-4f4d-a034-f1895e3f38d3 tempest-VolumeDependencyTests-1576157633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e4baebf5-9190-403c-b335-de97fff4c901.info {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:08:09 devstack sudo[102461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e4baebf5-9190-403c-b335-de97fff4c901.info Sep 17 22:08:09 devstack sudo[102461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:08:09 devstack sudo[102461]: pam_unix(sudo:session): session closed for user root Sep 17 22:08:09 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-391e5e3d-71b2-4f4d-a034-f1895e3f38d3 tempest-VolumeDependencyTests-1576157633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e4baebf5-9190-403c-b335-de97fff4c901.info" returned: 0 in 0.249s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:08:09 devstack cinder-volume[85458]: WARNING cinder.volume.drivers.remotefs [None req-391e5e3d-71b2-4f4d-a034-f1895e3f38d3 tempest-VolumeDependencyTests-1576157633 None] /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e4baebf5-9190-403c-b335-de97fff4c901.info is being set with open permissions: ugo+rw Sep 17 22:08:09 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-391e5e3d-71b2-4f4d-a034-f1895e3f38d3 tempest-VolumeDependencyTests-1576157633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e4baebf5-9190-403c-b335-de97fff4c901.info {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:08:09 devstack sudo[102465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e4baebf5-9190-403c-b335-de97fff4c901.info Sep 17 22:08:09 devstack sudo[102465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:08:09 devstack sudo[102465]: pam_unix(sudo:session): session closed for user root Sep 17 22:08:09 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-391e5e3d-71b2-4f4d-a034-f1895e3f38d3 tempest-VolumeDependencyTests-1576157633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e4baebf5-9190-403c-b335-de97fff4c901.info" returned: 0 in 0.245s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:08:09 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-391e5e3d-71b2-4f4d-a034-f1895e3f38d3 tempest-VolumeDependencyTests-1576157633 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.920s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:08:09 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-391e5e3d-71b2-4f4d-a034-f1895e3f38d3 tempest-VolumeDependencyTests-1576157633 None] Create snapshot completed successfully Sep 17 22:08:10 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-b660fca4-2c50-4f3b-ab99-32c46faf75e2 tempest-VolumeDependencyTests-1576157633 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 22:08:10 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b660fca4-2c50-4f3b-ab99-32c46faf75e2 tempest-VolumeDependencyTests-1576157633 None] Flow 'volume_create_manager' (acda5ff0-99b6-4fc1-8ac3-e7624648e4a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:08:10 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b660fca4-2c50-4f3b-ab99-32c46faf75e2 tempest-VolumeDependencyTests-1576157633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f32bc752-6d80-4679-8c01-021e41e3a435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:08:10 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b660fca4-2c50-4f3b-ab99-32c46faf75e2 tempest-VolumeDependencyTests-1576157633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f32bc752-6d80-4679-8c01-021e41e3a435) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:08:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2036449767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf4e5785-21b6-486b-a681-cd310e31314e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='affbbe9ecd734f1ab683cc98eeb2f984',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:08:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3b7e8064-a055-4933-9468-cc764affa81a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:08:10Z,use_quota=True,user_id='45daa0519c9f4ca6bffecad0a7d22b87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:08:10 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b660fca4-2c50-4f3b-ab99-32c46faf75e2 tempest-VolumeDependencyTests-1576157633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ab76b35-5b98-4738-9d40-2a1e739e697b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:08:10 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b660fca4-2c50-4f3b-ab99-32c46faf75e2 tempest-VolumeDependencyTests-1576157633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ab76b35-5b98-4738-9d40-2a1e739e697b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:08:10 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b660fca4-2c50-4f3b-ab99-32c46faf75e2 tempest-VolumeDependencyTests-1576157633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4455a39a-2930-464d-8074-4d6fda347512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:08:10 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b660fca4-2c50-4f3b-ab99-32c46faf75e2 tempest-VolumeDependencyTests-1576157633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4455a39a-2930-464d-8074-4d6fda347512) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'cf4e5785-21b6-486b-a681-cd310e31314e', 'volume_name': 'volume-cf4e5785-21b6-486b-a681-cd310e31314e', 'volume_size': 1, 'snapshot_id': '3b7e8064-a055-4933-9468-cc764affa81a'}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:08:10 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b660fca4-2c50-4f3b-ab99-32c46faf75e2 tempest-VolumeDependencyTests-1576157633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cb9d08b-369a-4f5b-8b76-fc6e5846a82c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:08:10 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b660fca4-2c50-4f3b-ab99-32c46faf75e2 tempest-VolumeDependencyTests-1576157633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cb9d08b-369a-4f5b-8b76-fc6e5846a82c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:08:10 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b660fca4-2c50-4f3b-ab99-32c46faf75e2 tempest-VolumeDependencyTests-1576157633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e32ef472-c3e7-4827-b7e7-a1f192433756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:08:10 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-b660fca4-2c50-4f3b-ab99-32c46faf75e2 tempest-VolumeDependencyTests-1576157633 None] Volume cf4e5785-21b6-486b-a681-cd310e31314e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-cf4e5785-21b6-486b-a681-cd310e31314e', 'volume_size': 1, 'snapshot_id': '3b7e8064-a055-4933-9468-cc764affa81a'} Sep 17 22:08:10 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-b660fca4-2c50-4f3b-ab99-32c46faf75e2 tempest-VolumeDependencyTests-1576157633 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:08:10 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-b660fca4-2c50-4f3b-ab99-32c46faf75e2 tempest-VolumeDependencyTests-1576157633 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:08:10 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-b660fca4-2c50-4f3b-ab99-32c46faf75e2 tempest-VolumeDependencyTests-1576157633 None] Acquiring lock "cinder-quobyte-3b7e8064-a055-4933-9468-cc764affa81a-cf4e5785-21b6-486b-a681-cd310e31314e" by "_create_volume_from_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:08:10 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-b660fca4-2c50-4f3b-ab99-32c46faf75e2 tempest-VolumeDependencyTests-1576157633 None] Lock "cinder-quobyte-3b7e8064-a055-4933-9468-cc764affa81a-cf4e5785-21b6-486b-a681-cd310e31314e" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:08:10 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-b660fca4-2c50-4f3b-ab99-32c46faf75e2 tempest-VolumeDependencyTests-1576157633 None] Creating volume cf4e5785-21b6-486b-a681-cd310e31314e from snapshot 3b7e8064-a055-4933-9468-cc764affa81a {{(pid=85458) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 17 22:08:10 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-b660fca4-2c50-4f3b-ab99-32c46faf75e2 tempest-VolumeDependencyTests-1576157633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:08:10 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-b660fca4-2c50-4f3b-ab99-32c46faf75e2 tempest-VolumeDependencyTests-1576157633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:08:10 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-b660fca4-2c50-4f3b-ab99-32c46faf75e2 tempest-VolumeDependencyTests-1576157633 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:08:10 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-b660fca4-2c50-4f3b-ab99-32c46faf75e2 tempest-VolumeDependencyTests-1576157633 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:08:10 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-b660fca4-2c50-4f3b-ab99-32c46faf75e2 tempest-VolumeDependencyTests-1576157633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:08:10 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-b660fca4-2c50-4f3b-ab99-32c46faf75e2 tempest-VolumeDependencyTests-1576157633 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 22:08:10 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-b660fca4-2c50-4f3b-ab99-32c46faf75e2 tempest-VolumeDependencyTests-1576157633 None] Acquiring lock "cinder-quobyte-cf4e5785-21b6-486b-a681-cd310e31314e" by "_copy_volume_from_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:08:10 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-b660fca4-2c50-4f3b-ab99-32c46faf75e2 tempest-VolumeDependencyTests-1576157633 None] Lock "cinder-quobyte-cf4e5785-21b6-486b-a681-cd310e31314e" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:08:10 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-b660fca4-2c50-4f3b-ab99-32c46faf75e2 tempest-VolumeDependencyTests-1576157633 None] snapshot: 3b7e8064-a055-4933-9468-cc764affa81a, volume: cf4e5785-21b6-486b-a681-cd310e31314e, {{(pid=85458) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 17 22:08:10 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-b660fca4-2c50-4f3b-ab99-32c46faf75e2 tempest-VolumeDependencyTests-1576157633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:08:10 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-b660fca4-2c50-4f3b-ab99-32c46faf75e2 tempest-VolumeDependencyTests-1576157633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:08:10 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-b660fca4-2c50-4f3b-ab99-32c46faf75e2 tempest-VolumeDependencyTests-1576157633 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:08:10 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-b660fca4-2c50-4f3b-ab99-32c46faf75e2 tempest-VolumeDependencyTests-1576157633 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:08:10 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-b660fca4-2c50-4f3b-ab99-32c46faf75e2 tempest-VolumeDependencyTests-1576157633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:08:10 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6c4c774-b4a8-4ece-82e7-b227489ee5a8]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:08:10 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-b660fca4-2c50-4f3b-ab99-32c46faf75e2 tempest-VolumeDependencyTests-1576157633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e4baebf5-9190-403c-b335-de97fff4c901.3b7e8064-a055-4933-9468-cc764affa81a {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:08:10 devstack sudo[102468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e4baebf5-9190-403c-b335-de97fff4c901.3b7e8064-a055-4933-9468-cc764affa81a Sep 17 22:08:10 devstack sudo[102468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:08:11 devstack sudo[102468]: pam_unix(sudo:session): session closed for user root Sep 17 22:08:11 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-b660fca4-2c50-4f3b-ab99-32c46faf75e2 tempest-VolumeDependencyTests-1576157633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e4baebf5-9190-403c-b335-de97fff4c901.3b7e8064-a055-4933-9468-cc764affa81a" returned: 0 in 0.386s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:08:11 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-b660fca4-2c50-4f3b-ab99-32c46faf75e2 tempest-VolumeDependencyTests-1576157633 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e4baebf5-9190-403c-b335-de97fff4c901(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85458) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 22:08:11 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c7f5612-c0d3-4361-9f85-9b01a2c0523c]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:08:11 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-b660fca4-2c50-4f3b-ab99-32c46faf75e2 tempest-VolumeDependencyTests-1576157633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e4baebf5-9190-403c-b335-de97fff4c901 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:08:11 devstack sudo[102473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e4baebf5-9190-403c-b335-de97fff4c901 Sep 17 22:08:11 devstack sudo[102473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:08:11 devstack sudo[102473]: pam_unix(sudo:session): session closed for user root Sep 17 22:08:11 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-b660fca4-2c50-4f3b-ab99-32c46faf75e2 tempest-VolumeDependencyTests-1576157633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e4baebf5-9190-403c-b335-de97fff4c901" returned: 0 in 0.383s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:08:11 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-b660fca4-2c50-4f3b-ab99-32c46faf75e2 tempest-VolumeDependencyTests-1576157633 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e4baebf5-9190-403c-b335-de97fff4c901 {{(pid=85458) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 17 22:08:11 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-b660fca4-2c50-4f3b-ab99-32c46faf75e2 tempest-VolumeDependencyTests-1576157633 None] Creating direct copy from snapshot {{(pid=85458) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 17 22:08:11 devstack cinder-volume[85458]: DEBUG cinder.utils [None req-b660fca4-2c50-4f3b-ab99-32c46faf75e2 tempest-VolumeDependencyTests-1576157633 None] Path /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cf4e5785-21b6-486b-a681-cd310e31314e not found in is_blk_device check {{(pid=85458) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 17 22:08:11 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-b660fca4-2c50-4f3b-ab99-32c46faf75e2 tempest-VolumeDependencyTests-1576157633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e4baebf5-9190-403c-b335-de97fff4c901 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cf4e5785-21b6-486b-a681-cd310e31314e {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:08:11 devstack sudo[102478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e4baebf5-9190-403c-b335-de97fff4c901 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cf4e5785-21b6-486b-a681-cd310e31314e Sep 17 22:08:11 devstack sudo[102478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:08:18 devstack sudo[102478]: pam_unix(sudo:session): session closed for user root Sep 17 22:08:18 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-b660fca4-2c50-4f3b-ab99-32c46faf75e2 tempest-VolumeDependencyTests-1576157633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e4baebf5-9190-403c-b335-de97fff4c901 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cf4e5785-21b6-486b-a681-cd310e31314e" returned: 0 in 6.690s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:08:18 devstack cinder-volume[85458]: DEBUG cinder.image.image_utils [None req-b660fca4-2c50-4f3b-ab99-32c46faf75e2 tempest-VolumeDependencyTests-1576157633 None] Image conversion details: src /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e4baebf5-9190-403c-b335-de97fff4c901, size 1024.00 MB, duration 6.69 sec, destination /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cf4e5785-21b6-486b-a681-cd310e31314e {{(pid=85458) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 17 22:08:18 devstack cinder-volume[85458]: INFO cinder.image.image_utils [None req-b660fca4-2c50-4f3b-ab99-32c46faf75e2 tempest-VolumeDependencyTests-1576157633 None] Converted 1024.00 MB image at 153.04 MB/s Sep 17 22:08:18 devstack cinder-volume[85458]: WARNING cinder.volume.drivers.remotefs [None req-b660fca4-2c50-4f3b-ab99-32c46faf75e2 tempest-VolumeDependencyTests-1576157633 None] /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cf4e5785-21b6-486b-a681-cd310e31314e is being set with open permissions: ugo+rw Sep 17 22:08:18 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-b660fca4-2c50-4f3b-ab99-32c46faf75e2 tempest-VolumeDependencyTests-1576157633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cf4e5785-21b6-486b-a681-cd310e31314e {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:08:18 devstack sudo[102512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cf4e5785-21b6-486b-a681-cd310e31314e Sep 17 22:08:18 devstack sudo[102512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:08:18 devstack sudo[102512]: pam_unix(sudo:session): session closed for user root Sep 17 22:08:18 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-b660fca4-2c50-4f3b-ab99-32c46faf75e2 tempest-VolumeDependencyTests-1576157633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cf4e5785-21b6-486b-a681-cd310e31314e" returned: 0 in 0.236s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:08:18 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-b660fca4-2c50-4f3b-ab99-32c46faf75e2 tempest-VolumeDependencyTests-1576157633 None] Lock "cinder-quobyte-cf4e5785-21b6-486b-a681-cd310e31314e" released by "_copy_volume_from_snapshot" :: held 7.787s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:08:18 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-b660fca4-2c50-4f3b-ab99-32c46faf75e2 tempest-VolumeDependencyTests-1576157633 None] Lock "cinder-quobyte-3b7e8064-a055-4933-9468-cc764affa81a-cf4e5785-21b6-486b-a681-cd310e31314e" released by "_create_volume_from_snapshot" :: held 7.850s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:08:18 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-b660fca4-2c50-4f3b-ab99-32c46faf75e2 tempest-VolumeDependencyTests-1576157633 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.868s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:08:18 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b660fca4-2c50-4f3b-ab99-32c46faf75e2 tempest-VolumeDependencyTests-1576157633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e32ef472-c3e7-4827-b7e7-a1f192433756) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf4e5785-21b6-486b-a681-cd310e31314e', 'volume_size': 1, 'snapshot_id': '3b7e8064-a055-4933-9468-cc764affa81a'}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:08:18 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b660fca4-2c50-4f3b-ab99-32c46faf75e2 tempest-VolumeDependencyTests-1576157633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37d5012a-d1fa-49f1-8754-675fa05e2326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:08:18 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-b660fca4-2c50-4f3b-ab99-32c46faf75e2 tempest-VolumeDependencyTests-1576157633 None] Volume volume-cf4e5785-21b6-486b-a681-cd310e31314e (cf4e5785-21b6-486b-a681-cd310e31314e): created successfully Sep 17 22:08:18 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b660fca4-2c50-4f3b-ab99-32c46faf75e2 tempest-VolumeDependencyTests-1576157633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37d5012a-d1fa-49f1-8754-675fa05e2326) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:08:18 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b660fca4-2c50-4f3b-ab99-32c46faf75e2 tempest-VolumeDependencyTests-1576157633 None] Flow 'volume_create_manager' (acda5ff0-99b6-4fc1-8ac3-e7624648e4a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:08:18 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-b660fca4-2c50-4f3b-ab99-32c46faf75e2 tempest-VolumeDependencyTests-1576157633 None] Created volume successfully. Sep 17 22:08:19 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-24f0d990-ca57-43d5-aa94-a3bdc9e95f3e tempest-VolumeDependencyTests-1576157633 None] Acquiring lock "cinder-3b7e8064-a055-4933-9468-cc764affa81a-delete_snapshot" by "delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:08:19 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-24f0d990-ca57-43d5-aa94-a3bdc9e95f3e tempest-VolumeDependencyTests-1576157633 None] Lock "cinder-3b7e8064-a055-4933-9468-cc764affa81a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:08:19 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-24f0d990-ca57-43d5-aa94-a3bdc9e95f3e tempest-VolumeDependencyTests-1576157633 None] Acquiring lock "cinder-quobyte-e4baebf5-9190-403c-b335-de97fff4c901" by "delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:08:19 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-24f0d990-ca57-43d5-aa94-a3bdc9e95f3e tempest-VolumeDependencyTests-1576157633 None] Lock "cinder-quobyte-e4baebf5-9190-403c-b335-de97fff4c901" acquired by "delete_snapshot" :: waited 0.014s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:08:19 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-24f0d990-ca57-43d5-aa94-a3bdc9e95f3e tempest-VolumeDependencyTests-1576157633 None] Acquiring lock "cinder-quobyte-3b7e8064-a055-4933-9468-cc764affa81a" by "_delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:08:19 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-24f0d990-ca57-43d5-aa94-a3bdc9e95f3e tempest-VolumeDependencyTests-1576157633 None] Lock "cinder-quobyte-3b7e8064-a055-4933-9468-cc764affa81a" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:08:19 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-24f0d990-ca57-43d5-aa94-a3bdc9e95f3e tempest-VolumeDependencyTests-1576157633 None] Deleting offline snapshot 3b7e8064-a055-4933-9468-cc764affa81a of volume e4baebf5-9190-403c-b335-de97fff4c901 {{(pid=85458) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 22:08:19 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-24f0d990-ca57-43d5-aa94-a3bdc9e95f3e tempest-VolumeDependencyTests-1576157633 None] snapshot_file for this snap is: volume-e4baebf5-9190-403c-b335-de97fff4c901.3b7e8064-a055-4933-9468-cc764affa81a {{(pid=85458) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 22:08:19 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[c58670d0-faa7-428d-9395-d6a5153c2f9a]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:08:19 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-24f0d990-ca57-43d5-aa94-a3bdc9e95f3e tempest-VolumeDependencyTests-1576157633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e4baebf5-9190-403c-b335-de97fff4c901.3b7e8064-a055-4933-9468-cc764affa81a {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:08:19 devstack sudo[102515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e4baebf5-9190-403c-b335-de97fff4c901.3b7e8064-a055-4933-9468-cc764affa81a Sep 17 22:08:19 devstack sudo[102515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:08:19 devstack sudo[102515]: pam_unix(sudo:session): session closed for user root Sep 17 22:08:19 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-24f0d990-ca57-43d5-aa94-a3bdc9e95f3e tempest-VolumeDependencyTests-1576157633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e4baebf5-9190-403c-b335-de97fff4c901.3b7e8064-a055-4933-9468-cc764affa81a" returned: 0 in 0.361s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:08:19 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-24f0d990-ca57-43d5-aa94-a3bdc9e95f3e tempest-VolumeDependencyTests-1576157633 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e4baebf5-9190-403c-b335-de97fff4c901(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85458) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 22:08:19 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f1375df-9667-4179-a9d1-fb3533246d57]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:08:19 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-24f0d990-ca57-43d5-aa94-a3bdc9e95f3e tempest-VolumeDependencyTests-1576157633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e4baebf5-9190-403c-b335-de97fff4c901 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:08:19 devstack sudo[102521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e4baebf5-9190-403c-b335-de97fff4c901 Sep 17 22:08:19 devstack sudo[102521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:08:20 devstack sudo[102521]: pam_unix(sudo:session): session closed for user root Sep 17 22:08:20 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-24f0d990-ca57-43d5-aa94-a3bdc9e95f3e tempest-VolumeDependencyTests-1576157633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e4baebf5-9190-403c-b335-de97fff4c901" returned: 0 in 0.511s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:08:20 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-24f0d990-ca57-43d5-aa94-a3bdc9e95f3e tempest-VolumeDependencyTests-1576157633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e4baebf5-9190-403c-b335-de97fff4c901.3b7e8064-a055-4933-9468-cc764affa81a {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:08:20 devstack sudo[102526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e4baebf5-9190-403c-b335-de97fff4c901.3b7e8064-a055-4933-9468-cc764affa81a Sep 17 22:08:20 devstack sudo[102526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:08:20 devstack sudo[102526]: pam_unix(sudo:session): session closed for user root Sep 17 22:08:20 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-24f0d990-ca57-43d5-aa94-a3bdc9e95f3e tempest-VolumeDependencyTests-1576157633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e4baebf5-9190-403c-b335-de97fff4c901.3b7e8064-a055-4933-9468-cc764affa81a" returned: 0 in 0.321s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:08:20 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-24f0d990-ca57-43d5-aa94-a3bdc9e95f3e tempest-VolumeDependencyTests-1576157633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e4baebf5-9190-403c-b335-de97fff4c901.3b7e8064-a055-4933-9468-cc764affa81a {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:08:20 devstack sudo[102532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e4baebf5-9190-403c-b335-de97fff4c901.3b7e8064-a055-4933-9468-cc764affa81a Sep 17 22:08:20 devstack sudo[102532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:08:20 devstack sudo[102532]: pam_unix(sudo:session): session closed for user root Sep 17 22:08:20 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-24f0d990-ca57-43d5-aa94-a3bdc9e95f3e tempest-VolumeDependencyTests-1576157633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e4baebf5-9190-403c-b335-de97fff4c901.3b7e8064-a055-4933-9468-cc764affa81a" returned: 0 in 0.255s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:08:20 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-24f0d990-ca57-43d5-aa94-a3bdc9e95f3e tempest-VolumeDependencyTests-1576157633 None] Lock "cinder-quobyte-3b7e8064-a055-4933-9468-cc764affa81a" released by "_delete_snapshot" :: held 1.558s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:08:20 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-24f0d990-ca57-43d5-aa94-a3bdc9e95f3e tempest-VolumeDependencyTests-1576157633 None] Lock "cinder-quobyte-e4baebf5-9190-403c-b335-de97fff4c901" released by "delete_snapshot" :: held 1.579s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:08:20 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-24f0d990-ca57-43d5-aa94-a3bdc9e95f3e tempest-VolumeDependencyTests-1576157633 None] Created reservations ['a9a46e69-624c-4728-a6af-bb7a882e6dcf', '31127b66-1c6c-4764-8210-a2bd722f3403', '1c0f7a9f-6278-4181-95d5-df48c9939b64', '3e4ab624-79fb-4e28-a5b4-7a51a7690ca2'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:08:20 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-24f0d990-ca57-43d5-aa94-a3bdc9e95f3e tempest-VolumeDependencyTests-1576157633 None] Delete snapshot completed successfully. Sep 17 22:08:20 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-24f0d990-ca57-43d5-aa94-a3bdc9e95f3e tempest-VolumeDependencyTests-1576157633 None] Lock "cinder-3b7e8064-a055-4933-9468-cc764affa81a-delete_snapshot" released by "delete_snapshot" :: held 1.714s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:08:21 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-88686377-be7d-4913-b23c-84c016d982e3 tempest-VolumeDependencyTests-1576157633 None] Acquiring lock "cinder-e4baebf5-9190-403c-b335-de97fff4c901-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:08:21 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-88686377-be7d-4913-b23c-84c016d982e3 tempest-VolumeDependencyTests-1576157633 None] Lock "cinder-e4baebf5-9190-403c-b335-de97fff4c901-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:08:21 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-88686377-be7d-4913-b23c-84c016d982e3 tempest-VolumeDependencyTests-1576157633 None] Acquiring lock "cinder-quobyte-e4baebf5-9190-403c-b335-de97fff4c901" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:08:21 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-88686377-be7d-4913-b23c-84c016d982e3 tempest-VolumeDependencyTests-1576157633 None] Lock "cinder-quobyte-e4baebf5-9190-403c-b335-de97fff4c901" acquired by "delete_volume" :: waited 0.019s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:08:21 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad1511be-bf6b-47b2-92ac-ec12e06fea8a]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:08:21 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-88686377-be7d-4913-b23c-84c016d982e3 tempest-VolumeDependencyTests-1576157633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e4baebf5-9190-403c-b335-de97fff4c901 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:08:21 devstack sudo[102535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e4baebf5-9190-403c-b335-de97fff4c901 Sep 17 22:08:21 devstack sudo[102535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:08:21 devstack sudo[102535]: pam_unix(sudo:session): session closed for user root Sep 17 22:08:21 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-88686377-be7d-4913-b23c-84c016d982e3 tempest-VolumeDependencyTests-1576157633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e4baebf5-9190-403c-b335-de97fff4c901" returned: 0 in 0.379s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:08:21 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-88686377-be7d-4913-b23c-84c016d982e3 tempest-VolumeDependencyTests-1576157633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e4baebf5-9190-403c-b335-de97fff4c901 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:08:21 devstack sudo[102540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e4baebf5-9190-403c-b335-de97fff4c901 Sep 17 22:08:21 devstack sudo[102540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:08:22 devstack sudo[102540]: pam_unix(sudo:session): session closed for user root Sep 17 22:08:22 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-88686377-be7d-4913-b23c-84c016d982e3 tempest-VolumeDependencyTests-1576157633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e4baebf5-9190-403c-b335-de97fff4c901" returned: 0 in 0.252s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:08:22 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-88686377-be7d-4913-b23c-84c016d982e3 tempest-VolumeDependencyTests-1576157633 None] Lock "cinder-quobyte-e4baebf5-9190-403c-b335-de97fff4c901" released by "delete_volume" :: held 0.699s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:08:22 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-88686377-be7d-4913-b23c-84c016d982e3 tempest-VolumeDependencyTests-1576157633 None] Created reservations ['e6746cce-198f-4d2a-b1bd-9296e66a3052', 'cef7d153-a78e-4b73-b92f-247e35329bde', '50ce7e4b-758a-456f-a33b-e08ebcb25c4a', '6458770d-859e-4a99-8a5e-e8efbff58e86'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:08:22 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-88686377-be7d-4913-b23c-84c016d982e3 tempest-VolumeDependencyTests-1576157633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:08:22 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-88686377-be7d-4913-b23c-84c016d982e3 tempest-VolumeDependencyTests-1576157633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:08:22 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-88686377-be7d-4913-b23c-84c016d982e3 tempest-VolumeDependencyTests-1576157633 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:08:22 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-88686377-be7d-4913-b23c-84c016d982e3 tempest-VolumeDependencyTests-1576157633 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:08:22 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-88686377-be7d-4913-b23c-84c016d982e3 tempest-VolumeDependencyTests-1576157633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:08:22 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-88686377-be7d-4913-b23c-84c016d982e3 tempest-VolumeDependencyTests-1576157633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:08:22 devstack sudo[102543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:08:22 devstack sudo[102543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:08:22 devstack sudo[102543]: pam_unix(sudo:session): session closed for user root Sep 17 22:08:22 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-88686377-be7d-4913-b23c-84c016d982e3 tempest-VolumeDependencyTests-1576157633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.258s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:08:22 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-88686377-be7d-4913-b23c-84c016d982e3 tempest-VolumeDependencyTests-1576157633 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:08:22 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-88686377-be7d-4913-b23c-84c016d982e3 tempest-VolumeDependencyTests-1576157633 None] Deleted volume successfully. Sep 17 22:08:22 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-4ef8143e-2f57-4c4e-872e-c6ada63e5823 tempest-VolumeDependencyTests-1576157633 None] Acquiring lock "cinder-cf4e5785-21b6-486b-a681-cd310e31314e-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:08:22 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-88686377-be7d-4913-b23c-84c016d982e3 tempest-VolumeDependencyTests-1576157633 None] Lock "cinder-e4baebf5-9190-403c-b335-de97fff4c901-delete_volume" released by "delete_volume" :: held 1.179s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:08:22 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-4ef8143e-2f57-4c4e-872e-c6ada63e5823 tempest-VolumeDependencyTests-1576157633 None] Lock "cinder-cf4e5785-21b6-486b-a681-cd310e31314e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:08:22 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-4ef8143e-2f57-4c4e-872e-c6ada63e5823 tempest-VolumeDependencyTests-1576157633 None] Acquiring lock "cinder-quobyte-cf4e5785-21b6-486b-a681-cd310e31314e" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:08:22 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-4ef8143e-2f57-4c4e-872e-c6ada63e5823 tempest-VolumeDependencyTests-1576157633 None] Lock "cinder-quobyte-cf4e5785-21b6-486b-a681-cd310e31314e" acquired by "delete_volume" :: waited 0.020s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:08:22 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc3f42b1-d71c-4d79-abfd-bf2235258064]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:08:22 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-4ef8143e-2f57-4c4e-872e-c6ada63e5823 tempest-VolumeDependencyTests-1576157633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cf4e5785-21b6-486b-a681-cd310e31314e {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:08:22 devstack sudo[102546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cf4e5785-21b6-486b-a681-cd310e31314e Sep 17 22:08:22 devstack sudo[102546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:08:22 devstack sudo[102546]: pam_unix(sudo:session): session closed for user root Sep 17 22:08:22 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-4ef8143e-2f57-4c4e-872e-c6ada63e5823 tempest-VolumeDependencyTests-1576157633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cf4e5785-21b6-486b-a681-cd310e31314e" returned: 0 in 0.363s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:08:22 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-4ef8143e-2f57-4c4e-872e-c6ada63e5823 tempest-VolumeDependencyTests-1576157633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cf4e5785-21b6-486b-a681-cd310e31314e {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:08:23 devstack sudo[102551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cf4e5785-21b6-486b-a681-cd310e31314e Sep 17 22:08:23 devstack sudo[102551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:08:23 devstack sudo[102551]: pam_unix(sudo:session): session closed for user root Sep 17 22:08:23 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-4ef8143e-2f57-4c4e-872e-c6ada63e5823 tempest-VolumeDependencyTests-1576157633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cf4e5785-21b6-486b-a681-cd310e31314e" returned: 0 in 0.239s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:08:23 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-4ef8143e-2f57-4c4e-872e-c6ada63e5823 tempest-VolumeDependencyTests-1576157633 None] Lock "cinder-quobyte-cf4e5785-21b6-486b-a681-cd310e31314e" released by "delete_volume" :: held 0.644s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:08:23 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-4ef8143e-2f57-4c4e-872e-c6ada63e5823 tempest-VolumeDependencyTests-1576157633 None] Created reservations ['f3ea074b-44b3-4d02-917f-ac892e87dbc3', 'a2ada513-31df-402b-b9fb-fcbb0f8481e5', '1be17628-ee79-47af-b4b9-a5a69feefe4b', 'f4ce30ef-4702-4fef-bd04-4fe9be863a4f'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:08:23 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-4ef8143e-2f57-4c4e-872e-c6ada63e5823 tempest-VolumeDependencyTests-1576157633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:08:23 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-4ef8143e-2f57-4c4e-872e-c6ada63e5823 tempest-VolumeDependencyTests-1576157633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:08:23 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-4ef8143e-2f57-4c4e-872e-c6ada63e5823 tempest-VolumeDependencyTests-1576157633 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:08:23 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-4ef8143e-2f57-4c4e-872e-c6ada63e5823 tempest-VolumeDependencyTests-1576157633 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:08:23 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-4ef8143e-2f57-4c4e-872e-c6ada63e5823 tempest-VolumeDependencyTests-1576157633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:08:23 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-4ef8143e-2f57-4c4e-872e-c6ada63e5823 tempest-VolumeDependencyTests-1576157633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:08:23 devstack sudo[102554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:08:23 devstack sudo[102554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:08:23 devstack sudo[102554]: pam_unix(sudo:session): session closed for user root Sep 17 22:08:23 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-4ef8143e-2f57-4c4e-872e-c6ada63e5823 tempest-VolumeDependencyTests-1576157633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.247s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:08:23 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-4ef8143e-2f57-4c4e-872e-c6ada63e5823 tempest-VolumeDependencyTests-1576157633 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:08:23 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-4ef8143e-2f57-4c4e-872e-c6ada63e5823 tempest-VolumeDependencyTests-1576157633 None] Deleted volume successfully. Sep 17 22:08:23 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-4ef8143e-2f57-4c4e-872e-c6ada63e5823 tempest-VolumeDependencyTests-1576157633 None] Lock "cinder-cf4e5785-21b6-486b-a681-cd310e31314e-delete_volume" released by "delete_volume" :: held 1.083s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:08:26 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [req-3b90cf05-7c6d-461d-b82e-d202e95bf104 req-d9354f58-7f44-4069-94db-ce79f79c5259 tempest-TestStampPattern-697373642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:08:26 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [req-3b90cf05-7c6d-461d-b82e-d202e95bf104 req-d9354f58-7f44-4069-94db-ce79f79c5259 tempest-TestStampPattern-697373642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:08:26 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [req-3b90cf05-7c6d-461d-b82e-d202e95bf104 req-d9354f58-7f44-4069-94db-ce79f79c5259 tempest-TestStampPattern-697373642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:08:26 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [req-3b90cf05-7c6d-461d-b82e-d202e95bf104 req-d9354f58-7f44-4069-94db-ce79f79c5259 tempest-TestStampPattern-697373642 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5', 'name': 'volume-8fdddd6e-df91-4f6e-bb35-5a58bd44e4a8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c7bc6be7-ad86-43b3-974f-bf2ab8fa7eb3', 'enforce_multipath': True} {{(pid=85458) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 22:08:26 devstack cinder-volume[85458]: INFO cinder.volume.manager [req-3b90cf05-7c6d-461d-b82e-d202e95bf104 req-d9354f58-7f44-4069-94db-ce79f79c5259 tempest-TestStampPattern-697373642 None] attachment_update completed successfully. Sep 17 22:08:27 devstack cinder-volume[85458]: DEBUG oslo_service.periodic_task [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85458) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 22:08:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:08:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:08:27 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:08:27 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:08:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:08:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:08:27 devstack sudo[103031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:08:27 devstack sudo[103031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:08:28 devstack sudo[103031]: pam_unix(sudo:session): session closed for user root Sep 17 22:08:28 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.258s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:08:28 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:08:28 devstack cinder-volume[85458]: DEBUG oslo_service.periodic_task [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Running periodic task VolumeManager._thread_info {{(pid=85458) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 22:08:28 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] thread count: 28 {{(pid=85458) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 22:08:28 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] thread info: [<_MainThread(MainThread, started 127546830999680)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85458) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 22:08:30 devstack cinder-volume[85458]: INFO cinder.volume.manager [req-9ac4479d-44e1-4daf-9297-2fa95cb0a9b5 req-cedddd0c-f3d7-4e07-b552-349a6a88169b tempest-TestStampPattern-697373642 None] Terminate volume connection completed successfully. Sep 17 22:08:30 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [req-9ac4479d-44e1-4daf-9297-2fa95cb0a9b5 req-cedddd0c-f3d7-4e07-b552-349a6a88169b tempest-TestStampPattern-697373642 None] Deleting attachment c7bc6be7-ad86-43b3-974f-bf2ab8fa7eb3. {{(pid=85458) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 22:08:31 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-a3a157a5-8375-4d51-8f63-62af697013b5 tempest-TestStampPattern-697373642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:08:31 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-a3a157a5-8375-4d51-8f63-62af697013b5 tempest-TestStampPattern-697373642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:08:31 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-a3a157a5-8375-4d51-8f63-62af697013b5 tempest-TestStampPattern-697373642 None] Creating offline snapshot 3849cb44-a7a9-476a-93e1-cfc013e5d404 of volume 8fdddd6e-df91-4f6e-bb35-5a58bd44e4a8 {{(pid=85458) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 22:08:31 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[53113260-c4bd-4905-a439-60ff98289fc5]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:08:31 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a3a157a5-8375-4d51-8f63-62af697013b5 tempest-TestStampPattern-697373642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8fdddd6e-df91-4f6e-bb35-5a58bd44e4a8 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:08:31 devstack sudo[103083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8fdddd6e-df91-4f6e-bb35-5a58bd44e4a8 Sep 17 22:08:31 devstack sudo[103083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:08:31 devstack sudo[103083]: pam_unix(sudo:session): session closed for user root Sep 17 22:08:31 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a3a157a5-8375-4d51-8f63-62af697013b5 tempest-TestStampPattern-697373642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8fdddd6e-df91-4f6e-bb35-5a58bd44e4a8" returned: 0 in 0.343s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:08:31 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a3a157a5-8375-4d51-8f63-62af697013b5 tempest-TestStampPattern-697373642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8fdddd6e-df91-4f6e-bb35-5a58bd44e4a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8fdddd6e-df91-4f6e-bb35-5a58bd44e4a8.3849cb44-a7a9-476a-93e1-cfc013e5d404 1G {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:08:31 devstack sudo[103088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8fdddd6e-df91-4f6e-bb35-5a58bd44e4a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8fdddd6e-df91-4f6e-bb35-5a58bd44e4a8.3849cb44-a7a9-476a-93e1-cfc013e5d404 1G Sep 17 22:08:31 devstack sudo[103088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:08:31 devstack sudo[103088]: pam_unix(sudo:session): session closed for user root Sep 17 22:08:31 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a3a157a5-8375-4d51-8f63-62af697013b5 tempest-TestStampPattern-697373642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8fdddd6e-df91-4f6e-bb35-5a58bd44e4a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8fdddd6e-df91-4f6e-bb35-5a58bd44e4a8.3849cb44-a7a9-476a-93e1-cfc013e5d404 1G" returned: 0 in 0.378s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:08:31 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a3a157a5-8375-4d51-8f63-62af697013b5 tempest-TestStampPattern-697373642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8fdddd6e-df91-4f6e-bb35-5a58bd44e4a8 -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8fdddd6e-df91-4f6e-bb35-5a58bd44e4a8.3849cb44-a7a9-476a-93e1-cfc013e5d404 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:08:31 devstack sudo[103093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8fdddd6e-df91-4f6e-bb35-5a58bd44e4a8 -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8fdddd6e-df91-4f6e-bb35-5a58bd44e4a8.3849cb44-a7a9-476a-93e1-cfc013e5d404 Sep 17 22:08:31 devstack sudo[103093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:08:32 devstack sudo[103093]: pam_unix(sudo:session): session closed for user root Sep 17 22:08:32 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a3a157a5-8375-4d51-8f63-62af697013b5 tempest-TestStampPattern-697373642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8fdddd6e-df91-4f6e-bb35-5a58bd44e4a8 -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8fdddd6e-df91-4f6e-bb35-5a58bd44e4a8.3849cb44-a7a9-476a-93e1-cfc013e5d404" returned: 0 in 0.292s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:08:32 devstack cinder-volume[85458]: WARNING cinder.volume.drivers.remotefs [None req-a3a157a5-8375-4d51-8f63-62af697013b5 tempest-TestStampPattern-697373642 None] /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8fdddd6e-df91-4f6e-bb35-5a58bd44e4a8.3849cb44-a7a9-476a-93e1-cfc013e5d404 is being set with open permissions: ugo+rw Sep 17 22:08:32 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a3a157a5-8375-4d51-8f63-62af697013b5 tempest-TestStampPattern-697373642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8fdddd6e-df91-4f6e-bb35-5a58bd44e4a8.3849cb44-a7a9-476a-93e1-cfc013e5d404 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:08:32 devstack sudo[103098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8fdddd6e-df91-4f6e-bb35-5a58bd44e4a8.3849cb44-a7a9-476a-93e1-cfc013e5d404 Sep 17 22:08:32 devstack sudo[103098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:08:32 devstack sudo[103098]: pam_unix(sudo:session): session closed for user root Sep 17 22:08:32 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a3a157a5-8375-4d51-8f63-62af697013b5 tempest-TestStampPattern-697373642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8fdddd6e-df91-4f6e-bb35-5a58bd44e4a8.3849cb44-a7a9-476a-93e1-cfc013e5d404" returned: 0 in 0.244s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:08:32 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a3a157a5-8375-4d51-8f63-62af697013b5 tempest-TestStampPattern-697373642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8fdddd6e-df91-4f6e-bb35-5a58bd44e4a8.info {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:08:32 devstack sudo[103101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8fdddd6e-df91-4f6e-bb35-5a58bd44e4a8.info Sep 17 22:08:32 devstack sudo[103101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:08:32 devstack sudo[103101]: pam_unix(sudo:session): session closed for user root Sep 17 22:08:32 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a3a157a5-8375-4d51-8f63-62af697013b5 tempest-TestStampPattern-697373642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8fdddd6e-df91-4f6e-bb35-5a58bd44e4a8.info" returned: 0 in 0.242s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:08:32 devstack cinder-volume[85458]: WARNING cinder.volume.drivers.remotefs [None req-a3a157a5-8375-4d51-8f63-62af697013b5 tempest-TestStampPattern-697373642 None] /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8fdddd6e-df91-4f6e-bb35-5a58bd44e4a8.info is being set with open permissions: ugo+rw Sep 17 22:08:32 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a3a157a5-8375-4d51-8f63-62af697013b5 tempest-TestStampPattern-697373642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8fdddd6e-df91-4f6e-bb35-5a58bd44e4a8.info {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:08:32 devstack sudo[103104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8fdddd6e-df91-4f6e-bb35-5a58bd44e4a8.info Sep 17 22:08:32 devstack sudo[103104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:08:32 devstack sudo[103104]: pam_unix(sudo:session): session closed for user root Sep 17 22:08:32 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a3a157a5-8375-4d51-8f63-62af697013b5 tempest-TestStampPattern-697373642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8fdddd6e-df91-4f6e-bb35-5a58bd44e4a8.info" returned: 0 in 0.234s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:08:32 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-a3a157a5-8375-4d51-8f63-62af697013b5 tempest-TestStampPattern-697373642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.845s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:08:33 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-a3a157a5-8375-4d51-8f63-62af697013b5 tempest-TestStampPattern-697373642 None] Create snapshot completed successfully Sep 17 22:08:39 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-662a2327-14d4-4cf5-ac15-7daab6fce011 tempest-TestStampPattern-697373642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 22:08:39 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-662a2327-14d4-4cf5-ac15-7daab6fce011 tempest-TestStampPattern-697373642 None] Flow 'volume_create_manager' (4e38fb1b-91e7-4891-92e8-a9d541a818e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:08:39 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-662a2327-14d4-4cf5-ac15-7daab6fce011 tempest-TestStampPattern-697373642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b0ba89d-c6c1-4cb0-bc8d-1a33100800b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:08:39 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-662a2327-14d4-4cf5-ac15-7daab6fce011 tempest-TestStampPattern-697373642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b0ba89d-c6c1-4cb0-bc8d-1a33100800b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:08:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1846754153',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d9270eb-ed82-4fc0-af50-479114c9e83f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6777ab0c6b148c5b376765ae8a03324',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:08:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3849cb44-a7a9-476a-93e1-cfc013e5d404,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:08:40Z,use_quota=True,user_id='2324371e38894b318bf30069915dd800',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:08:39 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-662a2327-14d4-4cf5-ac15-7daab6fce011 tempest-TestStampPattern-697373642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f50aacbd-3be6-44f3-82b4-a72636f3dbfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:08:39 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-662a2327-14d4-4cf5-ac15-7daab6fce011 tempest-TestStampPattern-697373642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f50aacbd-3be6-44f3-82b4-a72636f3dbfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:08:39 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-662a2327-14d4-4cf5-ac15-7daab6fce011 tempest-TestStampPattern-697373642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37a1c1f6-d751-442a-b154-01726a4084e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:08:39 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-662a2327-14d4-4cf5-ac15-7daab6fce011 tempest-TestStampPattern-697373642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37a1c1f6-d751-442a-b154-01726a4084e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4d9270eb-ed82-4fc0-af50-479114c9e83f', 'volume_name': 'volume-4d9270eb-ed82-4fc0-af50-479114c9e83f', 'volume_size': 1, 'snapshot_id': '3849cb44-a7a9-476a-93e1-cfc013e5d404'}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:08:39 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-662a2327-14d4-4cf5-ac15-7daab6fce011 tempest-TestStampPattern-697373642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06f6d342-f31d-4e1f-b5be-323e05562414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:08:39 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-662a2327-14d4-4cf5-ac15-7daab6fce011 tempest-TestStampPattern-697373642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06f6d342-f31d-4e1f-b5be-323e05562414) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:08:39 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-662a2327-14d4-4cf5-ac15-7daab6fce011 tempest-TestStampPattern-697373642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (352e4536-4d61-4302-bf0b-208d352d1639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:08:39 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-662a2327-14d4-4cf5-ac15-7daab6fce011 tempest-TestStampPattern-697373642 None] Volume 4d9270eb-ed82-4fc0-af50-479114c9e83f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4d9270eb-ed82-4fc0-af50-479114c9e83f', 'volume_size': 1, 'snapshot_id': '3849cb44-a7a9-476a-93e1-cfc013e5d404'} Sep 17 22:08:39 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-662a2327-14d4-4cf5-ac15-7daab6fce011 tempest-TestStampPattern-697373642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:08:39 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-662a2327-14d4-4cf5-ac15-7daab6fce011 tempest-TestStampPattern-697373642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:08:39 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-662a2327-14d4-4cf5-ac15-7daab6fce011 tempest-TestStampPattern-697373642 None] Acquiring lock "cinder-quobyte-3849cb44-a7a9-476a-93e1-cfc013e5d404-4d9270eb-ed82-4fc0-af50-479114c9e83f" by "_create_volume_from_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:08:39 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-662a2327-14d4-4cf5-ac15-7daab6fce011 tempest-TestStampPattern-697373642 None] Lock "cinder-quobyte-3849cb44-a7a9-476a-93e1-cfc013e5d404-4d9270eb-ed82-4fc0-af50-479114c9e83f" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:08:39 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-662a2327-14d4-4cf5-ac15-7daab6fce011 tempest-TestStampPattern-697373642 None] Creating volume 4d9270eb-ed82-4fc0-af50-479114c9e83f from snapshot 3849cb44-a7a9-476a-93e1-cfc013e5d404 {{(pid=85458) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 17 22:08:39 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-662a2327-14d4-4cf5-ac15-7daab6fce011 tempest-TestStampPattern-697373642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:08:39 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-662a2327-14d4-4cf5-ac15-7daab6fce011 tempest-TestStampPattern-697373642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:08:39 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-662a2327-14d4-4cf5-ac15-7daab6fce011 tempest-TestStampPattern-697373642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:08:39 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-662a2327-14d4-4cf5-ac15-7daab6fce011 tempest-TestStampPattern-697373642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:08:39 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-662a2327-14d4-4cf5-ac15-7daab6fce011 tempest-TestStampPattern-697373642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:08:39 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-662a2327-14d4-4cf5-ac15-7daab6fce011 tempest-TestStampPattern-697373642 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 22:08:39 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-662a2327-14d4-4cf5-ac15-7daab6fce011 tempest-TestStampPattern-697373642 None] Acquiring lock "cinder-quobyte-4d9270eb-ed82-4fc0-af50-479114c9e83f" by "_copy_volume_from_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:08:39 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-662a2327-14d4-4cf5-ac15-7daab6fce011 tempest-TestStampPattern-697373642 None] Lock "cinder-quobyte-4d9270eb-ed82-4fc0-af50-479114c9e83f" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:08:39 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-662a2327-14d4-4cf5-ac15-7daab6fce011 tempest-TestStampPattern-697373642 None] snapshot: 3849cb44-a7a9-476a-93e1-cfc013e5d404, volume: 4d9270eb-ed82-4fc0-af50-479114c9e83f, {{(pid=85458) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 17 22:08:39 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-662a2327-14d4-4cf5-ac15-7daab6fce011 tempest-TestStampPattern-697373642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:08:40 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-662a2327-14d4-4cf5-ac15-7daab6fce011 tempest-TestStampPattern-697373642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:08:40 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-662a2327-14d4-4cf5-ac15-7daab6fce011 tempest-TestStampPattern-697373642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:08:40 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-662a2327-14d4-4cf5-ac15-7daab6fce011 tempest-TestStampPattern-697373642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:08:40 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-662a2327-14d4-4cf5-ac15-7daab6fce011 tempest-TestStampPattern-697373642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:08:40 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[efeb5b4d-f65a-4c86-89c1-b9188bbeafc7]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:08:40 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-662a2327-14d4-4cf5-ac15-7daab6fce011 tempest-TestStampPattern-697373642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8fdddd6e-df91-4f6e-bb35-5a58bd44e4a8.3849cb44-a7a9-476a-93e1-cfc013e5d404 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:08:40 devstack sudo[103134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8fdddd6e-df91-4f6e-bb35-5a58bd44e4a8.3849cb44-a7a9-476a-93e1-cfc013e5d404 Sep 17 22:08:40 devstack sudo[103134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:08:40 devstack sudo[103134]: pam_unix(sudo:session): session closed for user root Sep 17 22:08:40 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-662a2327-14d4-4cf5-ac15-7daab6fce011 tempest-TestStampPattern-697373642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8fdddd6e-df91-4f6e-bb35-5a58bd44e4a8.3849cb44-a7a9-476a-93e1-cfc013e5d404" returned: 0 in 0.391s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:08:40 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-662a2327-14d4-4cf5-ac15-7daab6fce011 tempest-TestStampPattern-697373642 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8fdddd6e-df91-4f6e-bb35-5a58bd44e4a8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85458) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 22:08:40 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e8e1bb4-729d-4661-a7b8-531a079fa172]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:08:40 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-662a2327-14d4-4cf5-ac15-7daab6fce011 tempest-TestStampPattern-697373642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8fdddd6e-df91-4f6e-bb35-5a58bd44e4a8 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:08:40 devstack sudo[103139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8fdddd6e-df91-4f6e-bb35-5a58bd44e4a8 Sep 17 22:08:40 devstack sudo[103139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:08:40 devstack sudo[103139]: pam_unix(sudo:session): session closed for user root Sep 17 22:08:40 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-662a2327-14d4-4cf5-ac15-7daab6fce011 tempest-TestStampPattern-697373642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8fdddd6e-df91-4f6e-bb35-5a58bd44e4a8" returned: 0 in 0.413s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:08:40 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-662a2327-14d4-4cf5-ac15-7daab6fce011 tempest-TestStampPattern-697373642 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8fdddd6e-df91-4f6e-bb35-5a58bd44e4a8 {{(pid=85458) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 17 22:08:40 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-662a2327-14d4-4cf5-ac15-7daab6fce011 tempest-TestStampPattern-697373642 None] Creating direct copy from snapshot {{(pid=85458) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 17 22:08:40 devstack cinder-volume[85458]: DEBUG cinder.utils [None req-662a2327-14d4-4cf5-ac15-7daab6fce011 tempest-TestStampPattern-697373642 None] Path /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-4d9270eb-ed82-4fc0-af50-479114c9e83f not found in is_blk_device check {{(pid=85458) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 17 22:08:40 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-662a2327-14d4-4cf5-ac15-7daab6fce011 tempest-TestStampPattern-697373642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8fdddd6e-df91-4f6e-bb35-5a58bd44e4a8 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-4d9270eb-ed82-4fc0-af50-479114c9e83f {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:08:40 devstack sudo[103147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8fdddd6e-df91-4f6e-bb35-5a58bd44e4a8 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-4d9270eb-ed82-4fc0-af50-479114c9e83f Sep 17 22:08:40 devstack sudo[103147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:08:49 devstack sudo[103147]: pam_unix(sudo:session): session closed for user root Sep 17 22:08:49 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-662a2327-14d4-4cf5-ac15-7daab6fce011 tempest-TestStampPattern-697373642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8fdddd6e-df91-4f6e-bb35-5a58bd44e4a8 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-4d9270eb-ed82-4fc0-af50-479114c9e83f" returned: 0 in 8.706s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:08:49 devstack cinder-volume[85458]: DEBUG cinder.image.image_utils [None req-662a2327-14d4-4cf5-ac15-7daab6fce011 tempest-TestStampPattern-697373642 None] Image conversion details: src /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8fdddd6e-df91-4f6e-bb35-5a58bd44e4a8, size 1024.00 MB, duration 8.71 sec, destination /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-4d9270eb-ed82-4fc0-af50-479114c9e83f {{(pid=85458) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 17 22:08:49 devstack cinder-volume[85458]: INFO cinder.image.image_utils [None req-662a2327-14d4-4cf5-ac15-7daab6fce011 tempest-TestStampPattern-697373642 None] Converted 1024.00 MB image at 117.60 MB/s Sep 17 22:08:49 devstack cinder-volume[85458]: WARNING cinder.volume.drivers.remotefs [None req-662a2327-14d4-4cf5-ac15-7daab6fce011 tempest-TestStampPattern-697373642 None] /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-4d9270eb-ed82-4fc0-af50-479114c9e83f is being set with open permissions: ugo+rw Sep 17 22:08:49 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-662a2327-14d4-4cf5-ac15-7daab6fce011 tempest-TestStampPattern-697373642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-4d9270eb-ed82-4fc0-af50-479114c9e83f {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:08:49 devstack sudo[103233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-4d9270eb-ed82-4fc0-af50-479114c9e83f Sep 17 22:08:49 devstack sudo[103233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:08:49 devstack sudo[103233]: pam_unix(sudo:session): session closed for user root Sep 17 22:08:49 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-662a2327-14d4-4cf5-ac15-7daab6fce011 tempest-TestStampPattern-697373642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-4d9270eb-ed82-4fc0-af50-479114c9e83f" returned: 0 in 0.249s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:08:49 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-662a2327-14d4-4cf5-ac15-7daab6fce011 tempest-TestStampPattern-697373642 None] Lock "cinder-quobyte-4d9270eb-ed82-4fc0-af50-479114c9e83f" released by "_copy_volume_from_snapshot" :: held 9.860s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:08:49 devstack cinder-volume[85458]: DEBUG dbcounter [-] [85458] Writing DB stats cinder:SELECT=78,cinder:UPDATE=99,cinder:INSERT=22,cinder:DELETE=10 {{(pid=85458) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 22:08:49 devstack cinder-volume[85458]: DEBUG dbcounter [-] [85458] Writing DB stats cinder:SELECT=87,cinder:UPDATE=106,cinder:DELETE=9,cinder:INSERT=25 {{(pid=85458) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 22:08:49 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-662a2327-14d4-4cf5-ac15-7daab6fce011 tempest-TestStampPattern-697373642 None] Lock "cinder-quobyte-3849cb44-a7a9-476a-93e1-cfc013e5d404-4d9270eb-ed82-4fc0-af50-479114c9e83f" released by "_create_volume_from_snapshot" :: held 9.943s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:08:49 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-662a2327-14d4-4cf5-ac15-7daab6fce011 tempest-TestStampPattern-697373642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.960s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:08:49 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-662a2327-14d4-4cf5-ac15-7daab6fce011 tempest-TestStampPattern-697373642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (352e4536-4d61-4302-bf0b-208d352d1639) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d9270eb-ed82-4fc0-af50-479114c9e83f', 'volume_size': 1, 'snapshot_id': '3849cb44-a7a9-476a-93e1-cfc013e5d404'}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:08:49 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-662a2327-14d4-4cf5-ac15-7daab6fce011 tempest-TestStampPattern-697373642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b788a14-526c-4bf3-92e9-74e90be258c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:08:49 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-662a2327-14d4-4cf5-ac15-7daab6fce011 tempest-TestStampPattern-697373642 None] Volume volume-4d9270eb-ed82-4fc0-af50-479114c9e83f (4d9270eb-ed82-4fc0-af50-479114c9e83f): created successfully Sep 17 22:08:49 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-662a2327-14d4-4cf5-ac15-7daab6fce011 tempest-TestStampPattern-697373642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b788a14-526c-4bf3-92e9-74e90be258c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:08:49 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-662a2327-14d4-4cf5-ac15-7daab6fce011 tempest-TestStampPattern-697373642 None] Flow 'volume_create_manager' (4e38fb1b-91e7-4891-92e8-a9d541a818e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:08:49 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-662a2327-14d4-4cf5-ac15-7daab6fce011 tempest-TestStampPattern-697373642 None] Created volume successfully. Sep 17 22:08:59 devstack cinder-volume[85458]: DEBUG dbcounter [-] [85458] Writing DB stats cinder:SELECT=2,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=85458) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 22:08:59 devstack cinder-volume[85458]: DEBUG dbcounter [-] [85458] Writing DB stats cinder:UPDATE=1,cinder:DELETE=1 {{(pid=85458) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 22:09:27 devstack cinder-volume[85458]: DEBUG oslo_service.periodic_task [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85458) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 22:09:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:09:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:09:27 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:09:27 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:09:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:09:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:09:27 devstack sudo[103285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:09:27 devstack sudo[103285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:09:28 devstack sudo[103285]: pam_unix(sudo:session): session closed for user root Sep 17 22:09:28 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.249s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:09:28 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:09:28 devstack cinder-volume[85458]: DEBUG oslo_service.periodic_task [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Running periodic task VolumeManager._thread_info {{(pid=85458) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 22:09:28 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] thread count: 28 {{(pid=85458) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 22:09:28 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] thread info: [<_MainThread(MainThread, started 127546830999680)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85458) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 22:09:29 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [req-cd41c4d1-5d22-4090-9598-aa89d01e7c32 req-4eff9542-e9a3-4da6-8160-5f37bcd1d17d tempest-TestStampPattern-697373642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:09:29 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [req-cd41c4d1-5d22-4090-9598-aa89d01e7c32 req-4eff9542-e9a3-4da6-8160-5f37bcd1d17d tempest-TestStampPattern-697373642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:09:29 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [req-cd41c4d1-5d22-4090-9598-aa89d01e7c32 req-4eff9542-e9a3-4da6-8160-5f37bcd1d17d tempest-TestStampPattern-697373642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:09:29 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [req-cd41c4d1-5d22-4090-9598-aa89d01e7c32 req-4eff9542-e9a3-4da6-8160-5f37bcd1d17d tempest-TestStampPattern-697373642 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5', 'name': 'volume-4d9270eb-ed82-4fc0-af50-479114c9e83f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2e3bdb18-09bc-40ec-a6dc-fbb60bc42626', 'enforce_multipath': True} {{(pid=85458) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 22:09:29 devstack cinder-volume[85458]: INFO cinder.volume.manager [req-cd41c4d1-5d22-4090-9598-aa89d01e7c32 req-4eff9542-e9a3-4da6-8160-5f37bcd1d17d tempest-TestStampPattern-697373642 None] attachment_update completed successfully. Sep 17 22:09:31 devstack cinder-volume[85458]: INFO cinder.volume.manager [req-6c9050b3-88bb-4979-b15c-490c66f858e2 req-44e0f413-4281-4188-81ff-3396f5770922 tempest-TestStampPattern-697373642 None] Terminate volume connection completed successfully. Sep 17 22:09:31 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [req-6c9050b3-88bb-4979-b15c-490c66f858e2 req-44e0f413-4281-4188-81ff-3396f5770922 tempest-TestStampPattern-697373642 None] Deleting attachment 2e3bdb18-09bc-40ec-a6dc-fbb60bc42626. {{(pid=85458) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 22:09:36 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-afb8200f-acd5-42e2-8b1e-50aa4d047dd5 tempest-TestStampPattern-697373642 None] Acquiring lock "cinder-4d9270eb-ed82-4fc0-af50-479114c9e83f-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:09:36 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-afb8200f-acd5-42e2-8b1e-50aa4d047dd5 tempest-TestStampPattern-697373642 None] Lock "cinder-4d9270eb-ed82-4fc0-af50-479114c9e83f-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:09:36 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-afb8200f-acd5-42e2-8b1e-50aa4d047dd5 tempest-TestStampPattern-697373642 None] Acquiring lock "cinder-quobyte-4d9270eb-ed82-4fc0-af50-479114c9e83f" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:09:36 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-afb8200f-acd5-42e2-8b1e-50aa4d047dd5 tempest-TestStampPattern-697373642 None] Lock "cinder-quobyte-4d9270eb-ed82-4fc0-af50-479114c9e83f" acquired by "delete_volume" :: waited 0.019s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:09:36 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d0cb37f-87fe-4825-ad03-016f12f9c98d]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:09:36 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-afb8200f-acd5-42e2-8b1e-50aa4d047dd5 tempest-TestStampPattern-697373642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-4d9270eb-ed82-4fc0-af50-479114c9e83f {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:09:36 devstack sudo[103796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-4d9270eb-ed82-4fc0-af50-479114c9e83f Sep 17 22:09:36 devstack sudo[103796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:09:36 devstack sudo[103796]: pam_unix(sudo:session): session closed for user root Sep 17 22:09:36 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-afb8200f-acd5-42e2-8b1e-50aa4d047dd5 tempest-TestStampPattern-697373642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-4d9270eb-ed82-4fc0-af50-479114c9e83f" returned: 0 in 0.380s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:09:36 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-afb8200f-acd5-42e2-8b1e-50aa4d047dd5 tempest-TestStampPattern-697373642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-4d9270eb-ed82-4fc0-af50-479114c9e83f {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:09:36 devstack sudo[103801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-4d9270eb-ed82-4fc0-af50-479114c9e83f Sep 17 22:09:36 devstack sudo[103801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:09:36 devstack sudo[103801]: pam_unix(sudo:session): session closed for user root Sep 17 22:09:36 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-afb8200f-acd5-42e2-8b1e-50aa4d047dd5 tempest-TestStampPattern-697373642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-4d9270eb-ed82-4fc0-af50-479114c9e83f" returned: 0 in 0.254s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:09:36 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-afb8200f-acd5-42e2-8b1e-50aa4d047dd5 tempest-TestStampPattern-697373642 None] Lock "cinder-quobyte-4d9270eb-ed82-4fc0-af50-479114c9e83f" released by "delete_volume" :: held 0.681s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:09:36 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-afb8200f-acd5-42e2-8b1e-50aa4d047dd5 tempest-TestStampPattern-697373642 None] Created reservations ['51e4573b-f157-4ba0-922d-e9f19e8274d6', 'ba526990-a9a2-475e-8830-caf563e3dc88', '4057ebe1-4aa5-461f-89f9-ecc0584400db', 'bf1c47aa-80ea-42b8-9be8-e322026a45df'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:09:36 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-afb8200f-acd5-42e2-8b1e-50aa4d047dd5 tempest-TestStampPattern-697373642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:09:36 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-afb8200f-acd5-42e2-8b1e-50aa4d047dd5 tempest-TestStampPattern-697373642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:09:36 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-afb8200f-acd5-42e2-8b1e-50aa4d047dd5 tempest-TestStampPattern-697373642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:09:36 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-afb8200f-acd5-42e2-8b1e-50aa4d047dd5 tempest-TestStampPattern-697373642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:09:36 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-afb8200f-acd5-42e2-8b1e-50aa4d047dd5 tempest-TestStampPattern-697373642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:09:36 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-afb8200f-acd5-42e2-8b1e-50aa4d047dd5 tempest-TestStampPattern-697373642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:09:36 devstack sudo[103804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:09:36 devstack sudo[103804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:09:37 devstack sudo[103804]: pam_unix(sudo:session): session closed for user root Sep 17 22:09:37 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-afb8200f-acd5-42e2-8b1e-50aa4d047dd5 tempest-TestStampPattern-697373642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.243s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:09:37 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-afb8200f-acd5-42e2-8b1e-50aa4d047dd5 tempest-TestStampPattern-697373642 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:09:37 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-afb8200f-acd5-42e2-8b1e-50aa4d047dd5 tempest-TestStampPattern-697373642 None] Deleted volume successfully. Sep 17 22:09:37 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-afb8200f-acd5-42e2-8b1e-50aa4d047dd5 tempest-TestStampPattern-697373642 None] Lock "cinder-4d9270eb-ed82-4fc0-af50-479114c9e83f-delete_volume" released by "delete_volume" :: held 1.112s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:09:37 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-12b26c5b-3a0f-426b-a250-e3c0808bca43 tempest-TestStampPattern-697373642 None] Acquiring lock "cinder-3849cb44-a7a9-476a-93e1-cfc013e5d404-delete_snapshot" by "delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:09:37 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-12b26c5b-3a0f-426b-a250-e3c0808bca43 tempest-TestStampPattern-697373642 None] Lock "cinder-3849cb44-a7a9-476a-93e1-cfc013e5d404-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:09:37 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-12b26c5b-3a0f-426b-a250-e3c0808bca43 tempest-TestStampPattern-697373642 None] Acquiring lock "cinder-quobyte-8fdddd6e-df91-4f6e-bb35-5a58bd44e4a8" by "delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:09:37 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-12b26c5b-3a0f-426b-a250-e3c0808bca43 tempest-TestStampPattern-697373642 None] Lock "cinder-quobyte-8fdddd6e-df91-4f6e-bb35-5a58bd44e4a8" acquired by "delete_snapshot" :: waited 0.013s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:09:37 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-12b26c5b-3a0f-426b-a250-e3c0808bca43 tempest-TestStampPattern-697373642 None] Acquiring lock "cinder-quobyte-3849cb44-a7a9-476a-93e1-cfc013e5d404" by "_delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:09:37 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-12b26c5b-3a0f-426b-a250-e3c0808bca43 tempest-TestStampPattern-697373642 None] Lock "cinder-quobyte-3849cb44-a7a9-476a-93e1-cfc013e5d404" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:09:37 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-12b26c5b-3a0f-426b-a250-e3c0808bca43 tempest-TestStampPattern-697373642 None] Deleting offline snapshot 3849cb44-a7a9-476a-93e1-cfc013e5d404 of volume 8fdddd6e-df91-4f6e-bb35-5a58bd44e4a8 {{(pid=85458) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 22:09:37 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-12b26c5b-3a0f-426b-a250-e3c0808bca43 tempest-TestStampPattern-697373642 None] snapshot_file for this snap is: volume-8fdddd6e-df91-4f6e-bb35-5a58bd44e4a8.3849cb44-a7a9-476a-93e1-cfc013e5d404 {{(pid=85458) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 22:09:37 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[d983131c-26ca-4384-ba8f-51dc4585788f]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:09:37 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-12b26c5b-3a0f-426b-a250-e3c0808bca43 tempest-TestStampPattern-697373642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8fdddd6e-df91-4f6e-bb35-5a58bd44e4a8.3849cb44-a7a9-476a-93e1-cfc013e5d404 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:09:37 devstack sudo[103807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8fdddd6e-df91-4f6e-bb35-5a58bd44e4a8.3849cb44-a7a9-476a-93e1-cfc013e5d404 Sep 17 22:09:37 devstack sudo[103807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:09:37 devstack sudo[103807]: pam_unix(sudo:session): session closed for user root Sep 17 22:09:37 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-12b26c5b-3a0f-426b-a250-e3c0808bca43 tempest-TestStampPattern-697373642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8fdddd6e-df91-4f6e-bb35-5a58bd44e4a8.3849cb44-a7a9-476a-93e1-cfc013e5d404" returned: 0 in 0.357s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:09:37 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-12b26c5b-3a0f-426b-a250-e3c0808bca43 tempest-TestStampPattern-697373642 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8fdddd6e-df91-4f6e-bb35-5a58bd44e4a8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85458) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 22:09:37 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[5efc0d63-5be2-4099-a43d-2497e2714b50]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:09:37 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-12b26c5b-3a0f-426b-a250-e3c0808bca43 tempest-TestStampPattern-697373642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8fdddd6e-df91-4f6e-bb35-5a58bd44e4a8 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:09:38 devstack sudo[103812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8fdddd6e-df91-4f6e-bb35-5a58bd44e4a8 Sep 17 22:09:38 devstack sudo[103812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:09:38 devstack sudo[103812]: pam_unix(sudo:session): session closed for user root Sep 17 22:09:38 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-12b26c5b-3a0f-426b-a250-e3c0808bca43 tempest-TestStampPattern-697373642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8fdddd6e-df91-4f6e-bb35-5a58bd44e4a8" returned: 0 in 0.503s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:09:38 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-12b26c5b-3a0f-426b-a250-e3c0808bca43 tempest-TestStampPattern-697373642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8fdddd6e-df91-4f6e-bb35-5a58bd44e4a8.3849cb44-a7a9-476a-93e1-cfc013e5d404 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:09:38 devstack sudo[103817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8fdddd6e-df91-4f6e-bb35-5a58bd44e4a8.3849cb44-a7a9-476a-93e1-cfc013e5d404 Sep 17 22:09:38 devstack sudo[103817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:09:38 devstack sudo[103817]: pam_unix(sudo:session): session closed for user root Sep 17 22:09:38 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-12b26c5b-3a0f-426b-a250-e3c0808bca43 tempest-TestStampPattern-697373642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8fdddd6e-df91-4f6e-bb35-5a58bd44e4a8.3849cb44-a7a9-476a-93e1-cfc013e5d404" returned: 0 in 0.321s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:09:38 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-12b26c5b-3a0f-426b-a250-e3c0808bca43 tempest-TestStampPattern-697373642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8fdddd6e-df91-4f6e-bb35-5a58bd44e4a8.3849cb44-a7a9-476a-93e1-cfc013e5d404 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:09:38 devstack sudo[103822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8fdddd6e-df91-4f6e-bb35-5a58bd44e4a8.3849cb44-a7a9-476a-93e1-cfc013e5d404 Sep 17 22:09:38 devstack sudo[103822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:09:39 devstack sudo[103822]: pam_unix(sudo:session): session closed for user root Sep 17 22:09:39 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-12b26c5b-3a0f-426b-a250-e3c0808bca43 tempest-TestStampPattern-697373642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8fdddd6e-df91-4f6e-bb35-5a58bd44e4a8.3849cb44-a7a9-476a-93e1-cfc013e5d404" returned: 0 in 0.236s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:09:39 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-12b26c5b-3a0f-426b-a250-e3c0808bca43 tempest-TestStampPattern-697373642 None] Lock "cinder-quobyte-3849cb44-a7a9-476a-93e1-cfc013e5d404" released by "_delete_snapshot" :: held 1.516s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:09:39 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-12b26c5b-3a0f-426b-a250-e3c0808bca43 tempest-TestStampPattern-697373642 None] Lock "cinder-quobyte-8fdddd6e-df91-4f6e-bb35-5a58bd44e4a8" released by "delete_snapshot" :: held 1.535s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:09:39 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-12b26c5b-3a0f-426b-a250-e3c0808bca43 tempest-TestStampPattern-697373642 None] Created reservations ['c85d7319-e539-4f9d-9bf2-45bfbc4a25af', 'f8743978-ef60-4a20-87a3-8b76fa1d0707', 'd4e0df4c-8f8a-4692-9666-e21ae1449a7a', '9d56f7a4-bc40-4d2f-8dfb-d4f9adf43717'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:09:39 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-12b26c5b-3a0f-426b-a250-e3c0808bca43 tempest-TestStampPattern-697373642 None] Delete snapshot completed successfully. Sep 17 22:09:39 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-12b26c5b-3a0f-426b-a250-e3c0808bca43 tempest-TestStampPattern-697373642 None] Lock "cinder-3849cb44-a7a9-476a-93e1-cfc013e5d404-delete_snapshot" released by "delete_snapshot" :: held 1.669s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:09:43 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-0e79ca78-ecef-4f74-a227-adb2caa62bb8 tempest-TestStampPattern-697373642 None] Acquiring lock "cinder-8fdddd6e-df91-4f6e-bb35-5a58bd44e4a8-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:09:43 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-0e79ca78-ecef-4f74-a227-adb2caa62bb8 tempest-TestStampPattern-697373642 None] Lock "cinder-8fdddd6e-df91-4f6e-bb35-5a58bd44e4a8-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:09:43 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-0e79ca78-ecef-4f74-a227-adb2caa62bb8 tempest-TestStampPattern-697373642 None] Acquiring lock "cinder-quobyte-8fdddd6e-df91-4f6e-bb35-5a58bd44e4a8" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:09:43 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-0e79ca78-ecef-4f74-a227-adb2caa62bb8 tempest-TestStampPattern-697373642 None] Lock "cinder-quobyte-8fdddd6e-df91-4f6e-bb35-5a58bd44e4a8" acquired by "delete_volume" :: waited 0.017s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:09:43 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4f7bffa-7202-4184-b67b-91c940a0edf1]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:09:43 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-0e79ca78-ecef-4f74-a227-adb2caa62bb8 tempest-TestStampPattern-697373642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8fdddd6e-df91-4f6e-bb35-5a58bd44e4a8 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:09:43 devstack sudo[103852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8fdddd6e-df91-4f6e-bb35-5a58bd44e4a8 Sep 17 22:09:43 devstack sudo[103852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:09:43 devstack sudo[103852]: pam_unix(sudo:session): session closed for user root Sep 17 22:09:43 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-0e79ca78-ecef-4f74-a227-adb2caa62bb8 tempest-TestStampPattern-697373642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8fdddd6e-df91-4f6e-bb35-5a58bd44e4a8" returned: 0 in 0.369s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:09:43 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-0e79ca78-ecef-4f74-a227-adb2caa62bb8 tempest-TestStampPattern-697373642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8fdddd6e-df91-4f6e-bb35-5a58bd44e4a8 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:09:43 devstack sudo[103857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8fdddd6e-df91-4f6e-bb35-5a58bd44e4a8 Sep 17 22:09:43 devstack sudo[103857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:09:43 devstack sudo[103857]: pam_unix(sudo:session): session closed for user root Sep 17 22:09:43 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-0e79ca78-ecef-4f74-a227-adb2caa62bb8 tempest-TestStampPattern-697373642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8fdddd6e-df91-4f6e-bb35-5a58bd44e4a8" returned: 0 in 0.253s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:09:43 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-0e79ca78-ecef-4f74-a227-adb2caa62bb8 tempest-TestStampPattern-697373642 None] Lock "cinder-quobyte-8fdddd6e-df91-4f6e-bb35-5a58bd44e4a8" released by "delete_volume" :: held 0.690s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:09:43 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-0e79ca78-ecef-4f74-a227-adb2caa62bb8 tempest-TestStampPattern-697373642 None] Created reservations ['3d7928ec-71cf-4d55-ae9f-ac9c1ecabd59', '1410962f-968b-4a95-a9c6-eea8172c8837', '099b9598-3e09-4388-a6c9-e4bca91849ee', '55f8fffc-6b6f-4651-a53f-4b845726d4bb'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:09:43 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-0e79ca78-ecef-4f74-a227-adb2caa62bb8 tempest-TestStampPattern-697373642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:09:43 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-0e79ca78-ecef-4f74-a227-adb2caa62bb8 tempest-TestStampPattern-697373642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:09:43 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-0e79ca78-ecef-4f74-a227-adb2caa62bb8 tempest-TestStampPattern-697373642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:09:43 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-0e79ca78-ecef-4f74-a227-adb2caa62bb8 tempest-TestStampPattern-697373642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:09:43 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-0e79ca78-ecef-4f74-a227-adb2caa62bb8 tempest-TestStampPattern-697373642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:09:43 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-0e79ca78-ecef-4f74-a227-adb2caa62bb8 tempest-TestStampPattern-697373642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:09:43 devstack sudo[103860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:09:43 devstack sudo[103860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:09:44 devstack sudo[103860]: pam_unix(sudo:session): session closed for user root Sep 17 22:09:44 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-0e79ca78-ecef-4f74-a227-adb2caa62bb8 tempest-TestStampPattern-697373642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.243s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:09:44 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-0e79ca78-ecef-4f74-a227-adb2caa62bb8 tempest-TestStampPattern-697373642 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:09:44 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-0e79ca78-ecef-4f74-a227-adb2caa62bb8 tempest-TestStampPattern-697373642 None] Deleted volume successfully. Sep 17 22:09:44 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-0e79ca78-ecef-4f74-a227-adb2caa62bb8 tempest-TestStampPattern-697373642 None] Lock "cinder-8fdddd6e-df91-4f6e-bb35-5a58bd44e4a8-delete_volume" released by "delete_volume" :: held 1.118s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:09:53 devstack cinder-volume[85458]: DEBUG dbcounter [-] [85458] Writing DB stats cinder:SELECT=24,cinder:UPDATE=27,cinder:INSERT=5 {{(pid=85458) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 22:09:54 devstack cinder-volume[85458]: DEBUG dbcounter [-] [85458] Writing DB stats cinder:SELECT=22,cinder:UPDATE=19,cinder:INSERT=7,cinder:DELETE=2 {{(pid=85458) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 22:09:55 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c8057c2-3647-41b8-9c30-d018b6403ade tempest-CreateVolumesFromImageTest-1672173559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 22:09:55 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-3c8057c2-3647-41b8-9c30-d018b6403ade tempest-CreateVolumesFromImageTest-1672173559 None] Flow 'volume_create_manager' (333350fb-c8f6-40f8-9925-3c72126debb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:09:55 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-3c8057c2-3647-41b8-9c30-d018b6403ade tempest-CreateVolumesFromImageTest-1672173559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45b066e8-5b2e-4fa5-87fe-2556ff737f2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:09:55 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-3c8057c2-3647-41b8-9c30-d018b6403ade tempest-CreateVolumesFromImageTest-1672173559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45b066e8-5b2e-4fa5-87fe-2556ff737f2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:09:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1887653292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2bafe7c-8d15-4fef-bb21-ccec280f453f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fee19ad95174657a0c02a07909011c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:09:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:09:55Z,use_quota=True,user_id='8c34feecb603416ea85919fe6d75bf65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:09:55 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-3c8057c2-3647-41b8-9c30-d018b6403ade tempest-CreateVolumesFromImageTest-1672173559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ff71727-2a33-44d7-bfc7-822eb8651b3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:09:55 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-3c8057c2-3647-41b8-9c30-d018b6403ade tempest-CreateVolumesFromImageTest-1672173559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ff71727-2a33-44d7-bfc7-822eb8651b3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:09:55 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-3c8057c2-3647-41b8-9c30-d018b6403ade tempest-CreateVolumesFromImageTest-1672173559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f8737a2-6262-4cd7-b49d-c72542fc243a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:09:55 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-3c8057c2-3647-41b8-9c30-d018b6403ade tempest-CreateVolumesFromImageTest-1672173559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f8737a2-6262-4cd7-b49d-c72542fc243a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2bafe7c-8d15-4fef-bb21-ccec280f453f', 'volume_name': 'volume-d2bafe7c-8d15-4fef-bb21-ccec280f453f', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:09:55 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-3c8057c2-3647-41b8-9c30-d018b6403ade tempest-CreateVolumesFromImageTest-1672173559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (496578fa-3f97-471f-ab69-2791a038ab4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:09:55 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-3c8057c2-3647-41b8-9c30-d018b6403ade tempest-CreateVolumesFromImageTest-1672173559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (496578fa-3f97-471f-ab69-2791a038ab4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:09:55 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-3c8057c2-3647-41b8-9c30-d018b6403ade tempest-CreateVolumesFromImageTest-1672173559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b4f3c39-0722-41d5-a55a-2e795a00dc71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:09:55 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-3c8057c2-3647-41b8-9c30-d018b6403ade tempest-CreateVolumesFromImageTest-1672173559 None] Volume d2bafe7c-8d15-4fef-bb21-ccec280f453f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2bafe7c-8d15-4fef-bb21-ccec280f453f', 'volume_size': 1} Sep 17 22:09:55 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-3c8057c2-3647-41b8-9c30-d018b6403ade tempest-CreateVolumesFromImageTest-1672173559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:09:55 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-3c8057c2-3647-41b8-9c30-d018b6403ade tempest-CreateVolumesFromImageTest-1672173559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:09:55 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-3c8057c2-3647-41b8-9c30-d018b6403ade tempest-CreateVolumesFromImageTest-1672173559 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:09:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1887653292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2bafe7c-8d15-4fef-bb21-ccec280f453f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fee19ad95174657a0c02a07909011c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:09:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:09:55Z,use_quota=True,user_id='8c34feecb603416ea85919fe6d75bf65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 22:09:55 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-3c8057c2-3647-41b8-9c30-d018b6403ade tempest-CreateVolumesFromImageTest-1672173559 None] Creating volume d2bafe7c-8d15-4fef-bb21-ccec280f453f {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 22:09:55 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-3c8057c2-3647-41b8-9c30-d018b6403ade tempest-CreateVolumesFromImageTest-1672173559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:09:55 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-3c8057c2-3647-41b8-9c30-d018b6403ade tempest-CreateVolumesFromImageTest-1672173559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:09:55 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-3c8057c2-3647-41b8-9c30-d018b6403ade tempest-CreateVolumesFromImageTest-1672173559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:09:55 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-3c8057c2-3647-41b8-9c30-d018b6403ade tempest-CreateVolumesFromImageTest-1672173559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:09:55 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-3c8057c2-3647-41b8-9c30-d018b6403ade tempest-CreateVolumesFromImageTest-1672173559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:09:55 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-3c8057c2-3647-41b8-9c30-d018b6403ade tempest-CreateVolumesFromImageTest-1672173559 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 22:09:55 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-3c8057c2-3647-41b8-9c30-d018b6403ade tempest-CreateVolumesFromImageTest-1672173559 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 22:09:55 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-3c8057c2-3647-41b8-9c30-d018b6403ade tempest-CreateVolumesFromImageTest-1672173559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-d2bafe7c-8d15-4fef-bb21-ccec280f453f 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:09:55 devstack sudo[103871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-d2bafe7c-8d15-4fef-bb21-ccec280f453f 1073741824 Sep 17 22:09:55 devstack sudo[103871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:09:55 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-fab52e4f-d5b9-454d-867e-3323ffc11596 tempest-CreateVolumesFromImageTest-1672173559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 22:09:55 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-fab52e4f-d5b9-454d-867e-3323ffc11596 tempest-CreateVolumesFromImageTest-1672173559 None] Flow 'volume_create_manager' (86da693d-9625-4663-a0af-d272fecb2a4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:09:55 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-fab52e4f-d5b9-454d-867e-3323ffc11596 tempest-CreateVolumesFromImageTest-1672173559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14d00b1e-75d8-40b4-8096-5658ff3a373d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:09:55 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-fab52e4f-d5b9-454d-867e-3323ffc11596 tempest-CreateVolumesFromImageTest-1672173559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14d00b1e-75d8-40b4-8096-5658ff3a373d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:09:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1415654717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a76e6ae-9579-4570-b151-d060e47cee40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fee19ad95174657a0c02a07909011c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:09:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:09:56Z,use_quota=True,user_id='8c34feecb603416ea85919fe6d75bf65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:09:55 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-fab52e4f-d5b9-454d-867e-3323ffc11596 tempest-CreateVolumesFromImageTest-1672173559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77c79a54-b860-412f-85f1-b373f75bc1d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:09:55 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-fab52e4f-d5b9-454d-867e-3323ffc11596 tempest-CreateVolumesFromImageTest-1672173559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77c79a54-b860-412f-85f1-b373f75bc1d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:09:55 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-fab52e4f-d5b9-454d-867e-3323ffc11596 tempest-CreateVolumesFromImageTest-1672173559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1fb0fba-cdb4-4558-928e-0b9e6c421944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:09:55 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-fab52e4f-d5b9-454d-867e-3323ffc11596 tempest-CreateVolumesFromImageTest-1672173559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1fb0fba-cdb4-4558-928e-0b9e6c421944) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a76e6ae-9579-4570-b151-d060e47cee40', 'volume_name': 'volume-3a76e6ae-9579-4570-b151-d060e47cee40', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:09:55 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-fab52e4f-d5b9-454d-867e-3323ffc11596 tempest-CreateVolumesFromImageTest-1672173559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca401bb1-75de-4e07-a313-17c511b33a93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:09:55 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-fab52e4f-d5b9-454d-867e-3323ffc11596 tempest-CreateVolumesFromImageTest-1672173559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca401bb1-75de-4e07-a313-17c511b33a93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:09:55 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-fab52e4f-d5b9-454d-867e-3323ffc11596 tempest-CreateVolumesFromImageTest-1672173559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc7c7a19-1fca-44e6-91ae-430041a187a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:09:55 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-fab52e4f-d5b9-454d-867e-3323ffc11596 tempest-CreateVolumesFromImageTest-1672173559 None] Volume 3a76e6ae-9579-4570-b151-d060e47cee40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a76e6ae-9579-4570-b151-d060e47cee40', 'volume_size': 1} Sep 17 22:09:55 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-fab52e4f-d5b9-454d-867e-3323ffc11596 tempest-CreateVolumesFromImageTest-1672173559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:09:56 devstack sudo[103871]: pam_unix(sudo:session): session closed for user root Sep 17 22:09:56 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-3c8057c2-3647-41b8-9c30-d018b6403ade tempest-CreateVolumesFromImageTest-1672173559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-d2bafe7c-8d15-4fef-bb21-ccec280f453f 1073741824" returned: 0 in 0.498s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:09:56 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-3c8057c2-3647-41b8-9c30-d018b6403ade tempest-CreateVolumesFromImageTest-1672173559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-d2bafe7c-8d15-4fef-bb21-ccec280f453f {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:09:56 devstack sudo[103877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-d2bafe7c-8d15-4fef-bb21-ccec280f453f Sep 17 22:09:56 devstack sudo[103877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:09:56 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-2de2fe18-4fd6-4867-bd2f-d51c9e1eba80 tempest-CreateVolumesFromImageTest-1672173559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 22:09:56 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-2de2fe18-4fd6-4867-bd2f-d51c9e1eba80 tempest-CreateVolumesFromImageTest-1672173559 None] Flow 'volume_create_manager' (bc9598fc-9b6e-4d7f-88dd-9ad372223a25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:09:56 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-2de2fe18-4fd6-4867-bd2f-d51c9e1eba80 tempest-CreateVolumesFromImageTest-1672173559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5942b4ee-1aa3-4cf2-ba67-199849933a5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:09:56 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-2de2fe18-4fd6-4867-bd2f-d51c9e1eba80 tempest-CreateVolumesFromImageTest-1672173559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5942b4ee-1aa3-4cf2-ba67-199849933a5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:09:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-54942343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61a0e563-23ea-4d36-b75c-bbc9bfbe593e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fee19ad95174657a0c02a07909011c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:09:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:09:56Z,use_quota=True,user_id='8c34feecb603416ea85919fe6d75bf65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:09:56 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-2de2fe18-4fd6-4867-bd2f-d51c9e1eba80 tempest-CreateVolumesFromImageTest-1672173559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4985e973-4b9b-4bee-8c75-31cefb0c6002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:09:56 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-2de2fe18-4fd6-4867-bd2f-d51c9e1eba80 tempest-CreateVolumesFromImageTest-1672173559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4985e973-4b9b-4bee-8c75-31cefb0c6002) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:09:56 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-2de2fe18-4fd6-4867-bd2f-d51c9e1eba80 tempest-CreateVolumesFromImageTest-1672173559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1234437a-3c49-4b44-8b6c-3b83e23b4e2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:09:56 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-2de2fe18-4fd6-4867-bd2f-d51c9e1eba80 tempest-CreateVolumesFromImageTest-1672173559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1234437a-3c49-4b44-8b6c-3b83e23b4e2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61a0e563-23ea-4d36-b75c-bbc9bfbe593e', 'volume_name': 'volume-61a0e563-23ea-4d36-b75c-bbc9bfbe593e', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:09:56 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-2de2fe18-4fd6-4867-bd2f-d51c9e1eba80 tempest-CreateVolumesFromImageTest-1672173559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a00fd954-1493-4c6c-983d-e1492a38e681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:09:56 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-2de2fe18-4fd6-4867-bd2f-d51c9e1eba80 tempest-CreateVolumesFromImageTest-1672173559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a00fd954-1493-4c6c-983d-e1492a38e681) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:09:56 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-2de2fe18-4fd6-4867-bd2f-d51c9e1eba80 tempest-CreateVolumesFromImageTest-1672173559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59ba8e37-b527-4334-80ca-5d0dca4d050a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:09:56 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-2de2fe18-4fd6-4867-bd2f-d51c9e1eba80 tempest-CreateVolumesFromImageTest-1672173559 None] Volume 61a0e563-23ea-4d36-b75c-bbc9bfbe593e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61a0e563-23ea-4d36-b75c-bbc9bfbe593e', 'volume_size': 1} Sep 17 22:09:56 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-2de2fe18-4fd6-4867-bd2f-d51c9e1eba80 tempest-CreateVolumesFromImageTest-1672173559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:09:56 devstack sudo[103877]: pam_unix(sudo:session): session closed for user root Sep 17 22:09:56 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-3c8057c2-3647-41b8-9c30-d018b6403ade tempest-CreateVolumesFromImageTest-1672173559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-d2bafe7c-8d15-4fef-bb21-ccec280f453f" returned: 0 in 0.296s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:09:56 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-3c8057c2-3647-41b8-9c30-d018b6403ade tempest-CreateVolumesFromImageTest-1672173559 None] <== create_volume: return (841ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 22:09:56 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-3c8057c2-3647-41b8-9c30-d018b6403ade tempest-CreateVolumesFromImageTest-1672173559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.843s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:09:56 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-fab52e4f-d5b9-454d-867e-3323ffc11596 tempest-CreateVolumesFromImageTest-1672173559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.457s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:09:56 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-fab52e4f-d5b9-454d-867e-3323ffc11596 tempest-CreateVolumesFromImageTest-1672173559 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:09:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1415654717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a76e6ae-9579-4570-b151-d060e47cee40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fee19ad95174657a0c02a07909011c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:09:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:09:56Z,use_quota=True,user_id='8c34feecb603416ea85919fe6d75bf65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 22:09:56 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-fab52e4f-d5b9-454d-867e-3323ffc11596 tempest-CreateVolumesFromImageTest-1672173559 None] Creating volume 3a76e6ae-9579-4570-b151-d060e47cee40 {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 22:09:56 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-fab52e4f-d5b9-454d-867e-3323ffc11596 tempest-CreateVolumesFromImageTest-1672173559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:09:56 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-fab52e4f-d5b9-454d-867e-3323ffc11596 tempest-CreateVolumesFromImageTest-1672173559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:09:56 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-fab52e4f-d5b9-454d-867e-3323ffc11596 tempest-CreateVolumesFromImageTest-1672173559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:09:56 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-fab52e4f-d5b9-454d-867e-3323ffc11596 tempest-CreateVolumesFromImageTest-1672173559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:09:56 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-fab52e4f-d5b9-454d-867e-3323ffc11596 tempest-CreateVolumesFromImageTest-1672173559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:09:56 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-fab52e4f-d5b9-454d-867e-3323ffc11596 tempest-CreateVolumesFromImageTest-1672173559 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 22:09:56 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-fab52e4f-d5b9-454d-867e-3323ffc11596 tempest-CreateVolumesFromImageTest-1672173559 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 22:09:56 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-fab52e4f-d5b9-454d-867e-3323ffc11596 tempest-CreateVolumesFromImageTest-1672173559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-3a76e6ae-9579-4570-b151-d060e47cee40 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:09:56 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-3c8057c2-3647-41b8-9c30-d018b6403ade tempest-CreateVolumesFromImageTest-1672173559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b4f3c39-0722-41d5-a55a-2e795a00dc71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2bafe7c-8d15-4fef-bb21-ccec280f453f', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:09:56 devstack sudo[103880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-3a76e6ae-9579-4570-b151-d060e47cee40 1073741824 Sep 17 22:09:56 devstack sudo[103880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:09:56 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-3c8057c2-3647-41b8-9c30-d018b6403ade tempest-CreateVolumesFromImageTest-1672173559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (713ccff0-69ec-4766-a010-f81ac4f269a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:09:56 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-3c8057c2-3647-41b8-9c30-d018b6403ade tempest-CreateVolumesFromImageTest-1672173559 None] Volume volume-d2bafe7c-8d15-4fef-bb21-ccec280f453f (d2bafe7c-8d15-4fef-bb21-ccec280f453f): created successfully Sep 17 22:09:56 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-3c8057c2-3647-41b8-9c30-d018b6403ade tempest-CreateVolumesFromImageTest-1672173559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (713ccff0-69ec-4766-a010-f81ac4f269a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:09:56 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-3c8057c2-3647-41b8-9c30-d018b6403ade tempest-CreateVolumesFromImageTest-1672173559 None] Flow 'volume_create_manager' (333350fb-c8f6-40f8-9925-3c72126debb4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:09:56 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-3c8057c2-3647-41b8-9c30-d018b6403ade tempest-CreateVolumesFromImageTest-1672173559 None] Created volume successfully. Sep 17 22:09:56 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-9925fe02-6b82-4953-80b7-896de0eef67e tempest-CreateVolumesFromImageTest-1672173559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 22:09:56 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-9925fe02-6b82-4953-80b7-896de0eef67e tempest-CreateVolumesFromImageTest-1672173559 None] Flow 'volume_create_manager' (15767a59-507d-425a-b253-908bc266f8f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:09:56 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-9925fe02-6b82-4953-80b7-896de0eef67e tempest-CreateVolumesFromImageTest-1672173559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (564c7e02-76a7-4f0a-ad41-d8fd7be97abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:09:56 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-9925fe02-6b82-4953-80b7-896de0eef67e tempest-CreateVolumesFromImageTest-1672173559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (564c7e02-76a7-4f0a-ad41-d8fd7be97abe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:09:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1162707316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=978f92d4-e9bd-4f7c-9102-6bff19bf3d17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fee19ad95174657a0c02a07909011c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:09:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:09:57Z,use_quota=True,user_id='8c34feecb603416ea85919fe6d75bf65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:09:56 devstack sudo[103880]: pam_unix(sudo:session): session closed for user root Sep 17 22:09:56 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-9925fe02-6b82-4953-80b7-896de0eef67e tempest-CreateVolumesFromImageTest-1672173559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40d8c677-2373-43cd-aea7-47994bf3bd38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:09:56 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-9925fe02-6b82-4953-80b7-896de0eef67e tempest-CreateVolumesFromImageTest-1672173559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40d8c677-2373-43cd-aea7-47994bf3bd38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:09:56 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-9925fe02-6b82-4953-80b7-896de0eef67e tempest-CreateVolumesFromImageTest-1672173559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f28af8a-56b3-45a1-9d24-1004bb40cfc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:09:56 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-9925fe02-6b82-4953-80b7-896de0eef67e tempest-CreateVolumesFromImageTest-1672173559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f28af8a-56b3-45a1-9d24-1004bb40cfc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '978f92d4-e9bd-4f7c-9102-6bff19bf3d17', 'volume_name': 'volume-978f92d4-e9bd-4f7c-9102-6bff19bf3d17', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:09:56 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-9925fe02-6b82-4953-80b7-896de0eef67e tempest-CreateVolumesFromImageTest-1672173559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5c5133c-d719-457b-b24c-4d21e6d09e58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:09:56 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-9925fe02-6b82-4953-80b7-896de0eef67e tempest-CreateVolumesFromImageTest-1672173559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5c5133c-d719-457b-b24c-4d21e6d09e58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:09:56 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-9925fe02-6b82-4953-80b7-896de0eef67e tempest-CreateVolumesFromImageTest-1672173559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (337afbf5-024a-4b20-99a9-3e99467affbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:09:56 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-9925fe02-6b82-4953-80b7-896de0eef67e tempest-CreateVolumesFromImageTest-1672173559 None] Volume 978f92d4-e9bd-4f7c-9102-6bff19bf3d17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-978f92d4-e9bd-4f7c-9102-6bff19bf3d17', 'volume_size': 1} Sep 17 22:09:56 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-9925fe02-6b82-4953-80b7-896de0eef67e tempest-CreateVolumesFromImageTest-1672173559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:09:56 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-fab52e4f-d5b9-454d-867e-3323ffc11596 tempest-CreateVolumesFromImageTest-1672173559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-3a76e6ae-9579-4570-b151-d060e47cee40 1073741824" returned: 0 in 0.537s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:09:56 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-fab52e4f-d5b9-454d-867e-3323ffc11596 tempest-CreateVolumesFromImageTest-1672173559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-3a76e6ae-9579-4570-b151-d060e47cee40 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:09:57 devstack sudo[103886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-3a76e6ae-9579-4570-b151-d060e47cee40 Sep 17 22:09:57 devstack sudo[103886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:09:57 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-9533b658-2be8-419c-ae41-b2aeca9f0c78 tempest-CreateVolumesFromImageTest-1672173559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 22:09:57 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-9533b658-2be8-419c-ae41-b2aeca9f0c78 tempest-CreateVolumesFromImageTest-1672173559 None] Flow 'volume_create_manager' (247ef07b-0857-428e-a616-3fd687e944cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:09:57 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-9533b658-2be8-419c-ae41-b2aeca9f0c78 tempest-CreateVolumesFromImageTest-1672173559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16e17b54-56ff-4bc5-a22d-0b7801a1e187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:09:57 devstack sudo[103886]: pam_unix(sudo:session): session closed for user root Sep 17 22:09:57 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-9533b658-2be8-419c-ae41-b2aeca9f0c78 tempest-CreateVolumesFromImageTest-1672173559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16e17b54-56ff-4bc5-a22d-0b7801a1e187) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:09:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1875853502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a3b750e-b5ab-4025-9146-86fb5bb28a8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fee19ad95174657a0c02a07909011c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:09:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:09:57Z,use_quota=True,user_id='8c34feecb603416ea85919fe6d75bf65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:09:57 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-9533b658-2be8-419c-ae41-b2aeca9f0c78 tempest-CreateVolumesFromImageTest-1672173559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e574d4e8-2caf-4726-857b-c44305aedb2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:09:57 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-9533b658-2be8-419c-ae41-b2aeca9f0c78 tempest-CreateVolumesFromImageTest-1672173559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e574d4e8-2caf-4726-857b-c44305aedb2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:09:57 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-9533b658-2be8-419c-ae41-b2aeca9f0c78 tempest-CreateVolumesFromImageTest-1672173559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (709c201e-6bc5-43db-bc7c-c9ce673c81b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:09:57 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-9533b658-2be8-419c-ae41-b2aeca9f0c78 tempest-CreateVolumesFromImageTest-1672173559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (709c201e-6bc5-43db-bc7c-c9ce673c81b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a3b750e-b5ab-4025-9146-86fb5bb28a8e', 'volume_name': 'volume-8a3b750e-b5ab-4025-9146-86fb5bb28a8e', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:09:57 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-9533b658-2be8-419c-ae41-b2aeca9f0c78 tempest-CreateVolumesFromImageTest-1672173559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b178810-4f65-477b-9e7c-43d949664d74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:09:57 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-9533b658-2be8-419c-ae41-b2aeca9f0c78 tempest-CreateVolumesFromImageTest-1672173559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b178810-4f65-477b-9e7c-43d949664d74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:09:57 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-9533b658-2be8-419c-ae41-b2aeca9f0c78 tempest-CreateVolumesFromImageTest-1672173559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5172575a-46eb-4c30-8630-a46ad709a1f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:09:57 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-9533b658-2be8-419c-ae41-b2aeca9f0c78 tempest-CreateVolumesFromImageTest-1672173559 None] Volume 8a3b750e-b5ab-4025-9146-86fb5bb28a8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a3b750e-b5ab-4025-9146-86fb5bb28a8e', 'volume_size': 1} Sep 17 22:09:57 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-9533b658-2be8-419c-ae41-b2aeca9f0c78 tempest-CreateVolumesFromImageTest-1672173559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:09:57 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-fab52e4f-d5b9-454d-867e-3323ffc11596 tempest-CreateVolumesFromImageTest-1672173559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-3a76e6ae-9579-4570-b151-d060e47cee40" returned: 0 in 0.351s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:09:57 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-fab52e4f-d5b9-454d-867e-3323ffc11596 tempest-CreateVolumesFromImageTest-1672173559 None] <== create_volume: return (933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 22:09:57 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-fab52e4f-d5b9-454d-867e-3323ffc11596 tempest-CreateVolumesFromImageTest-1672173559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.935s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:09:57 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-2de2fe18-4fd6-4867-bd2f-d51c9e1eba80 tempest-CreateVolumesFromImageTest-1672173559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.991s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:09:57 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-2de2fe18-4fd6-4867-bd2f-d51c9e1eba80 tempest-CreateVolumesFromImageTest-1672173559 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:09:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-54942343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61a0e563-23ea-4d36-b75c-bbc9bfbe593e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fee19ad95174657a0c02a07909011c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:09:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:09:56Z,use_quota=True,user_id='8c34feecb603416ea85919fe6d75bf65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 22:09:57 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-2de2fe18-4fd6-4867-bd2f-d51c9e1eba80 tempest-CreateVolumesFromImageTest-1672173559 None] Creating volume 61a0e563-23ea-4d36-b75c-bbc9bfbe593e {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 22:09:57 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-2de2fe18-4fd6-4867-bd2f-d51c9e1eba80 tempest-CreateVolumesFromImageTest-1672173559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:09:57 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-2de2fe18-4fd6-4867-bd2f-d51c9e1eba80 tempest-CreateVolumesFromImageTest-1672173559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:09:57 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-2de2fe18-4fd6-4867-bd2f-d51c9e1eba80 tempest-CreateVolumesFromImageTest-1672173559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:09:57 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-2de2fe18-4fd6-4867-bd2f-d51c9e1eba80 tempest-CreateVolumesFromImageTest-1672173559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:09:57 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-2de2fe18-4fd6-4867-bd2f-d51c9e1eba80 tempest-CreateVolumesFromImageTest-1672173559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:09:57 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-2de2fe18-4fd6-4867-bd2f-d51c9e1eba80 tempest-CreateVolumesFromImageTest-1672173559 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 22:09:57 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-2de2fe18-4fd6-4867-bd2f-d51c9e1eba80 tempest-CreateVolumesFromImageTest-1672173559 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 22:09:57 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-2de2fe18-4fd6-4867-bd2f-d51c9e1eba80 tempest-CreateVolumesFromImageTest-1672173559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-61a0e563-23ea-4d36-b75c-bbc9bfbe593e 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:09:57 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-fab52e4f-d5b9-454d-867e-3323ffc11596 tempest-CreateVolumesFromImageTest-1672173559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc7c7a19-1fca-44e6-91ae-430041a187a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a76e6ae-9579-4570-b151-d060e47cee40', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:09:57 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-fab52e4f-d5b9-454d-867e-3323ffc11596 tempest-CreateVolumesFromImageTest-1672173559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd1e5525-09cd-4765-811e-02126dc18b68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:09:57 devstack sudo[103889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-61a0e563-23ea-4d36-b75c-bbc9bfbe593e 1073741824 Sep 17 22:09:57 devstack sudo[103889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:09:57 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-fab52e4f-d5b9-454d-867e-3323ffc11596 tempest-CreateVolumesFromImageTest-1672173559 None] Volume volume-3a76e6ae-9579-4570-b151-d060e47cee40 (3a76e6ae-9579-4570-b151-d060e47cee40): created successfully Sep 17 22:09:57 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-fab52e4f-d5b9-454d-867e-3323ffc11596 tempest-CreateVolumesFromImageTest-1672173559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd1e5525-09cd-4765-811e-02126dc18b68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:09:57 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-fab52e4f-d5b9-454d-867e-3323ffc11596 tempest-CreateVolumesFromImageTest-1672173559 None] Flow 'volume_create_manager' (86da693d-9625-4663-a0af-d272fecb2a4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:09:57 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-fab52e4f-d5b9-454d-867e-3323ffc11596 tempest-CreateVolumesFromImageTest-1672173559 None] Created volume successfully. Sep 17 22:09:57 devstack sudo[103889]: pam_unix(sudo:session): session closed for user root Sep 17 22:09:57 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-2de2fe18-4fd6-4867-bd2f-d51c9e1eba80 tempest-CreateVolumesFromImageTest-1672173559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-61a0e563-23ea-4d36-b75c-bbc9bfbe593e 1073741824" returned: 0 in 0.413s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:09:57 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-2de2fe18-4fd6-4867-bd2f-d51c9e1eba80 tempest-CreateVolumesFromImageTest-1672173559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-61a0e563-23ea-4d36-b75c-bbc9bfbe593e {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:09:57 devstack sudo[103895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-61a0e563-23ea-4d36-b75c-bbc9bfbe593e Sep 17 22:09:57 devstack sudo[103895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:09:58 devstack sudo[103895]: pam_unix(sudo:session): session closed for user root Sep 17 22:09:58 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-2de2fe18-4fd6-4867-bd2f-d51c9e1eba80 tempest-CreateVolumesFromImageTest-1672173559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-61a0e563-23ea-4d36-b75c-bbc9bfbe593e" returned: 0 in 0.247s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:09:58 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-2de2fe18-4fd6-4867-bd2f-d51c9e1eba80 tempest-CreateVolumesFromImageTest-1672173559 None] <== create_volume: return (705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 22:09:58 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-2de2fe18-4fd6-4867-bd2f-d51c9e1eba80 tempest-CreateVolumesFromImageTest-1672173559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.708s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:09:58 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-9925fe02-6b82-4953-80b7-896de0eef67e tempest-CreateVolumesFromImageTest-1672173559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.103s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:09:58 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-9925fe02-6b82-4953-80b7-896de0eef67e tempest-CreateVolumesFromImageTest-1672173559 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:09:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1162707316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=978f92d4-e9bd-4f7c-9102-6bff19bf3d17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fee19ad95174657a0c02a07909011c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:09:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:09:57Z,use_quota=True,user_id='8c34feecb603416ea85919fe6d75bf65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 22:09:58 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-9925fe02-6b82-4953-80b7-896de0eef67e tempest-CreateVolumesFromImageTest-1672173559 None] Creating volume 978f92d4-e9bd-4f7c-9102-6bff19bf3d17 {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 22:09:58 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-9925fe02-6b82-4953-80b7-896de0eef67e tempest-CreateVolumesFromImageTest-1672173559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:09:58 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-9925fe02-6b82-4953-80b7-896de0eef67e tempest-CreateVolumesFromImageTest-1672173559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:09:58 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-9925fe02-6b82-4953-80b7-896de0eef67e tempest-CreateVolumesFromImageTest-1672173559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:09:58 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-9925fe02-6b82-4953-80b7-896de0eef67e tempest-CreateVolumesFromImageTest-1672173559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:09:58 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-9925fe02-6b82-4953-80b7-896de0eef67e tempest-CreateVolumesFromImageTest-1672173559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:09:58 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-9925fe02-6b82-4953-80b7-896de0eef67e tempest-CreateVolumesFromImageTest-1672173559 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 22:09:58 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-9925fe02-6b82-4953-80b7-896de0eef67e tempest-CreateVolumesFromImageTest-1672173559 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 22:09:58 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-9925fe02-6b82-4953-80b7-896de0eef67e tempest-CreateVolumesFromImageTest-1672173559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-978f92d4-e9bd-4f7c-9102-6bff19bf3d17 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:09:58 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-2de2fe18-4fd6-4867-bd2f-d51c9e1eba80 tempest-CreateVolumesFromImageTest-1672173559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59ba8e37-b527-4334-80ca-5d0dca4d050a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61a0e563-23ea-4d36-b75c-bbc9bfbe593e', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:09:58 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-2de2fe18-4fd6-4867-bd2f-d51c9e1eba80 tempest-CreateVolumesFromImageTest-1672173559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (971e900e-0a18-4c47-8e84-3dd84694f263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:09:58 devstack sudo[103898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-978f92d4-e9bd-4f7c-9102-6bff19bf3d17 1073741824 Sep 17 22:09:58 devstack sudo[103898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:09:58 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-2de2fe18-4fd6-4867-bd2f-d51c9e1eba80 tempest-CreateVolumesFromImageTest-1672173559 None] Volume volume-61a0e563-23ea-4d36-b75c-bbc9bfbe593e (61a0e563-23ea-4d36-b75c-bbc9bfbe593e): created successfully Sep 17 22:09:58 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-2de2fe18-4fd6-4867-bd2f-d51c9e1eba80 tempest-CreateVolumesFromImageTest-1672173559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (971e900e-0a18-4c47-8e84-3dd84694f263) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:09:58 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-2de2fe18-4fd6-4867-bd2f-d51c9e1eba80 tempest-CreateVolumesFromImageTest-1672173559 None] Flow 'volume_create_manager' (bc9598fc-9b6e-4d7f-88dd-9ad372223a25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:09:58 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-2de2fe18-4fd6-4867-bd2f-d51c9e1eba80 tempest-CreateVolumesFromImageTest-1672173559 None] Created volume successfully. Sep 17 22:09:58 devstack sudo[103898]: pam_unix(sudo:session): session closed for user root Sep 17 22:09:58 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-9925fe02-6b82-4953-80b7-896de0eef67e tempest-CreateVolumesFromImageTest-1672173559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-978f92d4-e9bd-4f7c-9102-6bff19bf3d17 1073741824" returned: 0 in 0.458s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:09:58 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-9925fe02-6b82-4953-80b7-896de0eef67e tempest-CreateVolumesFromImageTest-1672173559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-978f92d4-e9bd-4f7c-9102-6bff19bf3d17 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:09:58 devstack sudo[103903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-978f92d4-e9bd-4f7c-9102-6bff19bf3d17 Sep 17 22:09:58 devstack sudo[103903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:09:58 devstack sudo[103903]: pam_unix(sudo:session): session closed for user root Sep 17 22:09:58 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-9925fe02-6b82-4953-80b7-896de0eef67e tempest-CreateVolumesFromImageTest-1672173559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-978f92d4-e9bd-4f7c-9102-6bff19bf3d17" returned: 0 in 0.240s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:09:58 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-9925fe02-6b82-4953-80b7-896de0eef67e tempest-CreateVolumesFromImageTest-1672173559 None] <== create_volume: return (738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 22:09:58 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-9925fe02-6b82-4953-80b7-896de0eef67e tempest-CreateVolumesFromImageTest-1672173559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.742s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:09:58 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-9533b658-2be8-419c-ae41-b2aeca9f0c78 tempest-CreateVolumesFromImageTest-1672173559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.463s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:09:58 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-9533b658-2be8-419c-ae41-b2aeca9f0c78 tempest-CreateVolumesFromImageTest-1672173559 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:09:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1875853502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a3b750e-b5ab-4025-9146-86fb5bb28a8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fee19ad95174657a0c02a07909011c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:09:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:09:57Z,use_quota=True,user_id='8c34feecb603416ea85919fe6d75bf65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 22:09:58 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-9533b658-2be8-419c-ae41-b2aeca9f0c78 tempest-CreateVolumesFromImageTest-1672173559 None] Creating volume 8a3b750e-b5ab-4025-9146-86fb5bb28a8e {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 22:09:58 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-9533b658-2be8-419c-ae41-b2aeca9f0c78 tempest-CreateVolumesFromImageTest-1672173559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:09:58 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-9533b658-2be8-419c-ae41-b2aeca9f0c78 tempest-CreateVolumesFromImageTest-1672173559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:09:58 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-9533b658-2be8-419c-ae41-b2aeca9f0c78 tempest-CreateVolumesFromImageTest-1672173559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:09:58 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-9533b658-2be8-419c-ae41-b2aeca9f0c78 tempest-CreateVolumesFromImageTest-1672173559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:09:58 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-9533b658-2be8-419c-ae41-b2aeca9f0c78 tempest-CreateVolumesFromImageTest-1672173559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:09:58 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-9533b658-2be8-419c-ae41-b2aeca9f0c78 tempest-CreateVolumesFromImageTest-1672173559 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 22:09:58 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-9533b658-2be8-419c-ae41-b2aeca9f0c78 tempest-CreateVolumesFromImageTest-1672173559 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 22:09:58 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-9533b658-2be8-419c-ae41-b2aeca9f0c78 tempest-CreateVolumesFromImageTest-1672173559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8a3b750e-b5ab-4025-9146-86fb5bb28a8e 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:09:58 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-9925fe02-6b82-4953-80b7-896de0eef67e tempest-CreateVolumesFromImageTest-1672173559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (337afbf5-024a-4b20-99a9-3e99467affbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-978f92d4-e9bd-4f7c-9102-6bff19bf3d17', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:09:58 devstack sudo[103906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8a3b750e-b5ab-4025-9146-86fb5bb28a8e 1073741824 Sep 17 22:09:58 devstack sudo[103906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:09:58 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-9925fe02-6b82-4953-80b7-896de0eef67e tempest-CreateVolumesFromImageTest-1672173559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dfd96b1-0bc7-4356-b5a3-b1cf4145bfb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:09:58 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-9925fe02-6b82-4953-80b7-896de0eef67e tempest-CreateVolumesFromImageTest-1672173559 None] Volume volume-978f92d4-e9bd-4f7c-9102-6bff19bf3d17 (978f92d4-e9bd-4f7c-9102-6bff19bf3d17): created successfully Sep 17 22:09:58 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-9925fe02-6b82-4953-80b7-896de0eef67e tempest-CreateVolumesFromImageTest-1672173559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dfd96b1-0bc7-4356-b5a3-b1cf4145bfb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:09:58 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-9925fe02-6b82-4953-80b7-896de0eef67e tempest-CreateVolumesFromImageTest-1672173559 None] Flow 'volume_create_manager' (15767a59-507d-425a-b253-908bc266f8f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:09:58 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-9925fe02-6b82-4953-80b7-896de0eef67e tempest-CreateVolumesFromImageTest-1672173559 None] Created volume successfully. Sep 17 22:09:59 devstack sudo[103906]: pam_unix(sudo:session): session closed for user root Sep 17 22:09:59 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-9533b658-2be8-419c-ae41-b2aeca9f0c78 tempest-CreateVolumesFromImageTest-1672173559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8a3b750e-b5ab-4025-9146-86fb5bb28a8e 1073741824" returned: 0 in 0.419s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:09:59 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-9533b658-2be8-419c-ae41-b2aeca9f0c78 tempest-CreateVolumesFromImageTest-1672173559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8a3b750e-b5ab-4025-9146-86fb5bb28a8e {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:09:59 devstack sudo[103912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8a3b750e-b5ab-4025-9146-86fb5bb28a8e Sep 17 22:09:59 devstack sudo[103912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:09:59 devstack sudo[103912]: pam_unix(sudo:session): session closed for user root Sep 17 22:09:59 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-9533b658-2be8-419c-ae41-b2aeca9f0c78 tempest-CreateVolumesFromImageTest-1672173559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8a3b750e-b5ab-4025-9146-86fb5bb28a8e" returned: 0 in 0.256s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:09:59 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-9533b658-2be8-419c-ae41-b2aeca9f0c78 tempest-CreateVolumesFromImageTest-1672173559 None] <== create_volume: return (710ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 22:09:59 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-9533b658-2be8-419c-ae41-b2aeca9f0c78 tempest-CreateVolumesFromImageTest-1672173559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.712s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:09:59 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-9533b658-2be8-419c-ae41-b2aeca9f0c78 tempest-CreateVolumesFromImageTest-1672173559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5172575a-46eb-4c30-8630-a46ad709a1f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a3b750e-b5ab-4025-9146-86fb5bb28a8e', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:09:59 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-9533b658-2be8-419c-ae41-b2aeca9f0c78 tempest-CreateVolumesFromImageTest-1672173559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35a50d1c-481a-4bea-aad3-512114bffb50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:09:59 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-9533b658-2be8-419c-ae41-b2aeca9f0c78 tempest-CreateVolumesFromImageTest-1672173559 None] Volume volume-8a3b750e-b5ab-4025-9146-86fb5bb28a8e (8a3b750e-b5ab-4025-9146-86fb5bb28a8e): created successfully Sep 17 22:09:59 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-9533b658-2be8-419c-ae41-b2aeca9f0c78 tempest-CreateVolumesFromImageTest-1672173559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35a50d1c-481a-4bea-aad3-512114bffb50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:09:59 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-9533b658-2be8-419c-ae41-b2aeca9f0c78 tempest-CreateVolumesFromImageTest-1672173559 None] Flow 'volume_create_manager' (247ef07b-0857-428e-a616-3fd687e944cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:09:59 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-9533b658-2be8-419c-ae41-b2aeca9f0c78 tempest-CreateVolumesFromImageTest-1672173559 None] Created volume successfully. Sep 17 22:10:00 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-5e360a5c-cdef-4144-90ab-dc85cd156f9c tempest-CreateVolumesFromImageTest-1672173559 None] Acquiring lock "cinder-8a3b750e-b5ab-4025-9146-86fb5bb28a8e-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:10:00 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-5e360a5c-cdef-4144-90ab-dc85cd156f9c tempest-CreateVolumesFromImageTest-1672173559 None] Lock "cinder-8a3b750e-b5ab-4025-9146-86fb5bb28a8e-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:10:00 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-5e360a5c-cdef-4144-90ab-dc85cd156f9c tempest-CreateVolumesFromImageTest-1672173559 None] Acquiring lock "cinder-quobyte-8a3b750e-b5ab-4025-9146-86fb5bb28a8e" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:10:00 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-5e360a5c-cdef-4144-90ab-dc85cd156f9c tempest-CreateVolumesFromImageTest-1672173559 None] Lock "cinder-quobyte-8a3b750e-b5ab-4025-9146-86fb5bb28a8e" acquired by "delete_volume" :: waited 0.015s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:10:00 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a18daa5-fd39-4dbe-a420-63bdd7317371]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:10:00 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-5e360a5c-cdef-4144-90ab-dc85cd156f9c tempest-CreateVolumesFromImageTest-1672173559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8a3b750e-b5ab-4025-9146-86fb5bb28a8e {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:10:00 devstack sudo[103916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8a3b750e-b5ab-4025-9146-86fb5bb28a8e Sep 17 22:10:00 devstack sudo[103916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:10:01 devstack sudo[103916]: pam_unix(sudo:session): session closed for user root Sep 17 22:10:01 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-5e360a5c-cdef-4144-90ab-dc85cd156f9c tempest-CreateVolumesFromImageTest-1672173559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8a3b750e-b5ab-4025-9146-86fb5bb28a8e" returned: 0 in 0.358s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:10:01 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-5e360a5c-cdef-4144-90ab-dc85cd156f9c tempest-CreateVolumesFromImageTest-1672173559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8a3b750e-b5ab-4025-9146-86fb5bb28a8e {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:10:01 devstack sudo[103921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8a3b750e-b5ab-4025-9146-86fb5bb28a8e Sep 17 22:10:01 devstack sudo[103921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:10:01 devstack sudo[103921]: pam_unix(sudo:session): session closed for user root Sep 17 22:10:01 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-5e360a5c-cdef-4144-90ab-dc85cd156f9c tempest-CreateVolumesFromImageTest-1672173559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8a3b750e-b5ab-4025-9146-86fb5bb28a8e" returned: 0 in 0.249s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:10:01 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-5e360a5c-cdef-4144-90ab-dc85cd156f9c tempest-CreateVolumesFromImageTest-1672173559 None] Lock "cinder-quobyte-8a3b750e-b5ab-4025-9146-86fb5bb28a8e" released by "delete_volume" :: held 0.650s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:10:01 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-5e360a5c-cdef-4144-90ab-dc85cd156f9c tempest-CreateVolumesFromImageTest-1672173559 None] Created reservations ['ac9b0add-8109-4faa-9dd5-c0dc3925ce4e', 'e891ad14-8cf0-43ed-a61e-8e5aabe8fb67', 'ab3ff346-4af6-4e92-b296-54f14252f650', 'da985bd1-ec13-4142-ba7c-7e80d36fcd8c'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:10:01 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-5e360a5c-cdef-4144-90ab-dc85cd156f9c tempest-CreateVolumesFromImageTest-1672173559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:10:01 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-5e360a5c-cdef-4144-90ab-dc85cd156f9c tempest-CreateVolumesFromImageTest-1672173559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:10:01 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-5e360a5c-cdef-4144-90ab-dc85cd156f9c tempest-CreateVolumesFromImageTest-1672173559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:10:01 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-5e360a5c-cdef-4144-90ab-dc85cd156f9c tempest-CreateVolumesFromImageTest-1672173559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:10:01 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-5e360a5c-cdef-4144-90ab-dc85cd156f9c tempest-CreateVolumesFromImageTest-1672173559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:10:01 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-5e360a5c-cdef-4144-90ab-dc85cd156f9c tempest-CreateVolumesFromImageTest-1672173559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:10:01 devstack sudo[103924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:10:01 devstack sudo[103924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:10:01 devstack sudo[103924]: pam_unix(sudo:session): session closed for user root Sep 17 22:10:01 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-5e360a5c-cdef-4144-90ab-dc85cd156f9c tempest-CreateVolumesFromImageTest-1672173559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.241s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:10:01 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-5e360a5c-cdef-4144-90ab-dc85cd156f9c tempest-CreateVolumesFromImageTest-1672173559 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:10:01 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-5e360a5c-cdef-4144-90ab-dc85cd156f9c tempest-CreateVolumesFromImageTest-1672173559 None] Deleted volume successfully. Sep 17 22:10:01 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-5e360a5c-cdef-4144-90ab-dc85cd156f9c tempest-CreateVolumesFromImageTest-1672173559 None] Lock "cinder-8a3b750e-b5ab-4025-9146-86fb5bb28a8e-delete_volume" released by "delete_volume" :: held 1.085s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:10:01 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-76993f4d-1747-43aa-8335-8f69b55f1135 tempest-CreateVolumesFromImageTest-1672173559 None] Acquiring lock "cinder-978f92d4-e9bd-4f7c-9102-6bff19bf3d17-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:10:01 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-76993f4d-1747-43aa-8335-8f69b55f1135 tempest-CreateVolumesFromImageTest-1672173559 None] Lock "cinder-978f92d4-e9bd-4f7c-9102-6bff19bf3d17-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:10:01 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-76993f4d-1747-43aa-8335-8f69b55f1135 tempest-CreateVolumesFromImageTest-1672173559 None] Acquiring lock "cinder-quobyte-978f92d4-e9bd-4f7c-9102-6bff19bf3d17" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:10:01 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-76993f4d-1747-43aa-8335-8f69b55f1135 tempest-CreateVolumesFromImageTest-1672173559 None] Lock "cinder-quobyte-978f92d4-e9bd-4f7c-9102-6bff19bf3d17" acquired by "delete_volume" :: waited 0.014s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:10:01 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[45427835-24f2-4d3f-babe-a6ad606f5674]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:10:01 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-76993f4d-1747-43aa-8335-8f69b55f1135 tempest-CreateVolumesFromImageTest-1672173559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-978f92d4-e9bd-4f7c-9102-6bff19bf3d17 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:10:01 devstack sudo[103927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-978f92d4-e9bd-4f7c-9102-6bff19bf3d17 Sep 17 22:10:01 devstack sudo[103927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:10:02 devstack sudo[103927]: pam_unix(sudo:session): session closed for user root Sep 17 22:10:02 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-76993f4d-1747-43aa-8335-8f69b55f1135 tempest-CreateVolumesFromImageTest-1672173559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-978f92d4-e9bd-4f7c-9102-6bff19bf3d17" returned: 0 in 0.365s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:10:02 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-76993f4d-1747-43aa-8335-8f69b55f1135 tempest-CreateVolumesFromImageTest-1672173559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-978f92d4-e9bd-4f7c-9102-6bff19bf3d17 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:10:02 devstack sudo[103932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-978f92d4-e9bd-4f7c-9102-6bff19bf3d17 Sep 17 22:10:02 devstack sudo[103932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:10:02 devstack sudo[103932]: pam_unix(sudo:session): session closed for user root Sep 17 22:10:02 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-76993f4d-1747-43aa-8335-8f69b55f1135 tempest-CreateVolumesFromImageTest-1672173559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-978f92d4-e9bd-4f7c-9102-6bff19bf3d17" returned: 0 in 0.244s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:10:02 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-76993f4d-1747-43aa-8335-8f69b55f1135 tempest-CreateVolumesFromImageTest-1672173559 None] Lock "cinder-quobyte-978f92d4-e9bd-4f7c-9102-6bff19bf3d17" released by "delete_volume" :: held 0.647s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:10:02 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-76993f4d-1747-43aa-8335-8f69b55f1135 tempest-CreateVolumesFromImageTest-1672173559 None] Created reservations ['ba0dc0f6-d8e8-497c-9351-366d2bd204d4', 'e6b3d392-3433-4b99-b756-979719fa790f', '4689b1ce-7638-4f1c-83c5-825ed67eb940', '49b981bd-a891-4e63-814d-fe224cdcef5b'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:10:02 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-76993f4d-1747-43aa-8335-8f69b55f1135 tempest-CreateVolumesFromImageTest-1672173559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:10:02 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-76993f4d-1747-43aa-8335-8f69b55f1135 tempest-CreateVolumesFromImageTest-1672173559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:10:02 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-76993f4d-1747-43aa-8335-8f69b55f1135 tempest-CreateVolumesFromImageTest-1672173559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:10:02 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-76993f4d-1747-43aa-8335-8f69b55f1135 tempest-CreateVolumesFromImageTest-1672173559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:10:02 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-76993f4d-1747-43aa-8335-8f69b55f1135 tempest-CreateVolumesFromImageTest-1672173559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:10:02 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-76993f4d-1747-43aa-8335-8f69b55f1135 tempest-CreateVolumesFromImageTest-1672173559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:10:02 devstack sudo[103935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:10:02 devstack sudo[103935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:10:02 devstack sudo[103935]: pam_unix(sudo:session): session closed for user root Sep 17 22:10:02 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-76993f4d-1747-43aa-8335-8f69b55f1135 tempest-CreateVolumesFromImageTest-1672173559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.246s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:10:02 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-76993f4d-1747-43aa-8335-8f69b55f1135 tempest-CreateVolumesFromImageTest-1672173559 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:10:02 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-76993f4d-1747-43aa-8335-8f69b55f1135 tempest-CreateVolumesFromImageTest-1672173559 None] Deleted volume successfully. Sep 17 22:10:02 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-76993f4d-1747-43aa-8335-8f69b55f1135 tempest-CreateVolumesFromImageTest-1672173559 None] Lock "cinder-978f92d4-e9bd-4f7c-9102-6bff19bf3d17-delete_volume" released by "delete_volume" :: held 1.068s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:10:02 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-723207ad-e15e-44a3-bfb2-d44477c00014 tempest-CreateVolumesFromImageTest-1672173559 None] Acquiring lock "cinder-61a0e563-23ea-4d36-b75c-bbc9bfbe593e-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:10:02 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-723207ad-e15e-44a3-bfb2-d44477c00014 tempest-CreateVolumesFromImageTest-1672173559 None] Lock "cinder-61a0e563-23ea-4d36-b75c-bbc9bfbe593e-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:10:02 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-723207ad-e15e-44a3-bfb2-d44477c00014 tempest-CreateVolumesFromImageTest-1672173559 None] Acquiring lock "cinder-quobyte-61a0e563-23ea-4d36-b75c-bbc9bfbe593e" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:10:02 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-723207ad-e15e-44a3-bfb2-d44477c00014 tempest-CreateVolumesFromImageTest-1672173559 None] Lock "cinder-quobyte-61a0e563-23ea-4d36-b75c-bbc9bfbe593e" acquired by "delete_volume" :: waited 0.016s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:10:03 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8a23506-e85a-4f25-9d4d-4b6108168ddf]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:10:03 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-723207ad-e15e-44a3-bfb2-d44477c00014 tempest-CreateVolumesFromImageTest-1672173559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-61a0e563-23ea-4d36-b75c-bbc9bfbe593e {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:10:03 devstack sudo[103938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-61a0e563-23ea-4d36-b75c-bbc9bfbe593e Sep 17 22:10:03 devstack sudo[103938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:10:03 devstack sudo[103938]: pam_unix(sudo:session): session closed for user root Sep 17 22:10:03 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-723207ad-e15e-44a3-bfb2-d44477c00014 tempest-CreateVolumesFromImageTest-1672173559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-61a0e563-23ea-4d36-b75c-bbc9bfbe593e" returned: 0 in 0.353s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:10:03 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-723207ad-e15e-44a3-bfb2-d44477c00014 tempest-CreateVolumesFromImageTest-1672173559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-61a0e563-23ea-4d36-b75c-bbc9bfbe593e {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:10:03 devstack sudo[103943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-61a0e563-23ea-4d36-b75c-bbc9bfbe593e Sep 17 22:10:03 devstack sudo[103943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:10:03 devstack sudo[103943]: pam_unix(sudo:session): session closed for user root Sep 17 22:10:03 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-723207ad-e15e-44a3-bfb2-d44477c00014 tempest-CreateVolumesFromImageTest-1672173559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-61a0e563-23ea-4d36-b75c-bbc9bfbe593e" returned: 0 in 0.247s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:10:03 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-723207ad-e15e-44a3-bfb2-d44477c00014 tempest-CreateVolumesFromImageTest-1672173559 None] Lock "cinder-quobyte-61a0e563-23ea-4d36-b75c-bbc9bfbe593e" released by "delete_volume" :: held 0.641s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:10:03 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-723207ad-e15e-44a3-bfb2-d44477c00014 tempest-CreateVolumesFromImageTest-1672173559 None] Created reservations ['866a49e9-bd50-46d7-b2c4-96155d264232', '4e524b5c-4f2b-4427-a74b-3e05f12317b9', '450fb5e2-4731-4290-a96b-539ee03e416a', '8e7b7834-de3d-4ef9-9cf3-14dfda2ffdbd'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:10:03 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-723207ad-e15e-44a3-bfb2-d44477c00014 tempest-CreateVolumesFromImageTest-1672173559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:10:03 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-723207ad-e15e-44a3-bfb2-d44477c00014 tempest-CreateVolumesFromImageTest-1672173559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:10:03 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-723207ad-e15e-44a3-bfb2-d44477c00014 tempest-CreateVolumesFromImageTest-1672173559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:10:03 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-723207ad-e15e-44a3-bfb2-d44477c00014 tempest-CreateVolumesFromImageTest-1672173559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:10:03 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-723207ad-e15e-44a3-bfb2-d44477c00014 tempest-CreateVolumesFromImageTest-1672173559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:10:03 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-723207ad-e15e-44a3-bfb2-d44477c00014 tempest-CreateVolumesFromImageTest-1672173559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:10:03 devstack sudo[103946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:10:03 devstack sudo[103946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:10:03 devstack sudo[103946]: pam_unix(sudo:session): session closed for user root Sep 17 22:10:03 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-723207ad-e15e-44a3-bfb2-d44477c00014 tempest-CreateVolumesFromImageTest-1672173559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.238s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:10:03 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-723207ad-e15e-44a3-bfb2-d44477c00014 tempest-CreateVolumesFromImageTest-1672173559 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:10:03 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-723207ad-e15e-44a3-bfb2-d44477c00014 tempest-CreateVolumesFromImageTest-1672173559 None] Deleted volume successfully. Sep 17 22:10:04 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-723207ad-e15e-44a3-bfb2-d44477c00014 tempest-CreateVolumesFromImageTest-1672173559 None] Lock "cinder-61a0e563-23ea-4d36-b75c-bbc9bfbe593e-delete_volume" released by "delete_volume" :: held 1.067s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:10:04 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-af3aeb12-2654-4473-8061-afe3b4f78d5b tempest-CreateVolumesFromImageTest-1672173559 None] Acquiring lock "cinder-3a76e6ae-9579-4570-b151-d060e47cee40-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:10:04 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-af3aeb12-2654-4473-8061-afe3b4f78d5b tempest-CreateVolumesFromImageTest-1672173559 None] Lock "cinder-3a76e6ae-9579-4570-b151-d060e47cee40-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:10:04 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-af3aeb12-2654-4473-8061-afe3b4f78d5b tempest-CreateVolumesFromImageTest-1672173559 None] Acquiring lock "cinder-quobyte-3a76e6ae-9579-4570-b151-d060e47cee40" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:10:04 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-af3aeb12-2654-4473-8061-afe3b4f78d5b tempest-CreateVolumesFromImageTest-1672173559 None] Lock "cinder-quobyte-3a76e6ae-9579-4570-b151-d060e47cee40" acquired by "delete_volume" :: waited 0.016s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:10:04 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5d54163-467d-42a5-b44a-65ec088a059a]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:10:04 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-af3aeb12-2654-4473-8061-afe3b4f78d5b tempest-CreateVolumesFromImageTest-1672173559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-3a76e6ae-9579-4570-b151-d060e47cee40 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:10:04 devstack sudo[103949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-3a76e6ae-9579-4570-b151-d060e47cee40 Sep 17 22:10:04 devstack sudo[103949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:10:04 devstack sudo[103949]: pam_unix(sudo:session): session closed for user root Sep 17 22:10:04 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-af3aeb12-2654-4473-8061-afe3b4f78d5b tempest-CreateVolumesFromImageTest-1672173559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-3a76e6ae-9579-4570-b151-d060e47cee40" returned: 0 in 0.361s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:10:04 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-af3aeb12-2654-4473-8061-afe3b4f78d5b tempest-CreateVolumesFromImageTest-1672173559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-3a76e6ae-9579-4570-b151-d060e47cee40 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:10:04 devstack sudo[103954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-3a76e6ae-9579-4570-b151-d060e47cee40 Sep 17 22:10:04 devstack sudo[103954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:10:04 devstack sudo[103954]: pam_unix(sudo:session): session closed for user root Sep 17 22:10:04 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-af3aeb12-2654-4473-8061-afe3b4f78d5b tempest-CreateVolumesFromImageTest-1672173559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-3a76e6ae-9579-4570-b151-d060e47cee40" returned: 0 in 0.249s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:10:04 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-af3aeb12-2654-4473-8061-afe3b4f78d5b tempest-CreateVolumesFromImageTest-1672173559 None] Lock "cinder-quobyte-3a76e6ae-9579-4570-b151-d060e47cee40" released by "delete_volume" :: held 0.652s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:10:04 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-af3aeb12-2654-4473-8061-afe3b4f78d5b tempest-CreateVolumesFromImageTest-1672173559 None] Created reservations ['b723d7e9-42d7-463a-b51a-981d3980a168', '486f1cfd-7cd0-484f-a1ff-93f6ff4da88e', '8678a934-3bc5-4df3-8162-663dae8760a3', '8ffbcf62-3a4f-4bd6-aaa2-6bc6cfa37597'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:10:04 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-af3aeb12-2654-4473-8061-afe3b4f78d5b tempest-CreateVolumesFromImageTest-1672173559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:10:04 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-af3aeb12-2654-4473-8061-afe3b4f78d5b tempest-CreateVolumesFromImageTest-1672173559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:10:04 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-af3aeb12-2654-4473-8061-afe3b4f78d5b tempest-CreateVolumesFromImageTest-1672173559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:10:04 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-af3aeb12-2654-4473-8061-afe3b4f78d5b tempest-CreateVolumesFromImageTest-1672173559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:10:04 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-af3aeb12-2654-4473-8061-afe3b4f78d5b tempest-CreateVolumesFromImageTest-1672173559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:10:04 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-af3aeb12-2654-4473-8061-afe3b4f78d5b tempest-CreateVolumesFromImageTest-1672173559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:10:04 devstack sudo[103957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:10:04 devstack sudo[103957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:10:05 devstack sudo[103957]: pam_unix(sudo:session): session closed for user root Sep 17 22:10:05 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-af3aeb12-2654-4473-8061-afe3b4f78d5b tempest-CreateVolumesFromImageTest-1672173559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.245s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:10:05 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-af3aeb12-2654-4473-8061-afe3b4f78d5b tempest-CreateVolumesFromImageTest-1672173559 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:10:05 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-af3aeb12-2654-4473-8061-afe3b4f78d5b tempest-CreateVolumesFromImageTest-1672173559 None] Deleted volume successfully. Sep 17 22:10:05 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-af3aeb12-2654-4473-8061-afe3b4f78d5b tempest-CreateVolumesFromImageTest-1672173559 None] Lock "cinder-3a76e6ae-9579-4570-b151-d060e47cee40-delete_volume" released by "delete_volume" :: held 1.104s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:10:05 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-0e49274b-045d-4e59-8a5a-691ac3b7f3f1 tempest-CreateVolumesFromImageTest-1672173559 None] Acquiring lock "cinder-d2bafe7c-8d15-4fef-bb21-ccec280f453f-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:10:05 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-0e49274b-045d-4e59-8a5a-691ac3b7f3f1 tempest-CreateVolumesFromImageTest-1672173559 None] Lock "cinder-d2bafe7c-8d15-4fef-bb21-ccec280f453f-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:10:05 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-0e49274b-045d-4e59-8a5a-691ac3b7f3f1 tempest-CreateVolumesFromImageTest-1672173559 None] Acquiring lock "cinder-quobyte-d2bafe7c-8d15-4fef-bb21-ccec280f453f" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:10:05 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-0e49274b-045d-4e59-8a5a-691ac3b7f3f1 tempest-CreateVolumesFromImageTest-1672173559 None] Lock "cinder-quobyte-d2bafe7c-8d15-4fef-bb21-ccec280f453f" acquired by "delete_volume" :: waited 0.013s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:10:05 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b684756-6bcf-4e6d-b6a0-8901a991240b]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:10:05 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-0e49274b-045d-4e59-8a5a-691ac3b7f3f1 tempest-CreateVolumesFromImageTest-1672173559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-d2bafe7c-8d15-4fef-bb21-ccec280f453f {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:10:05 devstack sudo[103960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-d2bafe7c-8d15-4fef-bb21-ccec280f453f Sep 17 22:10:05 devstack sudo[103960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:10:05 devstack sudo[103960]: pam_unix(sudo:session): session closed for user root Sep 17 22:10:05 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-0e49274b-045d-4e59-8a5a-691ac3b7f3f1 tempest-CreateVolumesFromImageTest-1672173559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-d2bafe7c-8d15-4fef-bb21-ccec280f453f" returned: 0 in 0.359s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:10:05 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-0e49274b-045d-4e59-8a5a-691ac3b7f3f1 tempest-CreateVolumesFromImageTest-1672173559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-d2bafe7c-8d15-4fef-bb21-ccec280f453f {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:10:05 devstack sudo[103965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-d2bafe7c-8d15-4fef-bb21-ccec280f453f Sep 17 22:10:05 devstack sudo[103965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:10:05 devstack sudo[103965]: pam_unix(sudo:session): session closed for user root Sep 17 22:10:05 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-0e49274b-045d-4e59-8a5a-691ac3b7f3f1 tempest-CreateVolumesFromImageTest-1672173559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-d2bafe7c-8d15-4fef-bb21-ccec280f453f" returned: 0 in 0.255s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:10:05 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-0e49274b-045d-4e59-8a5a-691ac3b7f3f1 tempest-CreateVolumesFromImageTest-1672173559 None] Lock "cinder-quobyte-d2bafe7c-8d15-4fef-bb21-ccec280f453f" released by "delete_volume" :: held 0.654s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:10:06 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-0e49274b-045d-4e59-8a5a-691ac3b7f3f1 tempest-CreateVolumesFromImageTest-1672173559 None] Created reservations ['ca21cecf-6cc2-4c6d-97ca-30d70e2ccc3f', 'ee20e3aa-816a-4906-ac11-443321cf2773', '21cbf76c-6fed-4129-9834-6f210fa92b67', 'bb0735d7-fcea-4b0b-8b20-8b01cea9098f'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:10:06 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-0e49274b-045d-4e59-8a5a-691ac3b7f3f1 tempest-CreateVolumesFromImageTest-1672173559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:10:06 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-0e49274b-045d-4e59-8a5a-691ac3b7f3f1 tempest-CreateVolumesFromImageTest-1672173559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:10:06 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-0e49274b-045d-4e59-8a5a-691ac3b7f3f1 tempest-CreateVolumesFromImageTest-1672173559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:10:06 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-0e49274b-045d-4e59-8a5a-691ac3b7f3f1 tempest-CreateVolumesFromImageTest-1672173559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:10:06 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-0e49274b-045d-4e59-8a5a-691ac3b7f3f1 tempest-CreateVolumesFromImageTest-1672173559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:10:06 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-0e49274b-045d-4e59-8a5a-691ac3b7f3f1 tempest-CreateVolumesFromImageTest-1672173559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:10:06 devstack sudo[103968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:10:06 devstack sudo[103968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:10:06 devstack sudo[103968]: pam_unix(sudo:session): session closed for user root Sep 17 22:10:06 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-0e49274b-045d-4e59-8a5a-691ac3b7f3f1 tempest-CreateVolumesFromImageTest-1672173559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.253s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:10:06 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-0e49274b-045d-4e59-8a5a-691ac3b7f3f1 tempest-CreateVolumesFromImageTest-1672173559 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:10:06 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-0e49274b-045d-4e59-8a5a-691ac3b7f3f1 tempest-CreateVolumesFromImageTest-1672173559 None] Deleted volume successfully. Sep 17 22:10:06 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-0e49274b-045d-4e59-8a5a-691ac3b7f3f1 tempest-CreateVolumesFromImageTest-1672173559 None] Lock "cinder-d2bafe7c-8d15-4fef-bb21-ccec280f453f-delete_volume" released by "delete_volume" :: held 1.099s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:10:08 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfb7a7aa-9f71-4055-9da4-cff7c9f12803 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 22:10:09 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-cfb7a7aa-9f71-4055-9da4-cff7c9f12803 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Flow 'volume_create_manager' (e74faa81-1149-4e79-861e-bd562c893f79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:10:09 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-cfb7a7aa-9f71-4055-9da4-cff7c9f12803 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4795bcbb-dcff-4948-b3b5-2b036f35680e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:10:09 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-cfb7a7aa-9f71-4055-9da4-cff7c9f12803 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4795bcbb-dcff-4948-b3b5-2b036f35680e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:10:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-82895357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f91ac926-6ead-4929-a5e2-88b7f0a7d2d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cc58c3e6d524107b947cfbde3cdc7c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:10:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:10:09Z,use_quota=True,user_id='7a9ea135852042889af2b337ea9ace2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:10:09 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-cfb7a7aa-9f71-4055-9da4-cff7c9f12803 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c276bf8e-cbd2-4767-93bf-787b13a4fc6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:10:09 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-cfb7a7aa-9f71-4055-9da4-cff7c9f12803 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c276bf8e-cbd2-4767-93bf-787b13a4fc6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:10:09 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-cfb7a7aa-9f71-4055-9da4-cff7c9f12803 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cfbf574-f345-4fa1-9145-115f82d2209b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:10:09 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-cfb7a7aa-9f71-4055-9da4-cff7c9f12803 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cfbf574-f345-4fa1-9145-115f82d2209b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f91ac926-6ead-4929-a5e2-88b7f0a7d2d9', 'volume_name': 'volume-f91ac926-6ead-4929-a5e2-88b7f0a7d2d9', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:10:09 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-cfb7a7aa-9f71-4055-9da4-cff7c9f12803 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3715e85-7d85-4bb5-b2e9-fbc5d32d6fd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:10:09 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-cfb7a7aa-9f71-4055-9da4-cff7c9f12803 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3715e85-7d85-4bb5-b2e9-fbc5d32d6fd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:10:09 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-cfb7a7aa-9f71-4055-9da4-cff7c9f12803 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24d22a23-817f-4972-8fb7-f4cccaf0b1a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:10:09 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-cfb7a7aa-9f71-4055-9da4-cff7c9f12803 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Volume f91ac926-6ead-4929-a5e2-88b7f0a7d2d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f91ac926-6ead-4929-a5e2-88b7f0a7d2d9', 'volume_size': 1} Sep 17 22:10:09 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-cfb7a7aa-9f71-4055-9da4-cff7c9f12803 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:10:09 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-cfb7a7aa-9f71-4055-9da4-cff7c9f12803 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:10:09 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-cfb7a7aa-9f71-4055-9da4-cff7c9f12803 tempest-CreateVolumesFromSnapshotTest-2038377790 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:10:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-82895357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f91ac926-6ead-4929-a5e2-88b7f0a7d2d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cc58c3e6d524107b947cfbde3cdc7c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:10:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:10:09Z,use_quota=True,user_id='7a9ea135852042889af2b337ea9ace2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 22:10:09 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-cfb7a7aa-9f71-4055-9da4-cff7c9f12803 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Creating volume f91ac926-6ead-4929-a5e2-88b7f0a7d2d9 {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 22:10:09 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-cfb7a7aa-9f71-4055-9da4-cff7c9f12803 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:10:09 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-cfb7a7aa-9f71-4055-9da4-cff7c9f12803 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:10:09 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-cfb7a7aa-9f71-4055-9da4-cff7c9f12803 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:10:09 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-cfb7a7aa-9f71-4055-9da4-cff7c9f12803 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:10:09 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-cfb7a7aa-9f71-4055-9da4-cff7c9f12803 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:10:09 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-cfb7a7aa-9f71-4055-9da4-cff7c9f12803 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 22:10:09 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-cfb7a7aa-9f71-4055-9da4-cff7c9f12803 tempest-CreateVolumesFromSnapshotTest-2038377790 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 22:10:09 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-cfb7a7aa-9f71-4055-9da4-cff7c9f12803 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f91ac926-6ead-4929-a5e2-88b7f0a7d2d9 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:10:09 devstack sudo[103971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f91ac926-6ead-4929-a5e2-88b7f0a7d2d9 1073741824 Sep 17 22:10:09 devstack sudo[103971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:10:09 devstack sudo[103971]: pam_unix(sudo:session): session closed for user root Sep 17 22:10:09 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-cfb7a7aa-9f71-4055-9da4-cff7c9f12803 tempest-CreateVolumesFromSnapshotTest-2038377790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f91ac926-6ead-4929-a5e2-88b7f0a7d2d9 1073741824" returned: 0 in 0.417s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:10:09 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-cfb7a7aa-9f71-4055-9da4-cff7c9f12803 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f91ac926-6ead-4929-a5e2-88b7f0a7d2d9 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:10:09 devstack sudo[103977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f91ac926-6ead-4929-a5e2-88b7f0a7d2d9 Sep 17 22:10:09 devstack sudo[103977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:10:09 devstack sudo[103977]: pam_unix(sudo:session): session closed for user root Sep 17 22:10:09 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-cfb7a7aa-9f71-4055-9da4-cff7c9f12803 tempest-CreateVolumesFromSnapshotTest-2038377790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f91ac926-6ead-4929-a5e2-88b7f0a7d2d9" returned: 0 in 0.242s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:10:09 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-cfb7a7aa-9f71-4055-9da4-cff7c9f12803 tempest-CreateVolumesFromSnapshotTest-2038377790 None] <== create_volume: return (699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 22:10:09 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-cfb7a7aa-9f71-4055-9da4-cff7c9f12803 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.701s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:10:09 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-cfb7a7aa-9f71-4055-9da4-cff7c9f12803 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24d22a23-817f-4972-8fb7-f4cccaf0b1a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f91ac926-6ead-4929-a5e2-88b7f0a7d2d9', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:10:09 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-cfb7a7aa-9f71-4055-9da4-cff7c9f12803 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (056b6a36-9094-42b6-a5b8-283e15e29e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:10:09 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-cfb7a7aa-9f71-4055-9da4-cff7c9f12803 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Volume volume-f91ac926-6ead-4929-a5e2-88b7f0a7d2d9 (f91ac926-6ead-4929-a5e2-88b7f0a7d2d9): created successfully Sep 17 22:10:09 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-cfb7a7aa-9f71-4055-9da4-cff7c9f12803 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (056b6a36-9094-42b6-a5b8-283e15e29e71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:10:09 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-cfb7a7aa-9f71-4055-9da4-cff7c9f12803 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Flow 'volume_create_manager' (e74faa81-1149-4e79-861e-bd562c893f79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:10:09 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-cfb7a7aa-9f71-4055-9da4-cff7c9f12803 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Created volume successfully. Sep 17 22:10:10 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-cc1d9760-87a1-4df4-baf6-732904a6242e tempest-CreateVolumesFromSnapshotTest-2038377790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:10:10 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-cc1d9760-87a1-4df4-baf6-732904a6242e tempest-CreateVolumesFromSnapshotTest-2038377790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:10:10 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-cc1d9760-87a1-4df4-baf6-732904a6242e tempest-CreateVolumesFromSnapshotTest-2038377790 None] Creating offline snapshot 36e63f19-9ca2-4337-ab5e-438012700b56 of volume f91ac926-6ead-4929-a5e2-88b7f0a7d2d9 {{(pid=85458) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 22:10:10 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cbc34f8-2b75-45ee-9137-d3cae1318c6f]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:10:10 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-cc1d9760-87a1-4df4-baf6-732904a6242e tempest-CreateVolumesFromSnapshotTest-2038377790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f91ac926-6ead-4929-a5e2-88b7f0a7d2d9 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:10:10 devstack sudo[103980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f91ac926-6ead-4929-a5e2-88b7f0a7d2d9 Sep 17 22:10:10 devstack sudo[103980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:10:10 devstack sudo[103980]: pam_unix(sudo:session): session closed for user root Sep 17 22:10:10 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-cc1d9760-87a1-4df4-baf6-732904a6242e tempest-CreateVolumesFromSnapshotTest-2038377790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f91ac926-6ead-4929-a5e2-88b7f0a7d2d9" returned: 0 in 0.352s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:10:10 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-cc1d9760-87a1-4df4-baf6-732904a6242e tempest-CreateVolumesFromSnapshotTest-2038377790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f91ac926-6ead-4929-a5e2-88b7f0a7d2d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f91ac926-6ead-4929-a5e2-88b7f0a7d2d9.36e63f19-9ca2-4337-ab5e-438012700b56 1G {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:10:10 devstack sudo[103985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f91ac926-6ead-4929-a5e2-88b7f0a7d2d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f91ac926-6ead-4929-a5e2-88b7f0a7d2d9.36e63f19-9ca2-4337-ab5e-438012700b56 1G Sep 17 22:10:10 devstack sudo[103985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:10:10 devstack sudo[103985]: pam_unix(sudo:session): session closed for user root Sep 17 22:10:10 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-cc1d9760-87a1-4df4-baf6-732904a6242e tempest-CreateVolumesFromSnapshotTest-2038377790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f91ac926-6ead-4929-a5e2-88b7f0a7d2d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f91ac926-6ead-4929-a5e2-88b7f0a7d2d9.36e63f19-9ca2-4337-ab5e-438012700b56 1G" returned: 0 in 0.393s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:10:10 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-cc1d9760-87a1-4df4-baf6-732904a6242e tempest-CreateVolumesFromSnapshotTest-2038377790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f91ac926-6ead-4929-a5e2-88b7f0a7d2d9 -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f91ac926-6ead-4929-a5e2-88b7f0a7d2d9.36e63f19-9ca2-4337-ab5e-438012700b56 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:10:10 devstack sudo[103991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f91ac926-6ead-4929-a5e2-88b7f0a7d2d9 -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f91ac926-6ead-4929-a5e2-88b7f0a7d2d9.36e63f19-9ca2-4337-ab5e-438012700b56 Sep 17 22:10:10 devstack sudo[103991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:10:11 devstack sudo[103991]: pam_unix(sudo:session): session closed for user root Sep 17 22:10:11 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-cc1d9760-87a1-4df4-baf6-732904a6242e tempest-CreateVolumesFromSnapshotTest-2038377790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f91ac926-6ead-4929-a5e2-88b7f0a7d2d9 -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f91ac926-6ead-4929-a5e2-88b7f0a7d2d9.36e63f19-9ca2-4337-ab5e-438012700b56" returned: 0 in 0.290s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:10:11 devstack cinder-volume[85458]: WARNING cinder.volume.drivers.remotefs [None req-cc1d9760-87a1-4df4-baf6-732904a6242e tempest-CreateVolumesFromSnapshotTest-2038377790 None] /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f91ac926-6ead-4929-a5e2-88b7f0a7d2d9.36e63f19-9ca2-4337-ab5e-438012700b56 is being set with open permissions: ugo+rw Sep 17 22:10:11 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-cc1d9760-87a1-4df4-baf6-732904a6242e tempest-CreateVolumesFromSnapshotTest-2038377790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f91ac926-6ead-4929-a5e2-88b7f0a7d2d9.36e63f19-9ca2-4337-ab5e-438012700b56 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:10:11 devstack sudo[103996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f91ac926-6ead-4929-a5e2-88b7f0a7d2d9.36e63f19-9ca2-4337-ab5e-438012700b56 Sep 17 22:10:11 devstack sudo[103996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:10:11 devstack sudo[103996]: pam_unix(sudo:session): session closed for user root Sep 17 22:10:11 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-cc1d9760-87a1-4df4-baf6-732904a6242e tempest-CreateVolumesFromSnapshotTest-2038377790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f91ac926-6ead-4929-a5e2-88b7f0a7d2d9.36e63f19-9ca2-4337-ab5e-438012700b56" returned: 0 in 0.236s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:10:11 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-cc1d9760-87a1-4df4-baf6-732904a6242e tempest-CreateVolumesFromSnapshotTest-2038377790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f91ac926-6ead-4929-a5e2-88b7f0a7d2d9.info {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:10:11 devstack sudo[103999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f91ac926-6ead-4929-a5e2-88b7f0a7d2d9.info Sep 17 22:10:11 devstack sudo[103999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:10:11 devstack sudo[103999]: pam_unix(sudo:session): session closed for user root Sep 17 22:10:11 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-cc1d9760-87a1-4df4-baf6-732904a6242e tempest-CreateVolumesFromSnapshotTest-2038377790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f91ac926-6ead-4929-a5e2-88b7f0a7d2d9.info" returned: 0 in 0.246s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:10:11 devstack cinder-volume[85458]: WARNING cinder.volume.drivers.remotefs [None req-cc1d9760-87a1-4df4-baf6-732904a6242e tempest-CreateVolumesFromSnapshotTest-2038377790 None] /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f91ac926-6ead-4929-a5e2-88b7f0a7d2d9.info is being set with open permissions: ugo+rw Sep 17 22:10:11 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-cc1d9760-87a1-4df4-baf6-732904a6242e tempest-CreateVolumesFromSnapshotTest-2038377790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f91ac926-6ead-4929-a5e2-88b7f0a7d2d9.info {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:10:11 devstack sudo[104002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f91ac926-6ead-4929-a5e2-88b7f0a7d2d9.info Sep 17 22:10:11 devstack sudo[104002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:10:11 devstack sudo[104002]: pam_unix(sudo:session): session closed for user root Sep 17 22:10:11 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-cc1d9760-87a1-4df4-baf6-732904a6242e tempest-CreateVolumesFromSnapshotTest-2038377790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f91ac926-6ead-4929-a5e2-88b7f0a7d2d9.info" returned: 0 in 0.238s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:10:12 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-cc1d9760-87a1-4df4-baf6-732904a6242e tempest-CreateVolumesFromSnapshotTest-2038377790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.850s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:10:12 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-cc1d9760-87a1-4df4-baf6-732904a6242e tempest-CreateVolumesFromSnapshotTest-2038377790 None] Create snapshot completed successfully Sep 17 22:10:12 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-56fe779e-6f0c-45f8-8024-945f66c8432e tempest-CreateVolumesFromSnapshotTest-2038377790 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 22:10:12 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-56fe779e-6f0c-45f8-8024-945f66c8432e tempest-CreateVolumesFromSnapshotTest-2038377790 None] Flow 'volume_create_manager' (50303d07-d0f4-4ad0-b15c-0c0f2011fd2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:10:12 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-56fe779e-6f0c-45f8-8024-945f66c8432e tempest-CreateVolumesFromSnapshotTest-2038377790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f7b9b42-864b-49de-b6e4-42475ea918c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:10:12 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-56fe779e-6f0c-45f8-8024-945f66c8432e tempest-CreateVolumesFromSnapshotTest-2038377790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f7b9b42-864b-49de-b6e4-42475ea918c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:10:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1955569563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a28cdd24-f294-45a7-933f-652e1907157c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cc58c3e6d524107b947cfbde3cdc7c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:10:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:10:13Z,use_quota=True,user_id='7a9ea135852042889af2b337ea9ace2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:10:12 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-56fe779e-6f0c-45f8-8024-945f66c8432e tempest-CreateVolumesFromSnapshotTest-2038377790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52fb128e-3eec-4a69-931b-89ca8e26d81e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:10:12 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-56fe779e-6f0c-45f8-8024-945f66c8432e tempest-CreateVolumesFromSnapshotTest-2038377790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52fb128e-3eec-4a69-931b-89ca8e26d81e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:10:12 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-56fe779e-6f0c-45f8-8024-945f66c8432e tempest-CreateVolumesFromSnapshotTest-2038377790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55a54825-a0bc-4e63-8acb-e295aa4df85d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:10:12 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-56fe779e-6f0c-45f8-8024-945f66c8432e tempest-CreateVolumesFromSnapshotTest-2038377790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55a54825-a0bc-4e63-8acb-e295aa4df85d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a28cdd24-f294-45a7-933f-652e1907157c', 'volume_name': 'volume-a28cdd24-f294-45a7-933f-652e1907157c', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:10:12 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-56fe779e-6f0c-45f8-8024-945f66c8432e tempest-CreateVolumesFromSnapshotTest-2038377790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5040e7f1-c690-4b1a-8f1c-15c9793dc241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:10:12 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-56fe779e-6f0c-45f8-8024-945f66c8432e tempest-CreateVolumesFromSnapshotTest-2038377790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5040e7f1-c690-4b1a-8f1c-15c9793dc241) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:10:12 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-56fe779e-6f0c-45f8-8024-945f66c8432e tempest-CreateVolumesFromSnapshotTest-2038377790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97b9029c-ea1c-45eb-905f-e3e13e8bf29d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:10:12 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-56fe779e-6f0c-45f8-8024-945f66c8432e tempest-CreateVolumesFromSnapshotTest-2038377790 None] Volume a28cdd24-f294-45a7-933f-652e1907157c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a28cdd24-f294-45a7-933f-652e1907157c', 'volume_size': 1} Sep 17 22:10:12 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-56fe779e-6f0c-45f8-8024-945f66c8432e tempest-CreateVolumesFromSnapshotTest-2038377790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:10:12 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-56fe779e-6f0c-45f8-8024-945f66c8432e tempest-CreateVolumesFromSnapshotTest-2038377790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:10:12 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-56fe779e-6f0c-45f8-8024-945f66c8432e tempest-CreateVolumesFromSnapshotTest-2038377790 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:10:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1955569563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a28cdd24-f294-45a7-933f-652e1907157c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cc58c3e6d524107b947cfbde3cdc7c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:10:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:10:13Z,use_quota=True,user_id='7a9ea135852042889af2b337ea9ace2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 22:10:12 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-56fe779e-6f0c-45f8-8024-945f66c8432e tempest-CreateVolumesFromSnapshotTest-2038377790 None] Creating volume a28cdd24-f294-45a7-933f-652e1907157c {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 22:10:12 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-56fe779e-6f0c-45f8-8024-945f66c8432e tempest-CreateVolumesFromSnapshotTest-2038377790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:10:12 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-56fe779e-6f0c-45f8-8024-945f66c8432e tempest-CreateVolumesFromSnapshotTest-2038377790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:10:12 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-56fe779e-6f0c-45f8-8024-945f66c8432e tempest-CreateVolumesFromSnapshotTest-2038377790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:10:12 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-56fe779e-6f0c-45f8-8024-945f66c8432e tempest-CreateVolumesFromSnapshotTest-2038377790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:10:12 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-56fe779e-6f0c-45f8-8024-945f66c8432e tempest-CreateVolumesFromSnapshotTest-2038377790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:10:12 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-56fe779e-6f0c-45f8-8024-945f66c8432e tempest-CreateVolumesFromSnapshotTest-2038377790 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 22:10:12 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-56fe779e-6f0c-45f8-8024-945f66c8432e tempest-CreateVolumesFromSnapshotTest-2038377790 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 22:10:12 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-56fe779e-6f0c-45f8-8024-945f66c8432e tempest-CreateVolumesFromSnapshotTest-2038377790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a28cdd24-f294-45a7-933f-652e1907157c 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:10:12 devstack sudo[104005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a28cdd24-f294-45a7-933f-652e1907157c 1073741824 Sep 17 22:10:12 devstack sudo[104005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:10:13 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd8b4c57-cce5-4129-8eb6-8954782d7c08 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 22:10:13 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-dd8b4c57-cce5-4129-8eb6-8954782d7c08 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Flow 'volume_create_manager' (e2dab6b4-ef8d-451a-abce-9bc4093a8d7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:10:13 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-dd8b4c57-cce5-4129-8eb6-8954782d7c08 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9a92348-dfc2-4520-bc37-0a1bb508aef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:10:13 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-dd8b4c57-cce5-4129-8eb6-8954782d7c08 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9a92348-dfc2-4520-bc37-0a1bb508aef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:10:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-639047957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ba708fe-16fb-4cea-ab4a-07641a46708d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cc58c3e6d524107b947cfbde3cdc7c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:10:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:10:13Z,use_quota=True,user_id='7a9ea135852042889af2b337ea9ace2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:10:13 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-dd8b4c57-cce5-4129-8eb6-8954782d7c08 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cae76309-eb51-4c90-9c65-c4558118443d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:10:13 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-dd8b4c57-cce5-4129-8eb6-8954782d7c08 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cae76309-eb51-4c90-9c65-c4558118443d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:10:13 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-dd8b4c57-cce5-4129-8eb6-8954782d7c08 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddcb9de6-2e6b-41cc-ba5b-d47515163eca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:10:13 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-dd8b4c57-cce5-4129-8eb6-8954782d7c08 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddcb9de6-2e6b-41cc-ba5b-d47515163eca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ba708fe-16fb-4cea-ab4a-07641a46708d', 'volume_name': 'volume-0ba708fe-16fb-4cea-ab4a-07641a46708d', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:10:13 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-dd8b4c57-cce5-4129-8eb6-8954782d7c08 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (020ed96e-2e0f-43cd-b733-854af4b8d53a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:10:13 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-dd8b4c57-cce5-4129-8eb6-8954782d7c08 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (020ed96e-2e0f-43cd-b733-854af4b8d53a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:10:13 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-dd8b4c57-cce5-4129-8eb6-8954782d7c08 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08fb8c12-317b-47c0-8744-45e470f4ea3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:10:13 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-dd8b4c57-cce5-4129-8eb6-8954782d7c08 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Volume 0ba708fe-16fb-4cea-ab4a-07641a46708d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ba708fe-16fb-4cea-ab4a-07641a46708d', 'volume_size': 1} Sep 17 22:10:13 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-dd8b4c57-cce5-4129-8eb6-8954782d7c08 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:10:13 devstack sudo[104005]: pam_unix(sudo:session): session closed for user root Sep 17 22:10:13 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-56fe779e-6f0c-45f8-8024-945f66c8432e tempest-CreateVolumesFromSnapshotTest-2038377790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a28cdd24-f294-45a7-933f-652e1907157c 1073741824" returned: 0 in 0.531s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:10:13 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-56fe779e-6f0c-45f8-8024-945f66c8432e tempest-CreateVolumesFromSnapshotTest-2038377790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a28cdd24-f294-45a7-933f-652e1907157c {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:10:13 devstack sudo[104010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a28cdd24-f294-45a7-933f-652e1907157c Sep 17 22:10:13 devstack sudo[104010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:10:13 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a1ebea0-677b-4175-835b-e1860c29ccf6 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 22:10:13 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-9a1ebea0-677b-4175-835b-e1860c29ccf6 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Flow 'volume_create_manager' (872176d8-d5cd-4c70-b7e1-1d99d7ce95b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:10:13 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-9a1ebea0-677b-4175-835b-e1860c29ccf6 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd8b47e5-89d8-482b-b72f-68e659b4097e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:10:13 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-9a1ebea0-677b-4175-835b-e1860c29ccf6 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd8b47e5-89d8-482b-b72f-68e659b4097e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:10:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-518485918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1685e4b9-bea9-4714-b82f-50b78d1b13a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cc58c3e6d524107b947cfbde3cdc7c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:10:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:10:13Z,use_quota=True,user_id='7a9ea135852042889af2b337ea9ace2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:10:13 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-9a1ebea0-677b-4175-835b-e1860c29ccf6 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bd994a1-3284-4afe-8c14-9ff564455d69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:10:13 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-9a1ebea0-677b-4175-835b-e1860c29ccf6 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bd994a1-3284-4afe-8c14-9ff564455d69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:10:13 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-9a1ebea0-677b-4175-835b-e1860c29ccf6 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b88ed505-520a-42bd-8cfc-f4b6b03d9a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:10:13 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-9a1ebea0-677b-4175-835b-e1860c29ccf6 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b88ed505-520a-42bd-8cfc-f4b6b03d9a59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1685e4b9-bea9-4714-b82f-50b78d1b13a0', 'volume_name': 'volume-1685e4b9-bea9-4714-b82f-50b78d1b13a0', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:10:13 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-9a1ebea0-677b-4175-835b-e1860c29ccf6 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94e1301b-a40b-41f8-b190-3ff97151ffba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:10:13 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-9a1ebea0-677b-4175-835b-e1860c29ccf6 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94e1301b-a40b-41f8-b190-3ff97151ffba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:10:13 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-9a1ebea0-677b-4175-835b-e1860c29ccf6 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6cb3e5b-78f6-4f47-92e3-52dc5bb63203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:10:13 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-9a1ebea0-677b-4175-835b-e1860c29ccf6 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Volume 1685e4b9-bea9-4714-b82f-50b78d1b13a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1685e4b9-bea9-4714-b82f-50b78d1b13a0', 'volume_size': 1} Sep 17 22:10:13 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-9a1ebea0-677b-4175-835b-e1860c29ccf6 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:10:13 devstack sudo[104010]: pam_unix(sudo:session): session closed for user root Sep 17 22:10:13 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-56fe779e-6f0c-45f8-8024-945f66c8432e tempest-CreateVolumesFromSnapshotTest-2038377790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a28cdd24-f294-45a7-933f-652e1907157c" returned: 0 in 0.257s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:10:13 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-56fe779e-6f0c-45f8-8024-945f66c8432e tempest-CreateVolumesFromSnapshotTest-2038377790 None] <== create_volume: return (860ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 22:10:13 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-56fe779e-6f0c-45f8-8024-945f66c8432e tempest-CreateVolumesFromSnapshotTest-2038377790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.864s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:10:13 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-dd8b4c57-cce5-4129-8eb6-8954782d7c08 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.488s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:10:13 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-dd8b4c57-cce5-4129-8eb6-8954782d7c08 tempest-CreateVolumesFromSnapshotTest-2038377790 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:10:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-639047957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ba708fe-16fb-4cea-ab4a-07641a46708d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cc58c3e6d524107b947cfbde3cdc7c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:10:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:10:13Z,use_quota=True,user_id='7a9ea135852042889af2b337ea9ace2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 22:10:13 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-dd8b4c57-cce5-4129-8eb6-8954782d7c08 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Creating volume 0ba708fe-16fb-4cea-ab4a-07641a46708d {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 22:10:13 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-dd8b4c57-cce5-4129-8eb6-8954782d7c08 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:10:13 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-dd8b4c57-cce5-4129-8eb6-8954782d7c08 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:10:13 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-dd8b4c57-cce5-4129-8eb6-8954782d7c08 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:10:13 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-dd8b4c57-cce5-4129-8eb6-8954782d7c08 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:10:13 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-dd8b4c57-cce5-4129-8eb6-8954782d7c08 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:10:13 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-dd8b4c57-cce5-4129-8eb6-8954782d7c08 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 22:10:13 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-dd8b4c57-cce5-4129-8eb6-8954782d7c08 tempest-CreateVolumesFromSnapshotTest-2038377790 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 22:10:13 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-dd8b4c57-cce5-4129-8eb6-8954782d7c08 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0ba708fe-16fb-4cea-ab4a-07641a46708d 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:10:13 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-56fe779e-6f0c-45f8-8024-945f66c8432e tempest-CreateVolumesFromSnapshotTest-2038377790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97b9029c-ea1c-45eb-905f-e3e13e8bf29d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a28cdd24-f294-45a7-933f-652e1907157c', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:10:13 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-56fe779e-6f0c-45f8-8024-945f66c8432e tempest-CreateVolumesFromSnapshotTest-2038377790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e16be88-3120-429a-86c5-dc33d3ca48a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:10:13 devstack sudo[104013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0ba708fe-16fb-4cea-ab4a-07641a46708d 1073741824 Sep 17 22:10:13 devstack sudo[104013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:10:13 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-56fe779e-6f0c-45f8-8024-945f66c8432e tempest-CreateVolumesFromSnapshotTest-2038377790 None] Volume volume-a28cdd24-f294-45a7-933f-652e1907157c (a28cdd24-f294-45a7-933f-652e1907157c): created successfully Sep 17 22:10:13 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-56fe779e-6f0c-45f8-8024-945f66c8432e tempest-CreateVolumesFromSnapshotTest-2038377790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e16be88-3120-429a-86c5-dc33d3ca48a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:10:13 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-56fe779e-6f0c-45f8-8024-945f66c8432e tempest-CreateVolumesFromSnapshotTest-2038377790 None] Flow 'volume_create_manager' (50303d07-d0f4-4ad0-b15c-0c0f2011fd2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:10:13 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-56fe779e-6f0c-45f8-8024-945f66c8432e tempest-CreateVolumesFromSnapshotTest-2038377790 None] Created volume successfully. Sep 17 22:10:13 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-125e1a98-84ba-48a6-a357-ed861fef2716 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 22:10:13 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-125e1a98-84ba-48a6-a357-ed861fef2716 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Flow 'volume_create_manager' (507ecf28-e8a1-4455-b096-749ad81adc5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:10:13 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-125e1a98-84ba-48a6-a357-ed861fef2716 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec359193-ed73-4234-bc77-6e2c8119cbba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:10:13 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-125e1a98-84ba-48a6-a357-ed861fef2716 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec359193-ed73-4234-bc77-6e2c8119cbba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:10:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-918875980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c06f8881-fa57-4401-b4b7-927423343562,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cc58c3e6d524107b947cfbde3cdc7c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:10:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:10:14Z,use_quota=True,user_id='7a9ea135852042889af2b337ea9ace2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:10:13 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-125e1a98-84ba-48a6-a357-ed861fef2716 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e717fee-7684-44a5-aa93-1ee2aa6965c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:10:13 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-125e1a98-84ba-48a6-a357-ed861fef2716 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e717fee-7684-44a5-aa93-1ee2aa6965c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:10:13 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-125e1a98-84ba-48a6-a357-ed861fef2716 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8b1f9a3-c35f-4c9a-a5f7-1a125546f6f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:10:13 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-125e1a98-84ba-48a6-a357-ed861fef2716 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8b1f9a3-c35f-4c9a-a5f7-1a125546f6f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c06f8881-fa57-4401-b4b7-927423343562', 'volume_name': 'volume-c06f8881-fa57-4401-b4b7-927423343562', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:10:13 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-125e1a98-84ba-48a6-a357-ed861fef2716 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f93dc07f-326a-4425-8418-5b25d9df94f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:10:13 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-125e1a98-84ba-48a6-a357-ed861fef2716 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f93dc07f-326a-4425-8418-5b25d9df94f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:10:13 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-125e1a98-84ba-48a6-a357-ed861fef2716 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4391b09-3482-4839-bf9a-3c725ca698fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:10:13 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-125e1a98-84ba-48a6-a357-ed861fef2716 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Volume c06f8881-fa57-4401-b4b7-927423343562: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c06f8881-fa57-4401-b4b7-927423343562', 'volume_size': 1} Sep 17 22:10:13 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-125e1a98-84ba-48a6-a357-ed861fef2716 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:10:14 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa971c28-4ce2-47f1-924f-652da9099947 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 22:10:14 devstack sudo[104013]: pam_unix(sudo:session): session closed for user root Sep 17 22:10:14 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-fa971c28-4ce2-47f1-924f-652da9099947 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Flow 'volume_create_manager' (850aa9e3-a9c6-40ef-8295-17641e8acbff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:10:14 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-fa971c28-4ce2-47f1-924f-652da9099947 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (319be9fe-74f7-4a50-b334-4f6ca8f3d4c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:10:14 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-dd8b4c57-cce5-4129-8eb6-8954782d7c08 tempest-CreateVolumesFromSnapshotTest-2038377790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0ba708fe-16fb-4cea-ab4a-07641a46708d 1073741824" returned: 0 in 0.532s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:10:14 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-fa971c28-4ce2-47f1-924f-652da9099947 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (319be9fe-74f7-4a50-b334-4f6ca8f3d4c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:10:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1680012187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2115099-956d-4fb5-ab1f-d924579b6d1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cc58c3e6d524107b947cfbde3cdc7c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:10:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:10:14Z,use_quota=True,user_id='7a9ea135852042889af2b337ea9ace2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:10:14 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-fa971c28-4ce2-47f1-924f-652da9099947 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ef17435-c42d-4e86-8b15-0921eb5a8f2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:10:14 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-fa971c28-4ce2-47f1-924f-652da9099947 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ef17435-c42d-4e86-8b15-0921eb5a8f2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:10:14 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-fa971c28-4ce2-47f1-924f-652da9099947 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (823d641e-42aa-4b0a-a665-eca3c4f391c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:10:14 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-fa971c28-4ce2-47f1-924f-652da9099947 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (823d641e-42aa-4b0a-a665-eca3c4f391c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2115099-956d-4fb5-ab1f-d924579b6d1b', 'volume_name': 'volume-d2115099-956d-4fb5-ab1f-d924579b6d1b', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:10:14 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-fa971c28-4ce2-47f1-924f-652da9099947 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35ce9f3f-24b7-49c8-8169-d6ce27ab217a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:10:14 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-fa971c28-4ce2-47f1-924f-652da9099947 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35ce9f3f-24b7-49c8-8169-d6ce27ab217a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:10:14 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-fa971c28-4ce2-47f1-924f-652da9099947 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db624dbe-e095-4a13-bd43-aa274aef7925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:10:14 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-fa971c28-4ce2-47f1-924f-652da9099947 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Volume d2115099-956d-4fb5-ab1f-d924579b6d1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2115099-956d-4fb5-ab1f-d924579b6d1b', 'volume_size': 1} Sep 17 22:10:14 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-fa971c28-4ce2-47f1-924f-652da9099947 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:10:14 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-dd8b4c57-cce5-4129-8eb6-8954782d7c08 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0ba708fe-16fb-4cea-ab4a-07641a46708d {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:10:14 devstack sudo[104019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0ba708fe-16fb-4cea-ab4a-07641a46708d Sep 17 22:10:14 devstack sudo[104019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:10:14 devstack sudo[104019]: pam_unix(sudo:session): session closed for user root Sep 17 22:10:14 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-dd8b4c57-cce5-4129-8eb6-8954782d7c08 tempest-CreateVolumesFromSnapshotTest-2038377790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0ba708fe-16fb-4cea-ab4a-07641a46708d" returned: 0 in 0.237s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:10:14 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-dd8b4c57-cce5-4129-8eb6-8954782d7c08 tempest-CreateVolumesFromSnapshotTest-2038377790 None] <== create_volume: return (857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 22:10:14 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-dd8b4c57-cce5-4129-8eb6-8954782d7c08 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.859s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:10:14 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-9a1ebea0-677b-4175-835b-e1860c29ccf6 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.998s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:10:14 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-9a1ebea0-677b-4175-835b-e1860c29ccf6 tempest-CreateVolumesFromSnapshotTest-2038377790 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:10:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-518485918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1685e4b9-bea9-4714-b82f-50b78d1b13a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cc58c3e6d524107b947cfbde3cdc7c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:10:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:10:13Z,use_quota=True,user_id='7a9ea135852042889af2b337ea9ace2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 22:10:14 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-9a1ebea0-677b-4175-835b-e1860c29ccf6 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Creating volume 1685e4b9-bea9-4714-b82f-50b78d1b13a0 {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 22:10:14 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-9a1ebea0-677b-4175-835b-e1860c29ccf6 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:10:14 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-9a1ebea0-677b-4175-835b-e1860c29ccf6 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:10:14 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-9a1ebea0-677b-4175-835b-e1860c29ccf6 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:10:14 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-9a1ebea0-677b-4175-835b-e1860c29ccf6 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:10:14 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-9a1ebea0-677b-4175-835b-e1860c29ccf6 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:10:14 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-9a1ebea0-677b-4175-835b-e1860c29ccf6 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 22:10:14 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-9a1ebea0-677b-4175-835b-e1860c29ccf6 tempest-CreateVolumesFromSnapshotTest-2038377790 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 22:10:14 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-9a1ebea0-677b-4175-835b-e1860c29ccf6 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-1685e4b9-bea9-4714-b82f-50b78d1b13a0 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:10:14 devstack sudo[104022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-1685e4b9-bea9-4714-b82f-50b78d1b13a0 1073741824 Sep 17 22:10:14 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-dd8b4c57-cce5-4129-8eb6-8954782d7c08 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08fb8c12-317b-47c0-8744-45e470f4ea3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ba708fe-16fb-4cea-ab4a-07641a46708d', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:10:14 devstack sudo[104022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:10:14 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-dd8b4c57-cce5-4129-8eb6-8954782d7c08 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84d84614-afa6-46df-8b18-25f301efac2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:10:14 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-dd8b4c57-cce5-4129-8eb6-8954782d7c08 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Volume volume-0ba708fe-16fb-4cea-ab4a-07641a46708d (0ba708fe-16fb-4cea-ab4a-07641a46708d): created successfully Sep 17 22:10:14 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-dd8b4c57-cce5-4129-8eb6-8954782d7c08 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84d84614-afa6-46df-8b18-25f301efac2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:10:14 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-dd8b4c57-cce5-4129-8eb6-8954782d7c08 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Flow 'volume_create_manager' (e2dab6b4-ef8d-451a-abce-9bc4093a8d7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:10:14 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-dd8b4c57-cce5-4129-8eb6-8954782d7c08 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Created volume successfully. Sep 17 22:10:14 devstack sudo[104022]: pam_unix(sudo:session): session closed for user root Sep 17 22:10:14 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-9a1ebea0-677b-4175-835b-e1860c29ccf6 tempest-CreateVolumesFromSnapshotTest-2038377790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-1685e4b9-bea9-4714-b82f-50b78d1b13a0 1073741824" returned: 0 in 0.406s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:10:14 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-9a1ebea0-677b-4175-835b-e1860c29ccf6 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-1685e4b9-bea9-4714-b82f-50b78d1b13a0 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:10:14 devstack sudo[104028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-1685e4b9-bea9-4714-b82f-50b78d1b13a0 Sep 17 22:10:14 devstack sudo[104028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:10:15 devstack sudo[104028]: pam_unix(sudo:session): session closed for user root Sep 17 22:10:15 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-9a1ebea0-677b-4175-835b-e1860c29ccf6 tempest-CreateVolumesFromSnapshotTest-2038377790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-1685e4b9-bea9-4714-b82f-50b78d1b13a0" returned: 0 in 0.242s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:10:15 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-9a1ebea0-677b-4175-835b-e1860c29ccf6 tempest-CreateVolumesFromSnapshotTest-2038377790 None] <== create_volume: return (686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 22:10:15 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-9a1ebea0-677b-4175-835b-e1860c29ccf6 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.690s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:10:15 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-125e1a98-84ba-48a6-a357-ed861fef2716 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.253s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:10:15 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-125e1a98-84ba-48a6-a357-ed861fef2716 tempest-CreateVolumesFromSnapshotTest-2038377790 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:10:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-918875980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c06f8881-fa57-4401-b4b7-927423343562,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cc58c3e6d524107b947cfbde3cdc7c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:10:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:10:14Z,use_quota=True,user_id='7a9ea135852042889af2b337ea9ace2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 22:10:15 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-125e1a98-84ba-48a6-a357-ed861fef2716 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Creating volume c06f8881-fa57-4401-b4b7-927423343562 {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 22:10:15 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-125e1a98-84ba-48a6-a357-ed861fef2716 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:10:15 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-125e1a98-84ba-48a6-a357-ed861fef2716 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:10:15 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-125e1a98-84ba-48a6-a357-ed861fef2716 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:10:15 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-125e1a98-84ba-48a6-a357-ed861fef2716 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:10:15 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-125e1a98-84ba-48a6-a357-ed861fef2716 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:10:15 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-125e1a98-84ba-48a6-a357-ed861fef2716 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 22:10:15 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-125e1a98-84ba-48a6-a357-ed861fef2716 tempest-CreateVolumesFromSnapshotTest-2038377790 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 22:10:15 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-125e1a98-84ba-48a6-a357-ed861fef2716 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c06f8881-fa57-4401-b4b7-927423343562 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:10:15 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-9a1ebea0-677b-4175-835b-e1860c29ccf6 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6cb3e5b-78f6-4f47-92e3-52dc5bb63203) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1685e4b9-bea9-4714-b82f-50b78d1b13a0', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:10:15 devstack sudo[104031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c06f8881-fa57-4401-b4b7-927423343562 1073741824 Sep 17 22:10:15 devstack sudo[104031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:10:15 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-9a1ebea0-677b-4175-835b-e1860c29ccf6 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b775af4-8541-4303-846b-a3a4077caaf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:10:15 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-9a1ebea0-677b-4175-835b-e1860c29ccf6 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Volume volume-1685e4b9-bea9-4714-b82f-50b78d1b13a0 (1685e4b9-bea9-4714-b82f-50b78d1b13a0): created successfully Sep 17 22:10:15 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-9a1ebea0-677b-4175-835b-e1860c29ccf6 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b775af4-8541-4303-846b-a3a4077caaf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:10:15 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-9a1ebea0-677b-4175-835b-e1860c29ccf6 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Flow 'volume_create_manager' (872176d8-d5cd-4c70-b7e1-1d99d7ce95b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:10:15 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-9a1ebea0-677b-4175-835b-e1860c29ccf6 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Created volume successfully. Sep 17 22:10:15 devstack sudo[104031]: pam_unix(sudo:session): session closed for user root Sep 17 22:10:15 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-125e1a98-84ba-48a6-a357-ed861fef2716 tempest-CreateVolumesFromSnapshotTest-2038377790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c06f8881-fa57-4401-b4b7-927423343562 1073741824" returned: 0 in 0.397s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:10:15 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-125e1a98-84ba-48a6-a357-ed861fef2716 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c06f8881-fa57-4401-b4b7-927423343562 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:10:15 devstack sudo[104036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c06f8881-fa57-4401-b4b7-927423343562 Sep 17 22:10:15 devstack sudo[104036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:10:15 devstack sudo[104036]: pam_unix(sudo:session): session closed for user root Sep 17 22:10:15 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-125e1a98-84ba-48a6-a357-ed861fef2716 tempest-CreateVolumesFromSnapshotTest-2038377790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c06f8881-fa57-4401-b4b7-927423343562" returned: 0 in 0.243s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:10:15 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-125e1a98-84ba-48a6-a357-ed861fef2716 tempest-CreateVolumesFromSnapshotTest-2038377790 None] <== create_volume: return (681ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 22:10:15 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-125e1a98-84ba-48a6-a357-ed861fef2716 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.683s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:10:15 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-fa971c28-4ce2-47f1-924f-652da9099947 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.650s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:10:15 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-fa971c28-4ce2-47f1-924f-652da9099947 tempest-CreateVolumesFromSnapshotTest-2038377790 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:10:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1680012187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2115099-956d-4fb5-ab1f-d924579b6d1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cc58c3e6d524107b947cfbde3cdc7c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:10:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:10:14Z,use_quota=True,user_id='7a9ea135852042889af2b337ea9ace2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 22:10:15 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-fa971c28-4ce2-47f1-924f-652da9099947 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Creating volume d2115099-956d-4fb5-ab1f-d924579b6d1b {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 22:10:15 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-fa971c28-4ce2-47f1-924f-652da9099947 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:10:15 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-fa971c28-4ce2-47f1-924f-652da9099947 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:10:15 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-fa971c28-4ce2-47f1-924f-652da9099947 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:10:15 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-fa971c28-4ce2-47f1-924f-652da9099947 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:10:15 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-fa971c28-4ce2-47f1-924f-652da9099947 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:10:15 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-fa971c28-4ce2-47f1-924f-652da9099947 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 22:10:15 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-fa971c28-4ce2-47f1-924f-652da9099947 tempest-CreateVolumesFromSnapshotTest-2038377790 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 22:10:15 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-fa971c28-4ce2-47f1-924f-652da9099947 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-d2115099-956d-4fb5-ab1f-d924579b6d1b 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:10:15 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-125e1a98-84ba-48a6-a357-ed861fef2716 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4391b09-3482-4839-bf9a-3c725ca698fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c06f8881-fa57-4401-b4b7-927423343562', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:10:15 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-125e1a98-84ba-48a6-a357-ed861fef2716 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89ae4b9d-306b-4255-8d08-d005ae3a156f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:10:15 devstack sudo[104039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-d2115099-956d-4fb5-ab1f-d924579b6d1b 1073741824 Sep 17 22:10:15 devstack sudo[104039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:10:15 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-125e1a98-84ba-48a6-a357-ed861fef2716 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Volume volume-c06f8881-fa57-4401-b4b7-927423343562 (c06f8881-fa57-4401-b4b7-927423343562): created successfully Sep 17 22:10:15 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-125e1a98-84ba-48a6-a357-ed861fef2716 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89ae4b9d-306b-4255-8d08-d005ae3a156f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:10:15 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-125e1a98-84ba-48a6-a357-ed861fef2716 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Flow 'volume_create_manager' (507ecf28-e8a1-4455-b096-749ad81adc5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:10:15 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-125e1a98-84ba-48a6-a357-ed861fef2716 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Created volume successfully. Sep 17 22:10:16 devstack sudo[104039]: pam_unix(sudo:session): session closed for user root Sep 17 22:10:16 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-fa971c28-4ce2-47f1-924f-652da9099947 tempest-CreateVolumesFromSnapshotTest-2038377790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-d2115099-956d-4fb5-ab1f-d924579b6d1b 1073741824" returned: 0 in 0.436s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:10:16 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-fa971c28-4ce2-47f1-924f-652da9099947 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-d2115099-956d-4fb5-ab1f-d924579b6d1b {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:10:16 devstack sudo[104045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-d2115099-956d-4fb5-ab1f-d924579b6d1b Sep 17 22:10:16 devstack sudo[104045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:10:16 devstack sudo[104045]: pam_unix(sudo:session): session closed for user root Sep 17 22:10:16 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-fa971c28-4ce2-47f1-924f-652da9099947 tempest-CreateVolumesFromSnapshotTest-2038377790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-d2115099-956d-4fb5-ab1f-d924579b6d1b" returned: 0 in 0.236s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:10:16 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-fa971c28-4ce2-47f1-924f-652da9099947 tempest-CreateVolumesFromSnapshotTest-2038377790 None] <== create_volume: return (712ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 22:10:16 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-fa971c28-4ce2-47f1-924f-652da9099947 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.715s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:10:16 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-fa971c28-4ce2-47f1-924f-652da9099947 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db624dbe-e095-4a13-bd43-aa274aef7925) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2115099-956d-4fb5-ab1f-d924579b6d1b', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:10:16 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-fa971c28-4ce2-47f1-924f-652da9099947 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (471b47e9-5772-4273-bed9-f0c518d4404c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:10:16 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-fa971c28-4ce2-47f1-924f-652da9099947 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Volume volume-d2115099-956d-4fb5-ab1f-d924579b6d1b (d2115099-956d-4fb5-ab1f-d924579b6d1b): created successfully Sep 17 22:10:16 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-fa971c28-4ce2-47f1-924f-652da9099947 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (471b47e9-5772-4273-bed9-f0c518d4404c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:10:16 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-fa971c28-4ce2-47f1-924f-652da9099947 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Flow 'volume_create_manager' (850aa9e3-a9c6-40ef-8295-17641e8acbff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:10:16 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-fa971c28-4ce2-47f1-924f-652da9099947 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Created volume successfully. Sep 17 22:10:17 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-5b18c8c8-c224-47d7-85c8-82ea62931a33 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Acquiring lock "cinder-d2115099-956d-4fb5-ab1f-d924579b6d1b-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:10:17 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-5b18c8c8-c224-47d7-85c8-82ea62931a33 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Lock "cinder-d2115099-956d-4fb5-ab1f-d924579b6d1b-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:10:17 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-5b18c8c8-c224-47d7-85c8-82ea62931a33 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Acquiring lock "cinder-quobyte-d2115099-956d-4fb5-ab1f-d924579b6d1b" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:10:17 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-5b18c8c8-c224-47d7-85c8-82ea62931a33 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Lock "cinder-quobyte-d2115099-956d-4fb5-ab1f-d924579b6d1b" acquired by "delete_volume" :: waited 0.014s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:10:17 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[6509023e-ec83-4176-b4f7-0732c613ef6c]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:10:17 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-5b18c8c8-c224-47d7-85c8-82ea62931a33 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-d2115099-956d-4fb5-ab1f-d924579b6d1b {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:10:17 devstack sudo[104048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-d2115099-956d-4fb5-ab1f-d924579b6d1b Sep 17 22:10:17 devstack sudo[104048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:10:17 devstack sudo[104048]: pam_unix(sudo:session): session closed for user root Sep 17 22:10:17 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-5b18c8c8-c224-47d7-85c8-82ea62931a33 tempest-CreateVolumesFromSnapshotTest-2038377790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-d2115099-956d-4fb5-ab1f-d924579b6d1b" returned: 0 in 0.353s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:10:17 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-5b18c8c8-c224-47d7-85c8-82ea62931a33 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-d2115099-956d-4fb5-ab1f-d924579b6d1b {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:10:17 devstack sudo[104053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-d2115099-956d-4fb5-ab1f-d924579b6d1b Sep 17 22:10:17 devstack sudo[104053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:10:18 devstack sudo[104053]: pam_unix(sudo:session): session closed for user root Sep 17 22:10:18 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-5b18c8c8-c224-47d7-85c8-82ea62931a33 tempest-CreateVolumesFromSnapshotTest-2038377790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-d2115099-956d-4fb5-ab1f-d924579b6d1b" returned: 0 in 0.244s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:10:18 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-5b18c8c8-c224-47d7-85c8-82ea62931a33 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Lock "cinder-quobyte-d2115099-956d-4fb5-ab1f-d924579b6d1b" released by "delete_volume" :: held 0.637s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:10:18 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-5b18c8c8-c224-47d7-85c8-82ea62931a33 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Created reservations ['c9cfaa93-c5a5-4acb-99da-9f7759dc2334', '5aa8b97f-e633-4c73-a5c0-dd73ef30fe54', '10379eed-c2fa-48cd-ab47-c90dbe42fc20', 'aedd43ef-4d31-427a-9976-c4ef0660a644'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:10:18 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-5b18c8c8-c224-47d7-85c8-82ea62931a33 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:10:18 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-5b18c8c8-c224-47d7-85c8-82ea62931a33 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:10:18 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-5b18c8c8-c224-47d7-85c8-82ea62931a33 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:10:18 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-5b18c8c8-c224-47d7-85c8-82ea62931a33 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:10:18 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-5b18c8c8-c224-47d7-85c8-82ea62931a33 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:10:18 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-5b18c8c8-c224-47d7-85c8-82ea62931a33 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:10:18 devstack sudo[104056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:10:18 devstack sudo[104056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:10:18 devstack sudo[104056]: pam_unix(sudo:session): session closed for user root Sep 17 22:10:18 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-5b18c8c8-c224-47d7-85c8-82ea62931a33 tempest-CreateVolumesFromSnapshotTest-2038377790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.243s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:10:18 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-5b18c8c8-c224-47d7-85c8-82ea62931a33 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:10:18 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-5b18c8c8-c224-47d7-85c8-82ea62931a33 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Deleted volume successfully. Sep 17 22:10:18 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-5b18c8c8-c224-47d7-85c8-82ea62931a33 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Lock "cinder-d2115099-956d-4fb5-ab1f-d924579b6d1b-delete_volume" released by "delete_volume" :: held 1.061s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:10:18 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-b5bcfca8-d6d6-46fc-81d3-9736203550e7 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Acquiring lock "cinder-c06f8881-fa57-4401-b4b7-927423343562-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:10:18 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-b5bcfca8-d6d6-46fc-81d3-9736203550e7 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Lock "cinder-c06f8881-fa57-4401-b4b7-927423343562-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:10:18 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-b5bcfca8-d6d6-46fc-81d3-9736203550e7 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Acquiring lock "cinder-quobyte-c06f8881-fa57-4401-b4b7-927423343562" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:10:18 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-b5bcfca8-d6d6-46fc-81d3-9736203550e7 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Lock "cinder-quobyte-c06f8881-fa57-4401-b4b7-927423343562" acquired by "delete_volume" :: waited 0.014s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:10:18 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[7736fde7-8937-459e-9b50-00ac8fc63abf]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:10:18 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-b5bcfca8-d6d6-46fc-81d3-9736203550e7 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c06f8881-fa57-4401-b4b7-927423343562 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:10:18 devstack sudo[104059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c06f8881-fa57-4401-b4b7-927423343562 Sep 17 22:10:18 devstack sudo[104059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:10:19 devstack sudo[104059]: pam_unix(sudo:session): session closed for user root Sep 17 22:10:19 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-b5bcfca8-d6d6-46fc-81d3-9736203550e7 tempest-CreateVolumesFromSnapshotTest-2038377790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c06f8881-fa57-4401-b4b7-927423343562" returned: 0 in 0.347s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:10:19 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-b5bcfca8-d6d6-46fc-81d3-9736203550e7 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c06f8881-fa57-4401-b4b7-927423343562 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:10:19 devstack sudo[104064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c06f8881-fa57-4401-b4b7-927423343562 Sep 17 22:10:19 devstack sudo[104064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:10:19 devstack sudo[104064]: pam_unix(sudo:session): session closed for user root Sep 17 22:10:19 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-b5bcfca8-d6d6-46fc-81d3-9736203550e7 tempest-CreateVolumesFromSnapshotTest-2038377790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c06f8881-fa57-4401-b4b7-927423343562" returned: 0 in 0.235s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:10:19 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-b5bcfca8-d6d6-46fc-81d3-9736203550e7 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Lock "cinder-quobyte-c06f8881-fa57-4401-b4b7-927423343562" released by "delete_volume" :: held 0.620s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:10:19 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-b5bcfca8-d6d6-46fc-81d3-9736203550e7 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Created reservations ['87dcb377-e21c-47ea-b2ac-769b5eeef13c', '9b091407-f0a1-4014-9e73-bd9a588996fb', 'e053ae07-8e13-440e-995a-e0335fa4dc1f', 'd58fd5d2-ad03-437a-a42d-8eac6d4a55d6'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:10:19 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-b5bcfca8-d6d6-46fc-81d3-9736203550e7 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:10:19 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-b5bcfca8-d6d6-46fc-81d3-9736203550e7 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:10:19 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-b5bcfca8-d6d6-46fc-81d3-9736203550e7 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:10:19 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-b5bcfca8-d6d6-46fc-81d3-9736203550e7 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:10:19 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-b5bcfca8-d6d6-46fc-81d3-9736203550e7 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:10:19 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-b5bcfca8-d6d6-46fc-81d3-9736203550e7 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:10:19 devstack sudo[104067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:10:19 devstack sudo[104067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:10:19 devstack sudo[104067]: pam_unix(sudo:session): session closed for user root Sep 17 22:10:19 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-b5bcfca8-d6d6-46fc-81d3-9736203550e7 tempest-CreateVolumesFromSnapshotTest-2038377790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.236s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:10:19 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-b5bcfca8-d6d6-46fc-81d3-9736203550e7 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:10:19 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-b5bcfca8-d6d6-46fc-81d3-9736203550e7 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Deleted volume successfully. Sep 17 22:10:19 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-b5bcfca8-d6d6-46fc-81d3-9736203550e7 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Lock "cinder-c06f8881-fa57-4401-b4b7-927423343562-delete_volume" released by "delete_volume" :: held 1.039s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:10:19 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-76539704-4d27-4ad6-972d-d735cb68082c tempest-CreateVolumesFromSnapshotTest-2038377790 None] Acquiring lock "cinder-1685e4b9-bea9-4714-b82f-50b78d1b13a0-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:10:19 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-76539704-4d27-4ad6-972d-d735cb68082c tempest-CreateVolumesFromSnapshotTest-2038377790 None] Lock "cinder-1685e4b9-bea9-4714-b82f-50b78d1b13a0-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:10:19 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-76539704-4d27-4ad6-972d-d735cb68082c tempest-CreateVolumesFromSnapshotTest-2038377790 None] Acquiring lock "cinder-quobyte-1685e4b9-bea9-4714-b82f-50b78d1b13a0" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:10:19 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-76539704-4d27-4ad6-972d-d735cb68082c tempest-CreateVolumesFromSnapshotTest-2038377790 None] Lock "cinder-quobyte-1685e4b9-bea9-4714-b82f-50b78d1b13a0" acquired by "delete_volume" :: waited 0.015s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:10:19 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[3577d27b-535a-4f71-8d0c-c16bb5141337]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:10:19 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-76539704-4d27-4ad6-972d-d735cb68082c tempest-CreateVolumesFromSnapshotTest-2038377790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-1685e4b9-bea9-4714-b82f-50b78d1b13a0 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:10:19 devstack sudo[104071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-1685e4b9-bea9-4714-b82f-50b78d1b13a0 Sep 17 22:10:19 devstack sudo[104071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:10:20 devstack sudo[104071]: pam_unix(sudo:session): session closed for user root Sep 17 22:10:20 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-76539704-4d27-4ad6-972d-d735cb68082c tempest-CreateVolumesFromSnapshotTest-2038377790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-1685e4b9-bea9-4714-b82f-50b78d1b13a0" returned: 0 in 0.356s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:10:20 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-76539704-4d27-4ad6-972d-d735cb68082c tempest-CreateVolumesFromSnapshotTest-2038377790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-1685e4b9-bea9-4714-b82f-50b78d1b13a0 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:10:20 devstack sudo[104076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-1685e4b9-bea9-4714-b82f-50b78d1b13a0 Sep 17 22:10:20 devstack sudo[104076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:10:20 devstack sudo[104076]: pam_unix(sudo:session): session closed for user root Sep 17 22:10:20 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-76539704-4d27-4ad6-972d-d735cb68082c tempest-CreateVolumesFromSnapshotTest-2038377790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-1685e4b9-bea9-4714-b82f-50b78d1b13a0" returned: 0 in 0.284s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:10:20 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-76539704-4d27-4ad6-972d-d735cb68082c tempest-CreateVolumesFromSnapshotTest-2038377790 None] Lock "cinder-quobyte-1685e4b9-bea9-4714-b82f-50b78d1b13a0" released by "delete_volume" :: held 0.679s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:10:20 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-76539704-4d27-4ad6-972d-d735cb68082c tempest-CreateVolumesFromSnapshotTest-2038377790 None] Created reservations ['42a554a4-4e27-42dd-9440-23dcffb083ba', 'efcd957b-93b8-4d2d-a9f3-816d2d966948', '284b698d-6c55-4221-aa81-57fd4a49059f', 'cbddce91-bf15-454e-a8d0-be6dadcf8688'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:10:20 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-76539704-4d27-4ad6-972d-d735cb68082c tempest-CreateVolumesFromSnapshotTest-2038377790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:10:20 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-76539704-4d27-4ad6-972d-d735cb68082c tempest-CreateVolumesFromSnapshotTest-2038377790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:10:20 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-76539704-4d27-4ad6-972d-d735cb68082c tempest-CreateVolumesFromSnapshotTest-2038377790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:10:20 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-76539704-4d27-4ad6-972d-d735cb68082c tempest-CreateVolumesFromSnapshotTest-2038377790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:10:20 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-76539704-4d27-4ad6-972d-d735cb68082c tempest-CreateVolumesFromSnapshotTest-2038377790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:10:20 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-76539704-4d27-4ad6-972d-d735cb68082c tempest-CreateVolumesFromSnapshotTest-2038377790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:10:20 devstack sudo[104079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:10:20 devstack sudo[104079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:10:20 devstack sudo[104079]: pam_unix(sudo:session): session closed for user root Sep 17 22:10:20 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-76539704-4d27-4ad6-972d-d735cb68082c tempest-CreateVolumesFromSnapshotTest-2038377790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.236s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:10:20 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-76539704-4d27-4ad6-972d-d735cb68082c tempest-CreateVolumesFromSnapshotTest-2038377790 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:10:20 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-76539704-4d27-4ad6-972d-d735cb68082c tempest-CreateVolumesFromSnapshotTest-2038377790 None] Deleted volume successfully. Sep 17 22:10:20 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-76539704-4d27-4ad6-972d-d735cb68082c tempest-CreateVolumesFromSnapshotTest-2038377790 None] Lock "cinder-1685e4b9-bea9-4714-b82f-50b78d1b13a0-delete_volume" released by "delete_volume" :: held 1.103s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:10:20 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-1ba60427-2afb-482a-af39-6778cef98a9e tempest-CreateVolumesFromSnapshotTest-2038377790 None] Acquiring lock "cinder-0ba708fe-16fb-4cea-ab4a-07641a46708d-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:10:20 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-1ba60427-2afb-482a-af39-6778cef98a9e tempest-CreateVolumesFromSnapshotTest-2038377790 None] Lock "cinder-0ba708fe-16fb-4cea-ab4a-07641a46708d-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:10:20 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-1ba60427-2afb-482a-af39-6778cef98a9e tempest-CreateVolumesFromSnapshotTest-2038377790 None] Acquiring lock "cinder-quobyte-0ba708fe-16fb-4cea-ab4a-07641a46708d" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:10:21 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-1ba60427-2afb-482a-af39-6778cef98a9e tempest-CreateVolumesFromSnapshotTest-2038377790 None] Lock "cinder-quobyte-0ba708fe-16fb-4cea-ab4a-07641a46708d" acquired by "delete_volume" :: waited 0.014s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:10:21 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[04b49582-76e8-40c4-a518-52a41b81008f]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:10:21 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-1ba60427-2afb-482a-af39-6778cef98a9e tempest-CreateVolumesFromSnapshotTest-2038377790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0ba708fe-16fb-4cea-ab4a-07641a46708d {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:10:21 devstack sudo[104082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0ba708fe-16fb-4cea-ab4a-07641a46708d Sep 17 22:10:21 devstack sudo[104082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:10:21 devstack sudo[104082]: pam_unix(sudo:session): session closed for user root Sep 17 22:10:21 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-1ba60427-2afb-482a-af39-6778cef98a9e tempest-CreateVolumesFromSnapshotTest-2038377790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0ba708fe-16fb-4cea-ab4a-07641a46708d" returned: 0 in 0.348s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:10:21 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-1ba60427-2afb-482a-af39-6778cef98a9e tempest-CreateVolumesFromSnapshotTest-2038377790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0ba708fe-16fb-4cea-ab4a-07641a46708d {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:10:21 devstack sudo[104087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0ba708fe-16fb-4cea-ab4a-07641a46708d Sep 17 22:10:21 devstack sudo[104087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:10:21 devstack sudo[104087]: pam_unix(sudo:session): session closed for user root Sep 17 22:10:21 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-1ba60427-2afb-482a-af39-6778cef98a9e tempest-CreateVolumesFromSnapshotTest-2038377790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0ba708fe-16fb-4cea-ab4a-07641a46708d" returned: 0 in 0.250s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:10:21 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-1ba60427-2afb-482a-af39-6778cef98a9e tempest-CreateVolumesFromSnapshotTest-2038377790 None] Lock "cinder-quobyte-0ba708fe-16fb-4cea-ab4a-07641a46708d" released by "delete_volume" :: held 0.637s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:10:21 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-1ba60427-2afb-482a-af39-6778cef98a9e tempest-CreateVolumesFromSnapshotTest-2038377790 None] Created reservations ['f802b80f-1a33-4d16-8395-99fa4ce44575', 'dc236273-8c77-4a58-a7ad-3aa13fd2084f', '31340d36-d4b1-485d-83db-2c113d75e811', '8c7b870e-3ff7-4103-ac6b-3eb3c3156377'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:10:21 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-1ba60427-2afb-482a-af39-6778cef98a9e tempest-CreateVolumesFromSnapshotTest-2038377790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:10:21 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-1ba60427-2afb-482a-af39-6778cef98a9e tempest-CreateVolumesFromSnapshotTest-2038377790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:10:21 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-1ba60427-2afb-482a-af39-6778cef98a9e tempest-CreateVolumesFromSnapshotTest-2038377790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:10:21 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-1ba60427-2afb-482a-af39-6778cef98a9e tempest-CreateVolumesFromSnapshotTest-2038377790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:10:21 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-1ba60427-2afb-482a-af39-6778cef98a9e tempest-CreateVolumesFromSnapshotTest-2038377790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:10:21 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-1ba60427-2afb-482a-af39-6778cef98a9e tempest-CreateVolumesFromSnapshotTest-2038377790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:10:21 devstack sudo[104090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:10:21 devstack sudo[104090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:10:21 devstack sudo[104090]: pam_unix(sudo:session): session closed for user root Sep 17 22:10:21 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-1ba60427-2afb-482a-af39-6778cef98a9e tempest-CreateVolumesFromSnapshotTest-2038377790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.236s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:10:21 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-1ba60427-2afb-482a-af39-6778cef98a9e tempest-CreateVolumesFromSnapshotTest-2038377790 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:10:21 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-1ba60427-2afb-482a-af39-6778cef98a9e tempest-CreateVolumesFromSnapshotTest-2038377790 None] Deleted volume successfully. Sep 17 22:10:22 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-1ba60427-2afb-482a-af39-6778cef98a9e tempest-CreateVolumesFromSnapshotTest-2038377790 None] Lock "cinder-0ba708fe-16fb-4cea-ab4a-07641a46708d-delete_volume" released by "delete_volume" :: held 1.053s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:10:22 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-1451ba7b-ef6b-4d97-834f-4e277e526086 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Acquiring lock "cinder-a28cdd24-f294-45a7-933f-652e1907157c-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:10:22 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-1451ba7b-ef6b-4d97-834f-4e277e526086 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Lock "cinder-a28cdd24-f294-45a7-933f-652e1907157c-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:10:22 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-1451ba7b-ef6b-4d97-834f-4e277e526086 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Acquiring lock "cinder-quobyte-a28cdd24-f294-45a7-933f-652e1907157c" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:10:22 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-1451ba7b-ef6b-4d97-834f-4e277e526086 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Lock "cinder-quobyte-a28cdd24-f294-45a7-933f-652e1907157c" acquired by "delete_volume" :: waited 0.013s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:10:22 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[f370e431-24d0-45dc-96f2-3652b391aead]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:10:22 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-1451ba7b-ef6b-4d97-834f-4e277e526086 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a28cdd24-f294-45a7-933f-652e1907157c {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:10:22 devstack sudo[104093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a28cdd24-f294-45a7-933f-652e1907157c Sep 17 22:10:22 devstack sudo[104093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:10:22 devstack sudo[104093]: pam_unix(sudo:session): session closed for user root Sep 17 22:10:22 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-1451ba7b-ef6b-4d97-834f-4e277e526086 tempest-CreateVolumesFromSnapshotTest-2038377790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a28cdd24-f294-45a7-933f-652e1907157c" returned: 0 in 0.358s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:10:22 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-1451ba7b-ef6b-4d97-834f-4e277e526086 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a28cdd24-f294-45a7-933f-652e1907157c {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:10:22 devstack sudo[104098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a28cdd24-f294-45a7-933f-652e1907157c Sep 17 22:10:22 devstack sudo[104098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:10:22 devstack sudo[104098]: pam_unix(sudo:session): session closed for user root Sep 17 22:10:22 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-1451ba7b-ef6b-4d97-834f-4e277e526086 tempest-CreateVolumesFromSnapshotTest-2038377790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a28cdd24-f294-45a7-933f-652e1907157c" returned: 0 in 0.236s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:10:22 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-1451ba7b-ef6b-4d97-834f-4e277e526086 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Lock "cinder-quobyte-a28cdd24-f294-45a7-933f-652e1907157c" released by "delete_volume" :: held 0.636s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:10:22 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-1451ba7b-ef6b-4d97-834f-4e277e526086 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Created reservations ['e5cbae38-49da-43c2-8bed-22c2977ae3a8', 'cfe9df9c-53d6-4598-93ca-b46cae34c067', '2817688a-a636-4d5a-b7d8-92b02852d65b', '8f9e8d90-99ef-4b20-b793-a6ca1aaa1fe8'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:10:22 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-1451ba7b-ef6b-4d97-834f-4e277e526086 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:10:22 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-1451ba7b-ef6b-4d97-834f-4e277e526086 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:10:22 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-1451ba7b-ef6b-4d97-834f-4e277e526086 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:10:22 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-1451ba7b-ef6b-4d97-834f-4e277e526086 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:10:22 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-1451ba7b-ef6b-4d97-834f-4e277e526086 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:10:22 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-1451ba7b-ef6b-4d97-834f-4e277e526086 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:10:22 devstack sudo[104101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:10:22 devstack sudo[104101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:10:23 devstack sudo[104101]: pam_unix(sudo:session): session closed for user root Sep 17 22:10:23 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-1451ba7b-ef6b-4d97-834f-4e277e526086 tempest-CreateVolumesFromSnapshotTest-2038377790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.240s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:10:23 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-1451ba7b-ef6b-4d97-834f-4e277e526086 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:10:23 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-1451ba7b-ef6b-4d97-834f-4e277e526086 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Deleted volume successfully. Sep 17 22:10:23 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-1451ba7b-ef6b-4d97-834f-4e277e526086 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Lock "cinder-a28cdd24-f294-45a7-933f-652e1907157c-delete_volume" released by "delete_volume" :: held 1.051s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:10:23 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-6faa0ebe-7165-4f6e-b6e7-56b8ac3d0d87 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Acquiring lock "cinder-36e63f19-9ca2-4337-ab5e-438012700b56-delete_snapshot" by "delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:10:23 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-6faa0ebe-7165-4f6e-b6e7-56b8ac3d0d87 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Lock "cinder-36e63f19-9ca2-4337-ab5e-438012700b56-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:10:23 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-6faa0ebe-7165-4f6e-b6e7-56b8ac3d0d87 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Acquiring lock "cinder-quobyte-f91ac926-6ead-4929-a5e2-88b7f0a7d2d9" by "delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:10:23 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-6faa0ebe-7165-4f6e-b6e7-56b8ac3d0d87 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Lock "cinder-quobyte-f91ac926-6ead-4929-a5e2-88b7f0a7d2d9" acquired by "delete_snapshot" :: waited 0.013s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:10:23 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-6faa0ebe-7165-4f6e-b6e7-56b8ac3d0d87 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Acquiring lock "cinder-quobyte-36e63f19-9ca2-4337-ab5e-438012700b56" by "_delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:10:23 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-6faa0ebe-7165-4f6e-b6e7-56b8ac3d0d87 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Lock "cinder-quobyte-36e63f19-9ca2-4337-ab5e-438012700b56" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:10:23 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-6faa0ebe-7165-4f6e-b6e7-56b8ac3d0d87 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Deleting offline snapshot 36e63f19-9ca2-4337-ab5e-438012700b56 of volume f91ac926-6ead-4929-a5e2-88b7f0a7d2d9 {{(pid=85458) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 22:10:23 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-6faa0ebe-7165-4f6e-b6e7-56b8ac3d0d87 tempest-CreateVolumesFromSnapshotTest-2038377790 None] snapshot_file for this snap is: volume-f91ac926-6ead-4929-a5e2-88b7f0a7d2d9.36e63f19-9ca2-4337-ab5e-438012700b56 {{(pid=85458) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 22:10:23 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[d91a5929-41ba-4ebc-b635-7c42f4d91a5f]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:10:23 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-6faa0ebe-7165-4f6e-b6e7-56b8ac3d0d87 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f91ac926-6ead-4929-a5e2-88b7f0a7d2d9.36e63f19-9ca2-4337-ab5e-438012700b56 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:10:23 devstack sudo[104104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f91ac926-6ead-4929-a5e2-88b7f0a7d2d9.36e63f19-9ca2-4337-ab5e-438012700b56 Sep 17 22:10:23 devstack sudo[104104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:10:23 devstack sudo[104104]: pam_unix(sudo:session): session closed for user root Sep 17 22:10:23 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-6faa0ebe-7165-4f6e-b6e7-56b8ac3d0d87 tempest-CreateVolumesFromSnapshotTest-2038377790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f91ac926-6ead-4929-a5e2-88b7f0a7d2d9.36e63f19-9ca2-4337-ab5e-438012700b56" returned: 0 in 0.347s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:10:23 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-6faa0ebe-7165-4f6e-b6e7-56b8ac3d0d87 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f91ac926-6ead-4929-a5e2-88b7f0a7d2d9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85458) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 22:10:23 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9f75627-1bf6-4f77-8b88-fe4b27515854]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:10:23 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-6faa0ebe-7165-4f6e-b6e7-56b8ac3d0d87 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f91ac926-6ead-4929-a5e2-88b7f0a7d2d9 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:10:23 devstack sudo[104109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f91ac926-6ead-4929-a5e2-88b7f0a7d2d9 Sep 17 22:10:23 devstack sudo[104109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:10:24 devstack sudo[104109]: pam_unix(sudo:session): session closed for user root Sep 17 22:10:24 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-6faa0ebe-7165-4f6e-b6e7-56b8ac3d0d87 tempest-CreateVolumesFromSnapshotTest-2038377790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f91ac926-6ead-4929-a5e2-88b7f0a7d2d9" returned: 0 in 0.347s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:10:24 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-6faa0ebe-7165-4f6e-b6e7-56b8ac3d0d87 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f91ac926-6ead-4929-a5e2-88b7f0a7d2d9.36e63f19-9ca2-4337-ab5e-438012700b56 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:10:24 devstack sudo[104114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f91ac926-6ead-4929-a5e2-88b7f0a7d2d9.36e63f19-9ca2-4337-ab5e-438012700b56 Sep 17 22:10:24 devstack sudo[104114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:10:24 devstack sudo[104114]: pam_unix(sudo:session): session closed for user root Sep 17 22:10:24 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-6faa0ebe-7165-4f6e-b6e7-56b8ac3d0d87 tempest-CreateVolumesFromSnapshotTest-2038377790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f91ac926-6ead-4929-a5e2-88b7f0a7d2d9.36e63f19-9ca2-4337-ab5e-438012700b56" returned: 0 in 0.326s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:10:24 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-6faa0ebe-7165-4f6e-b6e7-56b8ac3d0d87 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f91ac926-6ead-4929-a5e2-88b7f0a7d2d9.36e63f19-9ca2-4337-ab5e-438012700b56 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:10:24 devstack sudo[104119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f91ac926-6ead-4929-a5e2-88b7f0a7d2d9.36e63f19-9ca2-4337-ab5e-438012700b56 Sep 17 22:10:24 devstack sudo[104119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:10:24 devstack sudo[104119]: pam_unix(sudo:session): session closed for user root Sep 17 22:10:24 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-6faa0ebe-7165-4f6e-b6e7-56b8ac3d0d87 tempest-CreateVolumesFromSnapshotTest-2038377790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f91ac926-6ead-4929-a5e2-88b7f0a7d2d9.36e63f19-9ca2-4337-ab5e-438012700b56" returned: 0 in 0.243s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:10:24 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-6faa0ebe-7165-4f6e-b6e7-56b8ac3d0d87 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Lock "cinder-quobyte-36e63f19-9ca2-4337-ab5e-438012700b56" released by "_delete_snapshot" :: held 1.362s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:10:24 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-6faa0ebe-7165-4f6e-b6e7-56b8ac3d0d87 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Lock "cinder-quobyte-f91ac926-6ead-4929-a5e2-88b7f0a7d2d9" released by "delete_snapshot" :: held 1.382s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:10:24 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-6faa0ebe-7165-4f6e-b6e7-56b8ac3d0d87 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Created reservations ['be3cf196-d446-4bb4-925b-2606ddc31df3', '95faba56-d18a-40e1-8796-4413d5c739bd', '24a362cb-4ca9-44d3-afde-0e01e5fa124f', 'a32132d3-2591-47c4-b47e-bfb450f64602'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:10:24 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-6faa0ebe-7165-4f6e-b6e7-56b8ac3d0d87 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Delete snapshot completed successfully. Sep 17 22:10:24 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-6faa0ebe-7165-4f6e-b6e7-56b8ac3d0d87 tempest-CreateVolumesFromSnapshotTest-2038377790 None] Lock "cinder-36e63f19-9ca2-4337-ab5e-438012700b56-delete_snapshot" released by "delete_snapshot" :: held 1.501s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:10:25 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-2ed56d7a-cd60-4f90-8717-edefdca71b7f tempest-CreateVolumesFromSnapshotTest-2038377790 None] Acquiring lock "cinder-f91ac926-6ead-4929-a5e2-88b7f0a7d2d9-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:10:25 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-2ed56d7a-cd60-4f90-8717-edefdca71b7f tempest-CreateVolumesFromSnapshotTest-2038377790 None] Lock "cinder-f91ac926-6ead-4929-a5e2-88b7f0a7d2d9-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:10:25 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-2ed56d7a-cd60-4f90-8717-edefdca71b7f tempest-CreateVolumesFromSnapshotTest-2038377790 None] Acquiring lock "cinder-quobyte-f91ac926-6ead-4929-a5e2-88b7f0a7d2d9" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:10:25 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-2ed56d7a-cd60-4f90-8717-edefdca71b7f tempest-CreateVolumesFromSnapshotTest-2038377790 None] Lock "cinder-quobyte-f91ac926-6ead-4929-a5e2-88b7f0a7d2d9" acquired by "delete_volume" :: waited 0.019s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:10:25 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[fedb00bc-2712-4a3b-9810-b269d35449ff]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:10:25 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-2ed56d7a-cd60-4f90-8717-edefdca71b7f tempest-CreateVolumesFromSnapshotTest-2038377790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f91ac926-6ead-4929-a5e2-88b7f0a7d2d9 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:10:25 devstack sudo[104160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f91ac926-6ead-4929-a5e2-88b7f0a7d2d9 Sep 17 22:10:25 devstack sudo[104160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:10:25 devstack sudo[104160]: pam_unix(sudo:session): session closed for user root Sep 17 22:10:25 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-2ed56d7a-cd60-4f90-8717-edefdca71b7f tempest-CreateVolumesFromSnapshotTest-2038377790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f91ac926-6ead-4929-a5e2-88b7f0a7d2d9" returned: 0 in 0.354s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:10:25 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-2ed56d7a-cd60-4f90-8717-edefdca71b7f tempest-CreateVolumesFromSnapshotTest-2038377790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f91ac926-6ead-4929-a5e2-88b7f0a7d2d9 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:10:25 devstack sudo[104165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f91ac926-6ead-4929-a5e2-88b7f0a7d2d9 Sep 17 22:10:25 devstack sudo[104165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:10:26 devstack sudo[104165]: pam_unix(sudo:session): session closed for user root Sep 17 22:10:26 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-2ed56d7a-cd60-4f90-8717-edefdca71b7f tempest-CreateVolumesFromSnapshotTest-2038377790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f91ac926-6ead-4929-a5e2-88b7f0a7d2d9" returned: 0 in 0.242s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:10:26 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-2ed56d7a-cd60-4f90-8717-edefdca71b7f tempest-CreateVolumesFromSnapshotTest-2038377790 None] Lock "cinder-quobyte-f91ac926-6ead-4929-a5e2-88b7f0a7d2d9" released by "delete_volume" :: held 0.657s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:10:26 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-2ed56d7a-cd60-4f90-8717-edefdca71b7f tempest-CreateVolumesFromSnapshotTest-2038377790 None] Created reservations ['2bbee330-a49f-4828-895b-f32a59117f82', 'ad2ef347-9d3e-4c98-a152-53c5317528a1', 'b9e379ed-7ddc-4b16-b4db-e5174b27742d', 'bdd65146-c9f2-467a-af8a-2d12f03d7c8e'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:10:26 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-2ed56d7a-cd60-4f90-8717-edefdca71b7f tempest-CreateVolumesFromSnapshotTest-2038377790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:10:26 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-2ed56d7a-cd60-4f90-8717-edefdca71b7f tempest-CreateVolumesFromSnapshotTest-2038377790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:10:26 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-2ed56d7a-cd60-4f90-8717-edefdca71b7f tempest-CreateVolumesFromSnapshotTest-2038377790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:10:26 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-2ed56d7a-cd60-4f90-8717-edefdca71b7f tempest-CreateVolumesFromSnapshotTest-2038377790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:10:26 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-2ed56d7a-cd60-4f90-8717-edefdca71b7f tempest-CreateVolumesFromSnapshotTest-2038377790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:10:26 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-2ed56d7a-cd60-4f90-8717-edefdca71b7f tempest-CreateVolumesFromSnapshotTest-2038377790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:10:26 devstack sudo[104168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:10:26 devstack sudo[104168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:10:26 devstack sudo[104168]: pam_unix(sudo:session): session closed for user root Sep 17 22:10:26 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-2ed56d7a-cd60-4f90-8717-edefdca71b7f tempest-CreateVolumesFromSnapshotTest-2038377790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.235s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:10:26 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-2ed56d7a-cd60-4f90-8717-edefdca71b7f tempest-CreateVolumesFromSnapshotTest-2038377790 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:10:26 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-2ed56d7a-cd60-4f90-8717-edefdca71b7f tempest-CreateVolumesFromSnapshotTest-2038377790 None] Deleted volume successfully. Sep 17 22:10:26 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-2ed56d7a-cd60-4f90-8717-edefdca71b7f tempest-CreateVolumesFromSnapshotTest-2038377790 None] Lock "cinder-f91ac926-6ead-4929-a5e2-88b7f0a7d2d9-delete_volume" released by "delete_volume" :: held 1.089s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:10:27 devstack cinder-volume[85458]: DEBUG oslo_service.periodic_task [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85458) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 22:10:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:10:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:10:27 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:10:27 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:10:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:10:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:10:27 devstack sudo[104171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:10:27 devstack sudo[104171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:10:28 devstack sudo[104171]: pam_unix(sudo:session): session closed for user root Sep 17 22:10:28 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.257s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:10:28 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:10:28 devstack cinder-volume[85458]: DEBUG oslo_service.periodic_task [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Running periodic task VolumeManager._thread_info {{(pid=85458) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 22:10:28 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] thread count: 28 {{(pid=85458) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 22:10:28 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] thread info: [<_MainThread(MainThread, started 127546830999680)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85458) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 22:10:31 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5c092d3-6f93-4141-b61f-758e2edbd4be tempest-VolumeImageDependencyTests-1650451482 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 22:10:31 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-a5c092d3-6f93-4141-b61f-758e2edbd4be tempest-VolumeImageDependencyTests-1650451482 None] Flow 'volume_create_manager' (5bc22aa6-5dd2-43e6-9b3a-7173d6cce76b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:10:31 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-a5c092d3-6f93-4141-b61f-758e2edbd4be tempest-VolumeImageDependencyTests-1650451482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea29f9d9-6968-4cdf-a451-04bcb7dedbbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:10:31 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-a5c092d3-6f93-4141-b61f-758e2edbd4be tempest-VolumeImageDependencyTests-1650451482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea29f9d9-6968-4cdf-a451-04bcb7dedbbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:10:31Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b52e431-33f1-486e-8f1a-3f17a97a6121,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac516eb2ef8a4fbba412263778846c15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:10:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:10:31Z,use_quota=True,user_id='16d526c3504249d49724c3bfbc51deaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:10:31 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-a5c092d3-6f93-4141-b61f-758e2edbd4be tempest-VolumeImageDependencyTests-1650451482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd9d285c-513e-45b6-811d-b6c15997199c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:10:31 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-a5c092d3-6f93-4141-b61f-758e2edbd4be tempest-VolumeImageDependencyTests-1650451482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd9d285c-513e-45b6-811d-b6c15997199c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:10:31 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-a5c092d3-6f93-4141-b61f-758e2edbd4be tempest-VolumeImageDependencyTests-1650451482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ab0bd5f-9fac-4bb8-bae9-f39fd83c2942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:10:31 devstack cinder-volume[85458]: DEBUG cinder.image.glance [None req-a5c092d3-6f93-4141-b61f-758e2edbd4be tempest-VolumeImageDependencyTests-1650451482 None] Creating Keystone auth plugin from conf {{(pid=85458) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 17 22:10:31 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-a5c092d3-6f93-4141-b61f-758e2edbd4be tempest-VolumeImageDependencyTests-1650451482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ab0bd5f-9fac-4bb8-bae9-f39fd83c2942) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3b52e431-33f1-486e-8f1a-3f17a97a6121', 'volume_name': 'volume-3b52e431-33f1-486e-8f1a-3f17a97a6121', 'volume_size': 1, 'image_id': '53f58517-f1f7-4710-b459-0fbc03fcabc5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/53f58517-f1f7-4710-b459-0fbc03fcabc5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a5e23f03f74873c9eccab1b433f18ade', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ac516eb2ef8a4fbba412263778846c15', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4a47617174c9ecae08f7874ab2cbfcf58d237054538bd15fe5a67273b1db1fef6a25512a9e4c321dd7d9dcb265625de0a8539028afd5b2c456261032c0448bdb', 'id': '53f58517-f1f7-4710-b459-0fbc03fcabc5', 'created_at': datetime.datetime(2026, 9, 17, 20, 10, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 20, 10, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/53f58517-f1f7-4710-b459-0fbc03fcabc5/file', 'properties': {}}, 'image_service': }' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:10:31 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-a5c092d3-6f93-4141-b61f-758e2edbd4be tempest-VolumeImageDependencyTests-1650451482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d56cf4f2-ea34-49ca-b33d-83ef37d3d517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:10:31 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-a5c092d3-6f93-4141-b61f-758e2edbd4be tempest-VolumeImageDependencyTests-1650451482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d56cf4f2-ea34-49ca-b33d-83ef37d3d517) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:10:31 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-a5c092d3-6f93-4141-b61f-758e2edbd4be tempest-VolumeImageDependencyTests-1650451482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94594eb0-b1b6-41fe-82d0-6c509c7c1efb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:10:31 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-a5c092d3-6f93-4141-b61f-758e2edbd4be tempest-VolumeImageDependencyTests-1650451482 None] Volume 3b52e431-33f1-486e-8f1a-3f17a97a6121: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3b52e431-33f1-486e-8f1a-3f17a97a6121', 'volume_size': 1, 'image_id': '53f58517-f1f7-4710-b459-0fbc03fcabc5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/53f58517-f1f7-4710-b459-0fbc03fcabc5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a5e23f03f74873c9eccab1b433f18ade', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ac516eb2ef8a4fbba412263778846c15', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4a47617174c9ecae08f7874ab2cbfcf58d237054538bd15fe5a67273b1db1fef6a25512a9e4c321dd7d9dcb265625de0a8539028afd5b2c456261032c0448bdb', 'id': '53f58517-f1f7-4710-b459-0fbc03fcabc5', 'created_at': datetime.datetime(2026, 9, 17, 20, 10, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 20, 10, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/53f58517-f1f7-4710-b459-0fbc03fcabc5/file', 'properties': {}}, 'image_service': } Sep 17 22:10:31 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5c092d3-6f93-4141-b61f-758e2edbd4be tempest-VolumeImageDependencyTests-1650451482 None] Trying to clone 3b52e431-33f1-486e-8f1a-3f17a97a6121 from image 53f58517-f1f7-4710-b459-0fbc03fcabc5 at location (None, [{'url': 'file:///opt/stack/data/glance/images/53f58517-f1f7-4710-b459-0fbc03fcabc5', 'metadata': {}}]). {{(pid=85458) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 17 22:10:31 devstack cinder-volume[85458]: DEBUG cinder.image.image_utils [None req-a5c092d3-6f93-4141-b61f-758e2edbd4be tempest-VolumeImageDependencyTests-1650451482 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_53f58517-f1f7-4710-b459-0fbc03fcabc5_10qofcfadevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=85458) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 17 22:10:31 devstack cinder-volume[85458]: INFO cinder.image.image_utils [None req-a5c092d3-6f93-4141-b61f-758e2edbd4be tempest-VolumeImageDependencyTests-1650451482 None] Image download 0.00 MB at 0.00 MB/s Sep 17 22:10:31 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[506b0355-70cc-4254-a724-cc64133c6ce2]: (4, 'raw') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:10:31 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a5c092d3-6f93-4141-b61f-758e2edbd4be tempest-VolumeImageDependencyTests-1650451482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_53f58517-f1f7-4710-b459-0fbc03fcabc5_10qofcfadevstack@QuobyteHD {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:10:31 devstack sudo[104185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_53f58517-f1f7-4710-b459-0fbc03fcabc5_10qofcfadevstack@QuobyteHD Sep 17 22:10:31 devstack sudo[104185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:10:32 devstack sudo[104185]: pam_unix(sudo:session): session closed for user root Sep 17 22:10:32 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a5c092d3-6f93-4141-b61f-758e2edbd4be tempest-VolumeImageDependencyTests-1650451482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_53f58517-f1f7-4710-b459-0fbc03fcabc5_10qofcfadevstack@QuobyteHD" returned: 0 in 0.322s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:10:32 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a5c092d3-6f93-4141-b61f-758e2edbd4be tempest-VolumeImageDependencyTests-1650451482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_53f58517-f1f7-4710-b459-0fbc03fcabc5_10qofcfadevstack@QuobyteHD {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:10:32 devstack sudo[104189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_53f58517-f1f7-4710-b459-0fbc03fcabc5_10qofcfadevstack@QuobyteHD Sep 17 22:10:32 devstack sudo[104189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:10:32 devstack sudo[104189]: pam_unix(sudo:session): session closed for user root Sep 17 22:10:32 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a5c092d3-6f93-4141-b61f-758e2edbd4be tempest-VolumeImageDependencyTests-1650451482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_53f58517-f1f7-4710-b459-0fbc03fcabc5_10qofcfadevstack@QuobyteHD" returned: 1 in 0.331s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:10:32 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a5c092d3-6f93-4141-b61f-758e2edbd4be tempest-VolumeImageDependencyTests-1650451482 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_53f58517-f1f7-4710-b459-0fbc03fcabc5_10qofcfadevstack@QuobyteHD' failed. Not Retrying. {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 22:10:32 devstack cinder-volume[85458]: DEBUG cinder.image.image_utils [None req-a5c092d3-6f93-4141-b61f-758e2edbd4be tempest-VolumeImageDependencyTests-1650451482 None] Temporary image 53f58517-f1f7-4710-b459-0fbc03fcabc5 is fetched for user 16d526c3504249d49724c3bfbc51deaa. {{(pid=85458) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 17 22:10:32 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bc612cb-e040-4592-b0d4-b7d5d1fce69f]: (4, 'raw') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:10:32 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a5c092d3-6f93-4141-b61f-758e2edbd4be tempest-VolumeImageDependencyTests-1650451482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_53f58517-f1f7-4710-b459-0fbc03fcabc5_10qofcfadevstack@QuobyteHD {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:10:32 devstack sudo[104194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_53f58517-f1f7-4710-b459-0fbc03fcabc5_10qofcfadevstack@QuobyteHD Sep 17 22:10:32 devstack sudo[104194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:10:32 devstack sudo[104194]: pam_unix(sudo:session): session closed for user root Sep 17 22:10:32 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a5c092d3-6f93-4141-b61f-758e2edbd4be tempest-VolumeImageDependencyTests-1650451482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_53f58517-f1f7-4710-b459-0fbc03fcabc5_10qofcfadevstack@QuobyteHD" returned: 0 in 0.324s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:10:32 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a5c092d3-6f93-4141-b61f-758e2edbd4be tempest-VolumeImageDependencyTests-1650451482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_53f58517-f1f7-4710-b459-0fbc03fcabc5_10qofcfadevstack@QuobyteHD {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:10:32 devstack sudo[104198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_53f58517-f1f7-4710-b459-0fbc03fcabc5_10qofcfadevstack@QuobyteHD Sep 17 22:10:32 devstack sudo[104198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:10:33 devstack sudo[104198]: pam_unix(sudo:session): session closed for user root Sep 17 22:10:33 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a5c092d3-6f93-4141-b61f-758e2edbd4be tempest-VolumeImageDependencyTests-1650451482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_53f58517-f1f7-4710-b459-0fbc03fcabc5_10qofcfadevstack@QuobyteHD" returned: 1 in 0.319s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:10:33 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a5c092d3-6f93-4141-b61f-758e2edbd4be tempest-VolumeImageDependencyTests-1650451482 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_53f58517-f1f7-4710-b459-0fbc03fcabc5_10qofcfadevstack@QuobyteHD' failed. Not Retrying. {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 22:10:33 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-a5c092d3-6f93-4141-b61f-758e2edbd4be tempest-VolumeImageDependencyTests-1650451482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:10:33 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-a5c092d3-6f93-4141-b61f-758e2edbd4be tempest-VolumeImageDependencyTests-1650451482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:10:33 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-a5c092d3-6f93-4141-b61f-758e2edbd4be tempest-VolumeImageDependencyTests-1650451482 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:10:31Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b52e431-33f1-486e-8f1a-3f17a97a6121,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac516eb2ef8a4fbba412263778846c15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:10:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:10:31Z,use_quota=True,user_id='16d526c3504249d49724c3bfbc51deaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 22:10:33 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-a5c092d3-6f93-4141-b61f-758e2edbd4be tempest-VolumeImageDependencyTests-1650451482 None] Creating volume 3b52e431-33f1-486e-8f1a-3f17a97a6121 {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 22:10:33 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-a5c092d3-6f93-4141-b61f-758e2edbd4be tempest-VolumeImageDependencyTests-1650451482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:10:33 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-a5c092d3-6f93-4141-b61f-758e2edbd4be tempest-VolumeImageDependencyTests-1650451482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:10:33 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-a5c092d3-6f93-4141-b61f-758e2edbd4be tempest-VolumeImageDependencyTests-1650451482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:10:33 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-a5c092d3-6f93-4141-b61f-758e2edbd4be tempest-VolumeImageDependencyTests-1650451482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:10:33 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-a5c092d3-6f93-4141-b61f-758e2edbd4be tempest-VolumeImageDependencyTests-1650451482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:10:33 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-a5c092d3-6f93-4141-b61f-758e2edbd4be tempest-VolumeImageDependencyTests-1650451482 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 22:10:33 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-a5c092d3-6f93-4141-b61f-758e2edbd4be tempest-VolumeImageDependencyTests-1650451482 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 22:10:33 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a5c092d3-6f93-4141-b61f-758e2edbd4be tempest-VolumeImageDependencyTests-1650451482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-3b52e431-33f1-486e-8f1a-3f17a97a6121 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:10:33 devstack sudo[104203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-3b52e431-33f1-486e-8f1a-3f17a97a6121 1073741824 Sep 17 22:10:33 devstack sudo[104203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:10:33 devstack sudo[104203]: pam_unix(sudo:session): session closed for user root Sep 17 22:10:33 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a5c092d3-6f93-4141-b61f-758e2edbd4be tempest-VolumeImageDependencyTests-1650451482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-3b52e431-33f1-486e-8f1a-3f17a97a6121 1073741824" returned: 0 in 0.410s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:10:33 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a5c092d3-6f93-4141-b61f-758e2edbd4be tempest-VolumeImageDependencyTests-1650451482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-3b52e431-33f1-486e-8f1a-3f17a97a6121 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:10:33 devstack sudo[104208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-3b52e431-33f1-486e-8f1a-3f17a97a6121 Sep 17 22:10:33 devstack sudo[104208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:10:33 devstack sudo[104208]: pam_unix(sudo:session): session closed for user root Sep 17 22:10:33 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a5c092d3-6f93-4141-b61f-758e2edbd4be tempest-VolumeImageDependencyTests-1650451482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-3b52e431-33f1-486e-8f1a-3f17a97a6121" returned: 0 in 0.246s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:10:33 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-a5c092d3-6f93-4141-b61f-758e2edbd4be tempest-VolumeImageDependencyTests-1650451482 None] <== create_volume: return (697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 22:10:33 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-a5c092d3-6f93-4141-b61f-758e2edbd4be tempest-VolumeImageDependencyTests-1650451482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.700s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:10:33 devstack cinder-volume[85458]: DEBUG cinder.volume.volume_utils [None req-a5c092d3-6f93-4141-b61f-758e2edbd4be tempest-VolumeImageDependencyTests-1650451482 None] Attempting download of 53f58517-f1f7-4710-b459-0fbc03fcabc5 ((None, [{'url': 'file:///opt/stack/data/glance/images/53f58517-f1f7-4710-b459-0fbc03fcabc5', 'metadata': {}}])) to volume 3b52e431-33f1-486e-8f1a-3f17a97a6121. {{(pid=85458) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 17 22:10:33 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b2feb10-fedb-40cf-a2c3-f2fbf3fe2413]: (4, 'raw') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:10:33 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a5c092d3-6f93-4141-b61f-758e2edbd4be tempest-VolumeImageDependencyTests-1650451482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_53f58517-f1f7-4710-b459-0fbc03fcabc5_hzwpra4u {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:10:34 devstack sudo[104211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_53f58517-f1f7-4710-b459-0fbc03fcabc5_hzwpra4u Sep 17 22:10:34 devstack sudo[104211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:10:34 devstack sudo[104211]: pam_unix(sudo:session): session closed for user root Sep 17 22:10:34 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a5c092d3-6f93-4141-b61f-758e2edbd4be tempest-VolumeImageDependencyTests-1650451482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_53f58517-f1f7-4710-b459-0fbc03fcabc5_hzwpra4u" returned: 0 in 0.339s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:10:34 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a5c092d3-6f93-4141-b61f-758e2edbd4be tempest-VolumeImageDependencyTests-1650451482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_53f58517-f1f7-4710-b459-0fbc03fcabc5_hzwpra4u {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:10:34 devstack sudo[104215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_53f58517-f1f7-4710-b459-0fbc03fcabc5_hzwpra4u Sep 17 22:10:34 devstack sudo[104215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:10:34 devstack sudo[104215]: pam_unix(sudo:session): session closed for user root Sep 17 22:10:34 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a5c092d3-6f93-4141-b61f-758e2edbd4be tempest-VolumeImageDependencyTests-1650451482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_53f58517-f1f7-4710-b459-0fbc03fcabc5_hzwpra4u" returned: 1 in 0.329s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:10:34 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a5c092d3-6f93-4141-b61f-758e2edbd4be tempest-VolumeImageDependencyTests-1650451482 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_53f58517-f1f7-4710-b459-0fbc03fcabc5_hzwpra4u' failed. Not Retrying. {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 22:10:34 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[cde21c5d-665c-409c-9fa3-179122a39f03]: (4, 'raw') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:10:34 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a5c092d3-6f93-4141-b61f-758e2edbd4be tempest-VolumeImageDependencyTests-1650451482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_53f58517-f1f7-4710-b459-0fbc03fcabc5_10qofcfadevstack@QuobyteHD {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:10:34 devstack sudo[104219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_53f58517-f1f7-4710-b459-0fbc03fcabc5_10qofcfadevstack@QuobyteHD Sep 17 22:10:34 devstack sudo[104219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:10:34 devstack sudo[104219]: pam_unix(sudo:session): session closed for user root Sep 17 22:10:34 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a5c092d3-6f93-4141-b61f-758e2edbd4be tempest-VolumeImageDependencyTests-1650451482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_53f58517-f1f7-4710-b459-0fbc03fcabc5_10qofcfadevstack@QuobyteHD" returned: 0 in 0.333s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:10:34 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a5c092d3-6f93-4141-b61f-758e2edbd4be tempest-VolumeImageDependencyTests-1650451482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_53f58517-f1f7-4710-b459-0fbc03fcabc5_10qofcfadevstack@QuobyteHD {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:10:35 devstack sudo[104223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_53f58517-f1f7-4710-b459-0fbc03fcabc5_10qofcfadevstack@QuobyteHD Sep 17 22:10:35 devstack sudo[104223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:10:35 devstack sudo[104223]: pam_unix(sudo:session): session closed for user root Sep 17 22:10:35 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a5c092d3-6f93-4141-b61f-758e2edbd4be tempest-VolumeImageDependencyTests-1650451482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_53f58517-f1f7-4710-b459-0fbc03fcabc5_10qofcfadevstack@QuobyteHD" returned: 1 in 0.329s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:10:35 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a5c092d3-6f93-4141-b61f-758e2edbd4be tempest-VolumeImageDependencyTests-1650451482 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_53f58517-f1f7-4710-b459-0fbc03fcabc5_10qofcfadevstack@QuobyteHD' failed. Not Retrying. {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 22:10:35 devstack cinder-volume[85458]: DEBUG cinder.image.image_utils [None req-a5c092d3-6f93-4141-b61f-758e2edbd4be tempest-VolumeImageDependencyTests-1650451482 None] 53f58517-f1f7-4710-b459-0fbc03fcabc5 was raw, converting to qcow2 {{(pid=85458) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 17 22:10:35 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a5c092d3-6f93-4141-b61f-758e2edbd4be tempest-VolumeImageDependencyTests-1650451482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_53f58517-f1f7-4710-b459-0fbc03fcabc5_10qofcfadevstack@QuobyteHD /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-3b52e431-33f1-486e-8f1a-3f17a97a6121 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:10:35 devstack sudo[104228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_53f58517-f1f7-4710-b459-0fbc03fcabc5_10qofcfadevstack@QuobyteHD /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-3b52e431-33f1-486e-8f1a-3f17a97a6121 Sep 17 22:10:35 devstack sudo[104228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:10:35 devstack sudo[104228]: pam_unix(sudo:session): session closed for user root Sep 17 22:10:35 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a5c092d3-6f93-4141-b61f-758e2edbd4be tempest-VolumeImageDependencyTests-1650451482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_53f58517-f1f7-4710-b459-0fbc03fcabc5_10qofcfadevstack@QuobyteHD /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-3b52e431-33f1-486e-8f1a-3f17a97a6121" returned: 0 in 0.446s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:10:35 devstack cinder-volume[85458]: DEBUG cinder.image.image_utils [None req-a5c092d3-6f93-4141-b61f-758e2edbd4be tempest-VolumeImageDependencyTests-1650451482 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_53f58517-f1f7-4710-b459-0fbc03fcabc5_10qofcfadevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-3b52e431-33f1-486e-8f1a-3f17a97a6121 {{(pid=85458) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 17 22:10:35 devstack cinder-volume[85458]: INFO cinder.image.image_utils [None req-a5c092d3-6f93-4141-b61f-758e2edbd4be tempest-VolumeImageDependencyTests-1650451482 None] Converted 0.00 MB image at 0.00 MB/s Sep 17 22:10:35 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a5c092d3-6f93-4141-b61f-758e2edbd4be tempest-VolumeImageDependencyTests-1650451482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-3b52e431-33f1-486e-8f1a-3f17a97a6121 1G {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:10:35 devstack sudo[104233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-3b52e431-33f1-486e-8f1a-3f17a97a6121 1G Sep 17 22:10:35 devstack sudo[104233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:10:36 devstack sudo[104233]: pam_unix(sudo:session): session closed for user root Sep 17 22:10:36 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a5c092d3-6f93-4141-b61f-758e2edbd4be tempest-VolumeImageDependencyTests-1650451482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-3b52e431-33f1-486e-8f1a-3f17a97a6121 1G" returned: 0 in 0.310s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:10:36 devstack cinder-volume[85458]: DEBUG cinder.volume.volume_utils [None req-a5c092d3-6f93-4141-b61f-758e2edbd4be tempest-VolumeImageDependencyTests-1650451482 None] Downloaded image 53f58517-f1f7-4710-b459-0fbc03fcabc5 ((None, [{'url': 'file:///opt/stack/data/glance/images/53f58517-f1f7-4710-b459-0fbc03fcabc5', 'metadata': {}}])) to volume 3b52e431-33f1-486e-8f1a-3f17a97a6121 successfully. {{(pid=85458) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 17 22:10:36 devstack cinder-volume[85458]: DEBUG cinder.image.image_utils [None req-a5c092d3-6f93-4141-b61f-758e2edbd4be tempest-VolumeImageDependencyTests-1650451482 None] Temporary image 53f58517-f1f7-4710-b459-0fbc03fcabc5 for user 16d526c3504249d49724c3bfbc51deaa is deleted. {{(pid=85458) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 17 22:10:36 devstack cinder-volume[85458]: DEBUG cinder.volume.volume_utils [None req-a5c092d3-6f93-4141-b61f-758e2edbd4be tempest-VolumeImageDependencyTests-1650451482 None] Marking volume 3b52e431-33f1-486e-8f1a-3f17a97a6121 as bootable. {{(pid=85458) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 17 22:10:36 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5c092d3-6f93-4141-b61f-758e2edbd4be tempest-VolumeImageDependencyTests-1650451482 None] Copying metadata from image 53f58517-f1f7-4710-b459-0fbc03fcabc5 to 3b52e431-33f1-486e-8f1a-3f17a97a6121. {{(pid=85458) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 17 22:10:36 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5c092d3-6f93-4141-b61f-758e2edbd4be tempest-VolumeImageDependencyTests-1650451482 None] Creating volume glance metadata for volume 3b52e431-33f1-486e-8f1a-3f17a97a6121 backed by image 53f58517-f1f7-4710-b459-0fbc03fcabc5 with: {'image_id': '53f58517-f1f7-4710-b459-0fbc03fcabc5', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'a5e23f03f74873c9eccab1b433f18ade', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=85458) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 17 22:10:36 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-a5c092d3-6f93-4141-b61f-758e2edbd4be tempest-VolumeImageDependencyTests-1650451482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94594eb0-b1b6-41fe-82d0-6c509c7c1efb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b52e431-33f1-486e-8f1a-3f17a97a6121', 'volume_size': 1, 'image_id': '53f58517-f1f7-4710-b459-0fbc03fcabc5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/53f58517-f1f7-4710-b459-0fbc03fcabc5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a5e23f03f74873c9eccab1b433f18ade', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ac516eb2ef8a4fbba412263778846c15', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4a47617174c9ecae08f7874ab2cbfcf58d237054538bd15fe5a67273b1db1fef6a25512a9e4c321dd7d9dcb265625de0a8539028afd5b2c456261032c0448bdb', 'id': '53f58517-f1f7-4710-b459-0fbc03fcabc5', 'created_at': datetime.datetime(2026, 9, 17, 20, 10, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 20, 10, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/53f58517-f1f7-4710-b459-0fbc03fcabc5/file', 'properties': {}}, 'image_service': }' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:10:36 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-a5c092d3-6f93-4141-b61f-758e2edbd4be tempest-VolumeImageDependencyTests-1650451482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9ca3290-3592-403f-b05a-65eab97f35f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:10:36 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-a5c092d3-6f93-4141-b61f-758e2edbd4be tempest-VolumeImageDependencyTests-1650451482 None] Volume volume-3b52e431-33f1-486e-8f1a-3f17a97a6121 (3b52e431-33f1-486e-8f1a-3f17a97a6121): created successfully Sep 17 22:10:36 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-a5c092d3-6f93-4141-b61f-758e2edbd4be tempest-VolumeImageDependencyTests-1650451482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9ca3290-3592-403f-b05a-65eab97f35f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:10:36 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-a5c092d3-6f93-4141-b61f-758e2edbd4be tempest-VolumeImageDependencyTests-1650451482 None] Flow 'volume_create_manager' (5bc22aa6-5dd2-43e6-9b3a-7173d6cce76b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:10:36 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-a5c092d3-6f93-4141-b61f-758e2edbd4be tempest-VolumeImageDependencyTests-1650451482 None] Created volume successfully. Sep 17 22:10:36 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-18c06047-4400-490c-9e22-03b22011f8ac tempest-VolumeImageDependencyTests-1650451482 None] Acquiring lock "cinder-3b52e431-33f1-486e-8f1a-3f17a97a6121-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:10:36 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-18c06047-4400-490c-9e22-03b22011f8ac tempest-VolumeImageDependencyTests-1650451482 None] Lock "cinder-3b52e431-33f1-486e-8f1a-3f17a97a6121-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:10:36 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-18c06047-4400-490c-9e22-03b22011f8ac tempest-VolumeImageDependencyTests-1650451482 None] Acquiring lock "cinder-quobyte-3b52e431-33f1-486e-8f1a-3f17a97a6121" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:10:36 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-18c06047-4400-490c-9e22-03b22011f8ac tempest-VolumeImageDependencyTests-1650451482 None] Lock "cinder-quobyte-3b52e431-33f1-486e-8f1a-3f17a97a6121" acquired by "delete_volume" :: waited 0.015s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:10:36 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d5b550f-fa18-4113-92c0-2d42a9b8daf5]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:10:36 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-18c06047-4400-490c-9e22-03b22011f8ac tempest-VolumeImageDependencyTests-1650451482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-3b52e431-33f1-486e-8f1a-3f17a97a6121 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:10:36 devstack sudo[104238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-3b52e431-33f1-486e-8f1a-3f17a97a6121 Sep 17 22:10:36 devstack sudo[104238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:10:37 devstack sudo[104238]: pam_unix(sudo:session): session closed for user root Sep 17 22:10:37 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-18c06047-4400-490c-9e22-03b22011f8ac tempest-VolumeImageDependencyTests-1650451482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-3b52e431-33f1-486e-8f1a-3f17a97a6121" returned: 0 in 0.365s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:10:37 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-18c06047-4400-490c-9e22-03b22011f8ac tempest-VolumeImageDependencyTests-1650451482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-3b52e431-33f1-486e-8f1a-3f17a97a6121 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:10:37 devstack sudo[104243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-3b52e431-33f1-486e-8f1a-3f17a97a6121 Sep 17 22:10:37 devstack sudo[104243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:10:37 devstack sudo[104243]: pam_unix(sudo:session): session closed for user root Sep 17 22:10:37 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-18c06047-4400-490c-9e22-03b22011f8ac tempest-VolumeImageDependencyTests-1650451482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-3b52e431-33f1-486e-8f1a-3f17a97a6121" returned: 0 in 0.250s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:10:37 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-18c06047-4400-490c-9e22-03b22011f8ac tempest-VolumeImageDependencyTests-1650451482 None] Lock "cinder-quobyte-3b52e431-33f1-486e-8f1a-3f17a97a6121" released by "delete_volume" :: held 0.656s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:10:37 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-18c06047-4400-490c-9e22-03b22011f8ac tempest-VolumeImageDependencyTests-1650451482 None] Created reservations ['882fa431-1cc2-41fa-8798-12890d5de13a', '6d9ea890-6959-4865-bc56-21c4896a4751', 'eaf90407-02e3-4123-bc15-e0924e336502', '98ccf5bd-aa38-4033-bdeb-86ddcb42bc59'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:10:37 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-18c06047-4400-490c-9e22-03b22011f8ac tempest-VolumeImageDependencyTests-1650451482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:10:37 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-18c06047-4400-490c-9e22-03b22011f8ac tempest-VolumeImageDependencyTests-1650451482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:10:37 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-18c06047-4400-490c-9e22-03b22011f8ac tempest-VolumeImageDependencyTests-1650451482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:10:37 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-18c06047-4400-490c-9e22-03b22011f8ac tempest-VolumeImageDependencyTests-1650451482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:10:37 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-18c06047-4400-490c-9e22-03b22011f8ac tempest-VolumeImageDependencyTests-1650451482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:10:37 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-18c06047-4400-490c-9e22-03b22011f8ac tempest-VolumeImageDependencyTests-1650451482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:10:37 devstack sudo[104246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:10:37 devstack sudo[104246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:10:37 devstack sudo[104246]: pam_unix(sudo:session): session closed for user root Sep 17 22:10:37 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-18c06047-4400-490c-9e22-03b22011f8ac tempest-VolumeImageDependencyTests-1650451482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.256s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:10:37 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-18c06047-4400-490c-9e22-03b22011f8ac tempest-VolumeImageDependencyTests-1650451482 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:10:37 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-18c06047-4400-490c-9e22-03b22011f8ac tempest-VolumeImageDependencyTests-1650451482 None] Deleted volume successfully. Sep 17 22:10:37 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-18c06047-4400-490c-9e22-03b22011f8ac tempest-VolumeImageDependencyTests-1650451482 None] Lock "cinder-3b52e431-33f1-486e-8f1a-3f17a97a6121-delete_volume" released by "delete_volume" :: held 1.110s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:10:47 devstack cinder-volume[85458]: DEBUG dbcounter [-] [85458] Writing DB stats cinder:SELECT=99,cinder:UPDATE=147,cinder:INSERT=37,cinder:DELETE=11 {{(pid=85458) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 22:10:47 devstack cinder-volume[85458]: DEBUG dbcounter [-] [85458] Writing DB stats cinder:SELECT=99,cinder:UPDATE=135,cinder:DELETE=14,cinder:INSERT=37 {{(pid=85458) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 22:10:58 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-e69fd4ac-800f-40ab-aba3-e6d4f312c0f3 tempest-CinderUnicodeTest-502091172 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 22:10:58 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e69fd4ac-800f-40ab-aba3-e6d4f312c0f3 tempest-CinderUnicodeTest-502091172 None] Flow 'volume_create_manager' (decb3797-4ba5-4fe9-bc7b-e216bb0c6e68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:10:58 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e69fd4ac-800f-40ab-aba3-e6d4f312c0f3 tempest-CinderUnicodeTest-502091172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ad99411-e696-4d30-8b40-3181b14bff82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:10:58 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e69fd4ac-800f-40ab-aba3-e6d4f312c0f3 tempest-CinderUnicodeTest-502091172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ad99411-e696-4d30-8b40-3181b14bff82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:10:58Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5ae6aee-99d6-4c2f-93ad-912092b1392a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea6e6be09d7e4895b55b3e3292f9a3fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:10:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:10:59Z,use_quota=True,user_id='a598a48bfa664848a24ec024754af276',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:10:58 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e69fd4ac-800f-40ab-aba3-e6d4f312c0f3 tempest-CinderUnicodeTest-502091172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fabb3488-b97b-4b1e-b8c2-8b17b720a804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:10:58 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e69fd4ac-800f-40ab-aba3-e6d4f312c0f3 tempest-CinderUnicodeTest-502091172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fabb3488-b97b-4b1e-b8c2-8b17b720a804) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:10:58 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e69fd4ac-800f-40ab-aba3-e6d4f312c0f3 tempest-CinderUnicodeTest-502091172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf9663bd-c2cb-4a65-afd6-84fb2f249dd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:10:58 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e69fd4ac-800f-40ab-aba3-e6d4f312c0f3 tempest-CinderUnicodeTest-502091172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf9663bd-c2cb-4a65-afd6-84fb2f249dd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5ae6aee-99d6-4c2f-93ad-912092b1392a', 'volume_name': 'volume-c5ae6aee-99d6-4c2f-93ad-912092b1392a', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:10:58 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e69fd4ac-800f-40ab-aba3-e6d4f312c0f3 tempest-CinderUnicodeTest-502091172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f764151e-8f2f-45ca-95cd-681ad42ef994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:10:58 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e69fd4ac-800f-40ab-aba3-e6d4f312c0f3 tempest-CinderUnicodeTest-502091172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f764151e-8f2f-45ca-95cd-681ad42ef994) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:10:58 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e69fd4ac-800f-40ab-aba3-e6d4f312c0f3 tempest-CinderUnicodeTest-502091172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78b2c94e-752c-4afb-bbec-7cf46650f800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:10:58 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-e69fd4ac-800f-40ab-aba3-e6d4f312c0f3 tempest-CinderUnicodeTest-502091172 None] Volume c5ae6aee-99d6-4c2f-93ad-912092b1392a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5ae6aee-99d6-4c2f-93ad-912092b1392a', 'volume_size': 1} Sep 17 22:10:58 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e69fd4ac-800f-40ab-aba3-e6d4f312c0f3 tempest-CinderUnicodeTest-502091172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:10:58 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e69fd4ac-800f-40ab-aba3-e6d4f312c0f3 tempest-CinderUnicodeTest-502091172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:10:58 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-e69fd4ac-800f-40ab-aba3-e6d4f312c0f3 tempest-CinderUnicodeTest-502091172 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:10:58Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5ae6aee-99d6-4c2f-93ad-912092b1392a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea6e6be09d7e4895b55b3e3292f9a3fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:10:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:10:59Z,use_quota=True,user_id='a598a48bfa664848a24ec024754af276',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 22:10:58 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-e69fd4ac-800f-40ab-aba3-e6d4f312c0f3 tempest-CinderUnicodeTest-502091172 None] Creating volume c5ae6aee-99d6-4c2f-93ad-912092b1392a {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 22:10:58 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e69fd4ac-800f-40ab-aba3-e6d4f312c0f3 tempest-CinderUnicodeTest-502091172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:10:58 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e69fd4ac-800f-40ab-aba3-e6d4f312c0f3 tempest-CinderUnicodeTest-502091172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:10:58 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-e69fd4ac-800f-40ab-aba3-e6d4f312c0f3 tempest-CinderUnicodeTest-502091172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:10:58 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-e69fd4ac-800f-40ab-aba3-e6d4f312c0f3 tempest-CinderUnicodeTest-502091172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:10:58 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e69fd4ac-800f-40ab-aba3-e6d4f312c0f3 tempest-CinderUnicodeTest-502091172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:10:58 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-e69fd4ac-800f-40ab-aba3-e6d4f312c0f3 tempest-CinderUnicodeTest-502091172 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 22:10:58 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-e69fd4ac-800f-40ab-aba3-e6d4f312c0f3 tempest-CinderUnicodeTest-502091172 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 22:10:58 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e69fd4ac-800f-40ab-aba3-e6d4f312c0f3 tempest-CinderUnicodeTest-502091172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c5ae6aee-99d6-4c2f-93ad-912092b1392a 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:10:58 devstack sudo[104290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c5ae6aee-99d6-4c2f-93ad-912092b1392a 1073741824 Sep 17 22:10:58 devstack sudo[104290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:10:59 devstack sudo[104290]: pam_unix(sudo:session): session closed for user root Sep 17 22:10:59 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e69fd4ac-800f-40ab-aba3-e6d4f312c0f3 tempest-CinderUnicodeTest-502091172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c5ae6aee-99d6-4c2f-93ad-912092b1392a 1073741824" returned: 0 in 0.583s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:10:59 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e69fd4ac-800f-40ab-aba3-e6d4f312c0f3 tempest-CinderUnicodeTest-502091172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c5ae6aee-99d6-4c2f-93ad-912092b1392a {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:10:59 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d44c62d-4f7d-4863-bcb2-3dbeced202b0 tempest-CreateVolumesFromImageTest-467947785 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 22:10:59 devstack sudo[104296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c5ae6aee-99d6-4c2f-93ad-912092b1392a Sep 17 22:10:59 devstack sudo[104296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:10:59 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-1d44c62d-4f7d-4863-bcb2-3dbeced202b0 tempest-CreateVolumesFromImageTest-467947785 None] Flow 'volume_create_manager' (ef81db86-5f0c-437c-9940-fcac36373db6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:10:59 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-1d44c62d-4f7d-4863-bcb2-3dbeced202b0 tempest-CreateVolumesFromImageTest-467947785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c38e733-7176-4592-99e5-25498e638129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:10:59 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-1d44c62d-4f7d-4863-bcb2-3dbeced202b0 tempest-CreateVolumesFromImageTest-467947785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c38e733-7176-4592-99e5-25498e638129) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:10:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-163291739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d222051-d10c-47d4-9587-d77a319c7961,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cf4575c8c3d44aa9d83ab02572a28be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:10:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:10:59Z,use_quota=True,user_id='4a1d89cac38c49068cce7ca25ba7f2b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:10:59 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-1d44c62d-4f7d-4863-bcb2-3dbeced202b0 tempest-CreateVolumesFromImageTest-467947785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4039841f-c80e-4b07-a82e-850695a798eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:10:59 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-1d44c62d-4f7d-4863-bcb2-3dbeced202b0 tempest-CreateVolumesFromImageTest-467947785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4039841f-c80e-4b07-a82e-850695a798eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:10:59 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-1d44c62d-4f7d-4863-bcb2-3dbeced202b0 tempest-CreateVolumesFromImageTest-467947785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17e6fe6f-df03-4f8e-8754-d5fbf896d70e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:10:59 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-1d44c62d-4f7d-4863-bcb2-3dbeced202b0 tempest-CreateVolumesFromImageTest-467947785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17e6fe6f-df03-4f8e-8754-d5fbf896d70e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d222051-d10c-47d4-9587-d77a319c7961', 'volume_name': 'volume-8d222051-d10c-47d4-9587-d77a319c7961', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:10:59 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-1d44c62d-4f7d-4863-bcb2-3dbeced202b0 tempest-CreateVolumesFromImageTest-467947785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e7b5076-2d8d-41f8-a094-568c5d51c6c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:10:59 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-1d44c62d-4f7d-4863-bcb2-3dbeced202b0 tempest-CreateVolumesFromImageTest-467947785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e7b5076-2d8d-41f8-a094-568c5d51c6c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:10:59 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-1d44c62d-4f7d-4863-bcb2-3dbeced202b0 tempest-CreateVolumesFromImageTest-467947785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7740457b-c9cb-426b-8f0f-69319aaf3e6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:10:59 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-1d44c62d-4f7d-4863-bcb2-3dbeced202b0 tempest-CreateVolumesFromImageTest-467947785 None] Volume 8d222051-d10c-47d4-9587-d77a319c7961: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d222051-d10c-47d4-9587-d77a319c7961', 'volume_size': 1} Sep 17 22:10:59 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-1d44c62d-4f7d-4863-bcb2-3dbeced202b0 tempest-CreateVolumesFromImageTest-467947785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:10:59 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1fd609b-0b04-47af-9cf3-da71e9f67868 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 22:10:59 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b1fd609b-0b04-47af-9cf3-da71e9f67868 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Flow 'volume_create_manager' (2aab614d-20fb-4f58-ad53-50df1e153492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:10:59 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b1fd609b-0b04-47af-9cf3-da71e9f67868 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80c3da60-42bb-44fe-a7f4-a92db495cee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:10:59 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b1fd609b-0b04-47af-9cf3-da71e9f67868 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80c3da60-42bb-44fe-a7f4-a92db495cee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:10:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1052103718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcbdc049-4cbd-41f1-9210-4d1a1e60ef86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fca2e5554f39458694ef19aa1c2e0a3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:10:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:10:59Z,use_quota=True,user_id='9e3bf776ed4441c883eabadfac361819',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:10:59 devstack sudo[104296]: pam_unix(sudo:session): session closed for user root Sep 17 22:10:59 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b1fd609b-0b04-47af-9cf3-da71e9f67868 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (429beaeb-2c77-4014-b504-67722e6a3ee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:10:59 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b1fd609b-0b04-47af-9cf3-da71e9f67868 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (429beaeb-2c77-4014-b504-67722e6a3ee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:10:59 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b1fd609b-0b04-47af-9cf3-da71e9f67868 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9c5215d-31ee-43c3-9ece-4647bef431dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:10:59 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b1fd609b-0b04-47af-9cf3-da71e9f67868 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9c5215d-31ee-43c3-9ece-4647bef431dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fcbdc049-4cbd-41f1-9210-4d1a1e60ef86', 'volume_name': 'volume-fcbdc049-4cbd-41f1-9210-4d1a1e60ef86', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:10:59 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b1fd609b-0b04-47af-9cf3-da71e9f67868 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad41b435-e685-46a9-9e71-bd69b695d5ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:10:59 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b1fd609b-0b04-47af-9cf3-da71e9f67868 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad41b435-e685-46a9-9e71-bd69b695d5ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:10:59 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b1fd609b-0b04-47af-9cf3-da71e9f67868 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (420e6e09-8eb1-42a4-8a6d-59552208d5a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:10:59 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-b1fd609b-0b04-47af-9cf3-da71e9f67868 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Volume fcbdc049-4cbd-41f1-9210-4d1a1e60ef86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fcbdc049-4cbd-41f1-9210-4d1a1e60ef86', 'volume_size': 1} Sep 17 22:10:59 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-b1fd609b-0b04-47af-9cf3-da71e9f67868 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:10:59 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e69fd4ac-800f-40ab-aba3-e6d4f312c0f3 tempest-CinderUnicodeTest-502091172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c5ae6aee-99d6-4c2f-93ad-912092b1392a" returned: 0 in 0.400s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:10:59 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-e69fd4ac-800f-40ab-aba3-e6d4f312c0f3 tempest-CinderUnicodeTest-502091172 None] <== create_volume: return (1058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 22:10:59 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e69fd4ac-800f-40ab-aba3-e6d4f312c0f3 tempest-CinderUnicodeTest-502091172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.061s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:10:59 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-1d44c62d-4f7d-4863-bcb2-3dbeced202b0 tempest-CreateVolumesFromImageTest-467947785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.258s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:10:59 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-1d44c62d-4f7d-4863-bcb2-3dbeced202b0 tempest-CreateVolumesFromImageTest-467947785 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:10:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-163291739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d222051-d10c-47d4-9587-d77a319c7961,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cf4575c8c3d44aa9d83ab02572a28be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:10:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:10:59Z,use_quota=True,user_id='4a1d89cac38c49068cce7ca25ba7f2b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 22:10:59 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-1d44c62d-4f7d-4863-bcb2-3dbeced202b0 tempest-CreateVolumesFromImageTest-467947785 None] Creating volume 8d222051-d10c-47d4-9587-d77a319c7961 {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 22:10:59 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-1d44c62d-4f7d-4863-bcb2-3dbeced202b0 tempest-CreateVolumesFromImageTest-467947785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:10:59 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-1d44c62d-4f7d-4863-bcb2-3dbeced202b0 tempest-CreateVolumesFromImageTest-467947785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:10:59 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-1d44c62d-4f7d-4863-bcb2-3dbeced202b0 tempest-CreateVolumesFromImageTest-467947785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:10:59 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-1d44c62d-4f7d-4863-bcb2-3dbeced202b0 tempest-CreateVolumesFromImageTest-467947785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:10:59 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-1d44c62d-4f7d-4863-bcb2-3dbeced202b0 tempest-CreateVolumesFromImageTest-467947785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:10:59 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-1d44c62d-4f7d-4863-bcb2-3dbeced202b0 tempest-CreateVolumesFromImageTest-467947785 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 22:10:59 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-1d44c62d-4f7d-4863-bcb2-3dbeced202b0 tempest-CreateVolumesFromImageTest-467947785 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 22:10:59 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-1d44c62d-4f7d-4863-bcb2-3dbeced202b0 tempest-CreateVolumesFromImageTest-467947785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8d222051-d10c-47d4-9587-d77a319c7961 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:10:59 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-1baad46e-2e71-477e-98f6-c18befb5c9a9 tempest-CreateVolumesFromImageTest-467947785 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 22:10:59 devstack sudo[104300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8d222051-d10c-47d4-9587-d77a319c7961 1073741824 Sep 17 22:10:59 devstack sudo[104300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:10:59 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-1baad46e-2e71-477e-98f6-c18befb5c9a9 tempest-CreateVolumesFromImageTest-467947785 None] Flow 'volume_create_manager' (244c592b-ec96-4708-a59a-3f38722363e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:10:59 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-1baad46e-2e71-477e-98f6-c18befb5c9a9 tempest-CreateVolumesFromImageTest-467947785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8aa61ad7-cdac-4fc3-8477-688b13018c70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:10:59 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e69fd4ac-800f-40ab-aba3-e6d4f312c0f3 tempest-CinderUnicodeTest-502091172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78b2c94e-752c-4afb-bbec-7cf46650f800) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5ae6aee-99d6-4c2f-93ad-912092b1392a', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:10:59 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e69fd4ac-800f-40ab-aba3-e6d4f312c0f3 tempest-CinderUnicodeTest-502091172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06e18e91-b1fb-478d-981e-2e2dfc4c5f95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:10:59 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-1baad46e-2e71-477e-98f6-c18befb5c9a9 tempest-CreateVolumesFromImageTest-467947785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8aa61ad7-cdac-4fc3-8477-688b13018c70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:10:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-843830903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c50c2fd0-3c5b-4cf2-a002-b55cf1be89bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cf4575c8c3d44aa9d83ab02572a28be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:11:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:11:00Z,use_quota=True,user_id='4a1d89cac38c49068cce7ca25ba7f2b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:10:59 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-1baad46e-2e71-477e-98f6-c18befb5c9a9 tempest-CreateVolumesFromImageTest-467947785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58821898-1174-4ef5-a52d-ae2d16b56e16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:10:59 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-1baad46e-2e71-477e-98f6-c18befb5c9a9 tempest-CreateVolumesFromImageTest-467947785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58821898-1174-4ef5-a52d-ae2d16b56e16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:10:59 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-1baad46e-2e71-477e-98f6-c18befb5c9a9 tempest-CreateVolumesFromImageTest-467947785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4f82de3-26e8-4f43-ae89-5594db4d0f3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:10:59 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-1baad46e-2e71-477e-98f6-c18befb5c9a9 tempest-CreateVolumesFromImageTest-467947785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4f82de3-26e8-4f43-ae89-5594db4d0f3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c50c2fd0-3c5b-4cf2-a002-b55cf1be89bc', 'volume_name': 'volume-c50c2fd0-3c5b-4cf2-a002-b55cf1be89bc', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:10:59 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-1baad46e-2e71-477e-98f6-c18befb5c9a9 tempest-CreateVolumesFromImageTest-467947785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78a4f933-8af3-4793-b9c1-ff046fd71943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:10:59 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-1baad46e-2e71-477e-98f6-c18befb5c9a9 tempest-CreateVolumesFromImageTest-467947785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78a4f933-8af3-4793-b9c1-ff046fd71943) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:10:59 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-1baad46e-2e71-477e-98f6-c18befb5c9a9 tempest-CreateVolumesFromImageTest-467947785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65cc4bac-4706-4fa4-b43c-597dc6349f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:10:59 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-1baad46e-2e71-477e-98f6-c18befb5c9a9 tempest-CreateVolumesFromImageTest-467947785 None] Volume c50c2fd0-3c5b-4cf2-a002-b55cf1be89bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c50c2fd0-3c5b-4cf2-a002-b55cf1be89bc', 'volume_size': 1} Sep 17 22:10:59 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-1baad46e-2e71-477e-98f6-c18befb5c9a9 tempest-CreateVolumesFromImageTest-467947785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:10:59 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-e69fd4ac-800f-40ab-aba3-e6d4f312c0f3 tempest-CinderUnicodeTest-502091172 None] Volume volume-c5ae6aee-99d6-4c2f-93ad-912092b1392a (c5ae6aee-99d6-4c2f-93ad-912092b1392a): created successfully Sep 17 22:10:59 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e69fd4ac-800f-40ab-aba3-e6d4f312c0f3 tempest-CinderUnicodeTest-502091172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06e18e91-b1fb-478d-981e-2e2dfc4c5f95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:10:59 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e69fd4ac-800f-40ab-aba3-e6d4f312c0f3 tempest-CinderUnicodeTest-502091172 None] Flow 'volume_create_manager' (decb3797-4ba5-4fe9-bc7b-e216bb0c6e68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:10:59 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-e69fd4ac-800f-40ab-aba3-e6d4f312c0f3 tempest-CinderUnicodeTest-502091172 None] Created volume successfully. Sep 17 22:11:00 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d4abcae-464f-455d-b04b-db5b034c954c tempest-CreateVolumesFromImageTest-467947785 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 22:11:00 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-7d4abcae-464f-455d-b04b-db5b034c954c tempest-CreateVolumesFromImageTest-467947785 None] Flow 'volume_create_manager' (a55cd624-3a79-4e70-acfa-400e96ce2346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:11:00 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-7d4abcae-464f-455d-b04b-db5b034c954c tempest-CreateVolumesFromImageTest-467947785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a97ae7a-3399-40de-b9ae-59ceb25304ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:00 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-7d4abcae-464f-455d-b04b-db5b034c954c tempest-CreateVolumesFromImageTest-467947785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a97ae7a-3399-40de-b9ae-59ceb25304ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:11:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2110076015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8b42727-eee0-432a-973a-ee5651c7827b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cf4575c8c3d44aa9d83ab02572a28be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:11:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:11:00Z,use_quota=True,user_id='4a1d89cac38c49068cce7ca25ba7f2b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:00 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-7d4abcae-464f-455d-b04b-db5b034c954c tempest-CreateVolumesFromImageTest-467947785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f26d54b5-a494-4bde-86d2-0f2f1e945c0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:00 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-7d4abcae-464f-455d-b04b-db5b034c954c tempest-CreateVolumesFromImageTest-467947785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f26d54b5-a494-4bde-86d2-0f2f1e945c0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:00 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-7d4abcae-464f-455d-b04b-db5b034c954c tempest-CreateVolumesFromImageTest-467947785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (601f361a-5f11-48ad-b649-e5c17ce3660f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:00 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-7d4abcae-464f-455d-b04b-db5b034c954c tempest-CreateVolumesFromImageTest-467947785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (601f361a-5f11-48ad-b649-e5c17ce3660f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8b42727-eee0-432a-973a-ee5651c7827b', 'volume_name': 'volume-c8b42727-eee0-432a-973a-ee5651c7827b', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:00 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-7d4abcae-464f-455d-b04b-db5b034c954c tempest-CreateVolumesFromImageTest-467947785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4d3acc0-1546-4986-bdb5-ef322b3a59eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:00 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-7d4abcae-464f-455d-b04b-db5b034c954c tempest-CreateVolumesFromImageTest-467947785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4d3acc0-1546-4986-bdb5-ef322b3a59eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:00 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-7d4abcae-464f-455d-b04b-db5b034c954c tempest-CreateVolumesFromImageTest-467947785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f90b62d2-9a91-4738-ab81-02bebcdd0982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:00 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-7d4abcae-464f-455d-b04b-db5b034c954c tempest-CreateVolumesFromImageTest-467947785 None] Volume c8b42727-eee0-432a-973a-ee5651c7827b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8b42727-eee0-432a-973a-ee5651c7827b', 'volume_size': 1} Sep 17 22:11:00 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-7d4abcae-464f-455d-b04b-db5b034c954c tempest-CreateVolumesFromImageTest-467947785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:11:00 devstack sudo[104300]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:00 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-1d44c62d-4f7d-4863-bcb2-3dbeced202b0 tempest-CreateVolumesFromImageTest-467947785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8d222051-d10c-47d4-9587-d77a319c7961 1073741824" returned: 0 in 0.652s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:00 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-1d44c62d-4f7d-4863-bcb2-3dbeced202b0 tempest-CreateVolumesFromImageTest-467947785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8d222051-d10c-47d4-9587-d77a319c7961 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:00 devstack sudo[104306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8d222051-d10c-47d4-9587-d77a319c7961 Sep 17 22:11:00 devstack sudo[104306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:00 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c8ca0ae-fd8a-4dd6-9c4b-b7a74e1fb2bd tempest-CreateVolumesFromImageTest-467947785 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 22:11:00 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-9c8ca0ae-fd8a-4dd6-9c4b-b7a74e1fb2bd tempest-CreateVolumesFromImageTest-467947785 None] Flow 'volume_create_manager' (03541031-b9a2-4639-9a13-298eab05e0db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:11:00 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-9c8ca0ae-fd8a-4dd6-9c4b-b7a74e1fb2bd tempest-CreateVolumesFromImageTest-467947785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5996671-0530-40d6-b376-6349d9753f87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:00 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-9c8ca0ae-fd8a-4dd6-9c4b-b7a74e1fb2bd tempest-CreateVolumesFromImageTest-467947785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5996671-0530-40d6-b376-6349d9753f87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:11:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1419413639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53c91d92-8615-4e22-8888-16d11f45d16a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cf4575c8c3d44aa9d83ab02572a28be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:11:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:11:01Z,use_quota=True,user_id='4a1d89cac38c49068cce7ca25ba7f2b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:00 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-9c8ca0ae-fd8a-4dd6-9c4b-b7a74e1fb2bd tempest-CreateVolumesFromImageTest-467947785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a68d2bc-fb24-46d4-894b-bdf1a1ff91ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:00 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-9c8ca0ae-fd8a-4dd6-9c4b-b7a74e1fb2bd tempest-CreateVolumesFromImageTest-467947785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a68d2bc-fb24-46d4-894b-bdf1a1ff91ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:00 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-9c8ca0ae-fd8a-4dd6-9c4b-b7a74e1fb2bd tempest-CreateVolumesFromImageTest-467947785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bf4203a-06a8-45f8-b6de-fcf85b67268a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:00 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-9c8ca0ae-fd8a-4dd6-9c4b-b7a74e1fb2bd tempest-CreateVolumesFromImageTest-467947785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bf4203a-06a8-45f8-b6de-fcf85b67268a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53c91d92-8615-4e22-8888-16d11f45d16a', 'volume_name': 'volume-53c91d92-8615-4e22-8888-16d11f45d16a', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:00 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-9c8ca0ae-fd8a-4dd6-9c4b-b7a74e1fb2bd tempest-CreateVolumesFromImageTest-467947785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13d2b1da-e45e-4cfa-b24e-867870f9b241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:00 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-9c8ca0ae-fd8a-4dd6-9c4b-b7a74e1fb2bd tempest-CreateVolumesFromImageTest-467947785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13d2b1da-e45e-4cfa-b24e-867870f9b241) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:00 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-9c8ca0ae-fd8a-4dd6-9c4b-b7a74e1fb2bd tempest-CreateVolumesFromImageTest-467947785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4f62d5d-596f-45a0-bfdc-f74059c255ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:00 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-9c8ca0ae-fd8a-4dd6-9c4b-b7a74e1fb2bd tempest-CreateVolumesFromImageTest-467947785 None] Volume 53c91d92-8615-4e22-8888-16d11f45d16a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53c91d92-8615-4e22-8888-16d11f45d16a', 'volume_size': 1} Sep 17 22:11:00 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-9c8ca0ae-fd8a-4dd6-9c4b-b7a74e1fb2bd tempest-CreateVolumesFromImageTest-467947785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:11:00 devstack sudo[104306]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:00 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-1d44c62d-4f7d-4863-bcb2-3dbeced202b0 tempest-CreateVolumesFromImageTest-467947785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8d222051-d10c-47d4-9587-d77a319c7961" returned: 0 in 0.441s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:00 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-1d44c62d-4f7d-4863-bcb2-3dbeced202b0 tempest-CreateVolumesFromImageTest-467947785 None] <== create_volume: return (1159ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 22:11:00 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-1d44c62d-4f7d-4863-bcb2-3dbeced202b0 tempest-CreateVolumesFromImageTest-467947785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.161s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:11:00 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-b1fd609b-0b04-47af-9cf3-da71e9f67868 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.174s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:11:00 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-b1fd609b-0b04-47af-9cf3-da71e9f67868 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:10:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1052103718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcbdc049-4cbd-41f1-9210-4d1a1e60ef86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fca2e5554f39458694ef19aa1c2e0a3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:10:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:10:59Z,use_quota=True,user_id='9e3bf776ed4441c883eabadfac361819',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 22:11:00 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-b1fd609b-0b04-47af-9cf3-da71e9f67868 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Creating volume fcbdc049-4cbd-41f1-9210-4d1a1e60ef86 {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 22:11:00 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-b1fd609b-0b04-47af-9cf3-da71e9f67868 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:11:00 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-b1fd609b-0b04-47af-9cf3-da71e9f67868 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:11:00 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-b1fd609b-0b04-47af-9cf3-da71e9f67868 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:11:00 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-b1fd609b-0b04-47af-9cf3-da71e9f67868 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:11:00 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-b1fd609b-0b04-47af-9cf3-da71e9f67868 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:11:00 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-b1fd609b-0b04-47af-9cf3-da71e9f67868 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 22:11:00 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-b1fd609b-0b04-47af-9cf3-da71e9f67868 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 22:11:00 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-b1fd609b-0b04-47af-9cf3-da71e9f67868 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-fcbdc049-4cbd-41f1-9210-4d1a1e60ef86 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:00 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-1d44c62d-4f7d-4863-bcb2-3dbeced202b0 tempest-CreateVolumesFromImageTest-467947785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7740457b-c9cb-426b-8f0f-69319aaf3e6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d222051-d10c-47d4-9587-d77a319c7961', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:00 devstack sudo[104309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-fcbdc049-4cbd-41f1-9210-4d1a1e60ef86 1073741824 Sep 17 22:11:00 devstack sudo[104309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:00 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-1d44c62d-4f7d-4863-bcb2-3dbeced202b0 tempest-CreateVolumesFromImageTest-467947785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44dc888a-6996-46f3-a34a-4de2b232f274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:00 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-1d44c62d-4f7d-4863-bcb2-3dbeced202b0 tempest-CreateVolumesFromImageTest-467947785 None] Volume volume-8d222051-d10c-47d4-9587-d77a319c7961 (8d222051-d10c-47d4-9587-d77a319c7961): created successfully Sep 17 22:11:00 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-1d44c62d-4f7d-4863-bcb2-3dbeced202b0 tempest-CreateVolumesFromImageTest-467947785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44dc888a-6996-46f3-a34a-4de2b232f274) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:00 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-1d44c62d-4f7d-4863-bcb2-3dbeced202b0 tempest-CreateVolumesFromImageTest-467947785 None] Flow 'volume_create_manager' (ef81db86-5f0c-437c-9940-fcac36373db6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:11:01 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-1d44c62d-4f7d-4863-bcb2-3dbeced202b0 tempest-CreateVolumesFromImageTest-467947785 None] Created volume successfully. Sep 17 22:11:01 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-10ad151d-6ef6-41ac-9196-507cfffab687 tempest-CreateVolumesFromImageTest-467947785 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 22:11:01 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-10ad151d-6ef6-41ac-9196-507cfffab687 tempest-CreateVolumesFromImageTest-467947785 None] Flow 'volume_create_manager' (7fea9bb6-52b1-431c-9d8a-a26baa24bf8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:11:01 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-10ad151d-6ef6-41ac-9196-507cfffab687 tempest-CreateVolumesFromImageTest-467947785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c16a9ebd-5f27-4fb1-be68-bd1298f0a0d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:01 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-10ad151d-6ef6-41ac-9196-507cfffab687 tempest-CreateVolumesFromImageTest-467947785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c16a9ebd-5f27-4fb1-be68-bd1298f0a0d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:11:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1208622183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6c680cc-d2fc-4eee-97ed-dc18b798d0c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cf4575c8c3d44aa9d83ab02572a28be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:11:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:11:01Z,use_quota=True,user_id='4a1d89cac38c49068cce7ca25ba7f2b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:01 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-10ad151d-6ef6-41ac-9196-507cfffab687 tempest-CreateVolumesFromImageTest-467947785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abd6fc4e-b13d-4108-a1a0-23b931c3af60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:01 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-10ad151d-6ef6-41ac-9196-507cfffab687 tempest-CreateVolumesFromImageTest-467947785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abd6fc4e-b13d-4108-a1a0-23b931c3af60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:01 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-10ad151d-6ef6-41ac-9196-507cfffab687 tempest-CreateVolumesFromImageTest-467947785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da6edda3-1c3b-43cc-adde-9b8d26977f16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:01 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-10ad151d-6ef6-41ac-9196-507cfffab687 tempest-CreateVolumesFromImageTest-467947785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da6edda3-1c3b-43cc-adde-9b8d26977f16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6c680cc-d2fc-4eee-97ed-dc18b798d0c6', 'volume_name': 'volume-f6c680cc-d2fc-4eee-97ed-dc18b798d0c6', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:01 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-10ad151d-6ef6-41ac-9196-507cfffab687 tempest-CreateVolumesFromImageTest-467947785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cef1c70e-1f01-4e0a-b3f6-5ca80d8ff1db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:01 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-10ad151d-6ef6-41ac-9196-507cfffab687 tempest-CreateVolumesFromImageTest-467947785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cef1c70e-1f01-4e0a-b3f6-5ca80d8ff1db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:01 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-10ad151d-6ef6-41ac-9196-507cfffab687 tempest-CreateVolumesFromImageTest-467947785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e0d90f6-ebf2-4fa9-976d-0db845d1c143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:01 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-10ad151d-6ef6-41ac-9196-507cfffab687 tempest-CreateVolumesFromImageTest-467947785 None] Volume f6c680cc-d2fc-4eee-97ed-dc18b798d0c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6c680cc-d2fc-4eee-97ed-dc18b798d0c6', 'volume_size': 1} Sep 17 22:11:01 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-10ad151d-6ef6-41ac-9196-507cfffab687 tempest-CreateVolumesFromImageTest-467947785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:11:01 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-2267b7be-3b4b-41be-8517-9ef528d35275 tempest-CinderUnicodeTest-502091172 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 22:11:01 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-2267b7be-3b4b-41be-8517-9ef528d35275 tempest-CinderUnicodeTest-502091172 None] Flow 'volume_create_manager' (1de266b8-549a-4a18-aea9-465f9b174c9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:11:01 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-2267b7be-3b4b-41be-8517-9ef528d35275 tempest-CinderUnicodeTest-502091172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9d07368-5499-42a9-9753-eb084ed43649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:01 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-2267b7be-3b4b-41be-8517-9ef528d35275 tempest-CinderUnicodeTest-502091172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9d07368-5499-42a9-9753-eb084ed43649) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:11:01Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-904066976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5153193-2437-4b44-8d42-f07a9a670036,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea6e6be09d7e4895b55b3e3292f9a3fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:11:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:11:01Z,use_quota=True,user_id='a598a48bfa664848a24ec024754af276',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:01 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-2267b7be-3b4b-41be-8517-9ef528d35275 tempest-CinderUnicodeTest-502091172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf3a500f-2c52-461e-9d4f-295de703ec09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:01 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-2267b7be-3b4b-41be-8517-9ef528d35275 tempest-CinderUnicodeTest-502091172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf3a500f-2c52-461e-9d4f-295de703ec09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:01 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-2267b7be-3b4b-41be-8517-9ef528d35275 tempest-CinderUnicodeTest-502091172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aae2bfa7-dfb4-42c4-97df-8075d37de832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:01 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-2267b7be-3b4b-41be-8517-9ef528d35275 tempest-CinderUnicodeTest-502091172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aae2bfa7-dfb4-42c4-97df-8075d37de832) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5153193-2437-4b44-8d42-f07a9a670036', 'volume_name': 'volume-a5153193-2437-4b44-8d42-f07a9a670036', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:01 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-2267b7be-3b4b-41be-8517-9ef528d35275 tempest-CinderUnicodeTest-502091172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcdb1bb9-7674-4242-8bce-fe0d9009b7c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:01 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-2267b7be-3b4b-41be-8517-9ef528d35275 tempest-CinderUnicodeTest-502091172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcdb1bb9-7674-4242-8bce-fe0d9009b7c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:01 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-2267b7be-3b4b-41be-8517-9ef528d35275 tempest-CinderUnicodeTest-502091172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43590e02-e1c6-4a2f-a8e4-48a753169b09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:01 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-2267b7be-3b4b-41be-8517-9ef528d35275 tempest-CinderUnicodeTest-502091172 None] Volume a5153193-2437-4b44-8d42-f07a9a670036: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5153193-2437-4b44-8d42-f07a9a670036', 'volume_size': 1} Sep 17 22:11:01 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-2267b7be-3b4b-41be-8517-9ef528d35275 tempest-CinderUnicodeTest-502091172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:11:01 devstack sudo[104309]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:01 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-b1fd609b-0b04-47af-9cf3-da71e9f67868 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-fcbdc049-4cbd-41f1-9210-4d1a1e60ef86 1073741824" returned: 0 in 0.562s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:01 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-b1fd609b-0b04-47af-9cf3-da71e9f67868 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-fcbdc049-4cbd-41f1-9210-4d1a1e60ef86 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:01 devstack sudo[104316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-fcbdc049-4cbd-41f1-9210-4d1a1e60ef86 Sep 17 22:11:01 devstack sudo[104316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:01 devstack sudo[104316]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:01 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-b1fd609b-0b04-47af-9cf3-da71e9f67868 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-fcbdc049-4cbd-41f1-9210-4d1a1e60ef86" returned: 0 in 0.257s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:01 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-b1fd609b-0b04-47af-9cf3-da71e9f67868 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] <== create_volume: return (871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 22:11:01 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-b1fd609b-0b04-47af-9cf3-da71e9f67868 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.874s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:11:01 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-1baad46e-2e71-477e-98f6-c18befb5c9a9 tempest-CreateVolumesFromImageTest-467947785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.898s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:11:01 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-1baad46e-2e71-477e-98f6-c18befb5c9a9 tempest-CreateVolumesFromImageTest-467947785 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:10:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-843830903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c50c2fd0-3c5b-4cf2-a002-b55cf1be89bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cf4575c8c3d44aa9d83ab02572a28be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:11:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:11:00Z,use_quota=True,user_id='4a1d89cac38c49068cce7ca25ba7f2b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 22:11:01 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-1baad46e-2e71-477e-98f6-c18befb5c9a9 tempest-CreateVolumesFromImageTest-467947785 None] Creating volume c50c2fd0-3c5b-4cf2-a002-b55cf1be89bc {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 22:11:01 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-1baad46e-2e71-477e-98f6-c18befb5c9a9 tempest-CreateVolumesFromImageTest-467947785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:11:01 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-1baad46e-2e71-477e-98f6-c18befb5c9a9 tempest-CreateVolumesFromImageTest-467947785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:11:01 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-1baad46e-2e71-477e-98f6-c18befb5c9a9 tempest-CreateVolumesFromImageTest-467947785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:11:01 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-1baad46e-2e71-477e-98f6-c18befb5c9a9 tempest-CreateVolumesFromImageTest-467947785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:11:01 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-1baad46e-2e71-477e-98f6-c18befb5c9a9 tempest-CreateVolumesFromImageTest-467947785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:11:01 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-1baad46e-2e71-477e-98f6-c18befb5c9a9 tempest-CreateVolumesFromImageTest-467947785 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 22:11:01 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-1baad46e-2e71-477e-98f6-c18befb5c9a9 tempest-CreateVolumesFromImageTest-467947785 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 22:11:01 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-1baad46e-2e71-477e-98f6-c18befb5c9a9 tempest-CreateVolumesFromImageTest-467947785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c50c2fd0-3c5b-4cf2-a002-b55cf1be89bc 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:01 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b1fd609b-0b04-47af-9cf3-da71e9f67868 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (420e6e09-8eb1-42a4-8a6d-59552208d5a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fcbdc049-4cbd-41f1-9210-4d1a1e60ef86', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:01 devstack sudo[104319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c50c2fd0-3c5b-4cf2-a002-b55cf1be89bc 1073741824 Sep 17 22:11:01 devstack sudo[104319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:01 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b1fd609b-0b04-47af-9cf3-da71e9f67868 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dde0d210-0248-49af-a533-1208ec1e67da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:01 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-b1fd609b-0b04-47af-9cf3-da71e9f67868 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Volume volume-fcbdc049-4cbd-41f1-9210-4d1a1e60ef86 (fcbdc049-4cbd-41f1-9210-4d1a1e60ef86): created successfully Sep 17 22:11:01 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b1fd609b-0b04-47af-9cf3-da71e9f67868 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dde0d210-0248-49af-a533-1208ec1e67da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:01 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b1fd609b-0b04-47af-9cf3-da71e9f67868 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Flow 'volume_create_manager' (2aab614d-20fb-4f58-ad53-50df1e153492) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:11:01 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-b1fd609b-0b04-47af-9cf3-da71e9f67868 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Created volume successfully. Sep 17 22:11:02 devstack sudo[104319]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:02 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-1baad46e-2e71-477e-98f6-c18befb5c9a9 tempest-CreateVolumesFromImageTest-467947785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c50c2fd0-3c5b-4cf2-a002-b55cf1be89bc 1073741824" returned: 0 in 0.464s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:02 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-1baad46e-2e71-477e-98f6-c18befb5c9a9 tempest-CreateVolumesFromImageTest-467947785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c50c2fd0-3c5b-4cf2-a002-b55cf1be89bc {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:02 devstack sudo[104325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c50c2fd0-3c5b-4cf2-a002-b55cf1be89bc Sep 17 22:11:02 devstack sudo[104325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:02 devstack sudo[104325]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:02 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-1baad46e-2e71-477e-98f6-c18befb5c9a9 tempest-CreateVolumesFromImageTest-467947785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c50c2fd0-3c5b-4cf2-a002-b55cf1be89bc" returned: 0 in 0.275s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:02 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-1baad46e-2e71-477e-98f6-c18befb5c9a9 tempest-CreateVolumesFromImageTest-467947785 None] <== create_volume: return (797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 22:11:02 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-1baad46e-2e71-477e-98f6-c18befb5c9a9 tempest-CreateVolumesFromImageTest-467947785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.800s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:11:02 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-7d4abcae-464f-455d-b04b-db5b034c954c tempest-CreateVolumesFromImageTest-467947785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.336s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:11:02 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-7d4abcae-464f-455d-b04b-db5b034c954c tempest-CreateVolumesFromImageTest-467947785 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:11:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2110076015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8b42727-eee0-432a-973a-ee5651c7827b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cf4575c8c3d44aa9d83ab02572a28be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:11:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:11:00Z,use_quota=True,user_id='4a1d89cac38c49068cce7ca25ba7f2b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 22:11:02 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-7d4abcae-464f-455d-b04b-db5b034c954c tempest-CreateVolumesFromImageTest-467947785 None] Creating volume c8b42727-eee0-432a-973a-ee5651c7827b {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 22:11:02 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-7d4abcae-464f-455d-b04b-db5b034c954c tempest-CreateVolumesFromImageTest-467947785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:11:02 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-7d4abcae-464f-455d-b04b-db5b034c954c tempest-CreateVolumesFromImageTest-467947785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:11:02 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-7d4abcae-464f-455d-b04b-db5b034c954c tempest-CreateVolumesFromImageTest-467947785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:11:02 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-7d4abcae-464f-455d-b04b-db5b034c954c tempest-CreateVolumesFromImageTest-467947785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:11:02 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-7d4abcae-464f-455d-b04b-db5b034c954c tempest-CreateVolumesFromImageTest-467947785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:11:02 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-7d4abcae-464f-455d-b04b-db5b034c954c tempest-CreateVolumesFromImageTest-467947785 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 22:11:02 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-7d4abcae-464f-455d-b04b-db5b034c954c tempest-CreateVolumesFromImageTest-467947785 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 22:11:02 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-7d4abcae-464f-455d-b04b-db5b034c954c tempest-CreateVolumesFromImageTest-467947785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c8b42727-eee0-432a-973a-ee5651c7827b 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:02 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-1baad46e-2e71-477e-98f6-c18befb5c9a9 tempest-CreateVolumesFromImageTest-467947785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65cc4bac-4706-4fa4-b43c-597dc6349f0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c50c2fd0-3c5b-4cf2-a002-b55cf1be89bc', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:02 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-1baad46e-2e71-477e-98f6-c18befb5c9a9 tempest-CreateVolumesFromImageTest-467947785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a29e25a-6d3c-4dbc-ae84-db6a6e6e7763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:02 devstack sudo[104328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c8b42727-eee0-432a-973a-ee5651c7827b 1073741824 Sep 17 22:11:02 devstack sudo[104328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:02 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-1baad46e-2e71-477e-98f6-c18befb5c9a9 tempest-CreateVolumesFromImageTest-467947785 None] Volume volume-c50c2fd0-3c5b-4cf2-a002-b55cf1be89bc (c50c2fd0-3c5b-4cf2-a002-b55cf1be89bc): created successfully Sep 17 22:11:02 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-1baad46e-2e71-477e-98f6-c18befb5c9a9 tempest-CreateVolumesFromImageTest-467947785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a29e25a-6d3c-4dbc-ae84-db6a6e6e7763) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:02 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-1baad46e-2e71-477e-98f6-c18befb5c9a9 tempest-CreateVolumesFromImageTest-467947785 None] Flow 'volume_create_manager' (244c592b-ec96-4708-a59a-3f38722363e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:11:02 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-1baad46e-2e71-477e-98f6-c18befb5c9a9 tempest-CreateVolumesFromImageTest-467947785 None] Created volume successfully. Sep 17 22:11:03 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e181557-9639-4875-b16e-19460d877e3b tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 22:11:03 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-3e181557-9639-4875-b16e-19460d877e3b tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Flow 'volume_create_manager' (44f01c55-137f-4e16-8af3-8e46d97396a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:11:03 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-3e181557-9639-4875-b16e-19460d877e3b tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35379a2d-0f3f-43f7-b0b9-98f50818df66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:03 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-3e181557-9639-4875-b16e-19460d877e3b tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35379a2d-0f3f-43f7-b0b9-98f50818df66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:11:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1653786166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2071b381-05b2-47ca-80f9-24c058d7b1b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fca2e5554f39458694ef19aa1c2e0a3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:11:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:11:03Z,use_quota=True,user_id='9e3bf776ed4441c883eabadfac361819',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:03 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-3e181557-9639-4875-b16e-19460d877e3b tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8fb2c99-a117-44c4-a19b-bff985d65320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:03 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-3e181557-9639-4875-b16e-19460d877e3b tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8fb2c99-a117-44c4-a19b-bff985d65320) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:03 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-3e181557-9639-4875-b16e-19460d877e3b tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a78901b-5386-4d27-9398-4b855d30cc5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:03 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-3e181557-9639-4875-b16e-19460d877e3b tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a78901b-5386-4d27-9398-4b855d30cc5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2071b381-05b2-47ca-80f9-24c058d7b1b1', 'volume_name': 'volume-2071b381-05b2-47ca-80f9-24c058d7b1b1', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:03 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-3e181557-9639-4875-b16e-19460d877e3b tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71e4557a-de74-406c-9b5f-ae0f45fb804b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:03 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-3e181557-9639-4875-b16e-19460d877e3b tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71e4557a-de74-406c-9b5f-ae0f45fb804b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:03 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-3e181557-9639-4875-b16e-19460d877e3b tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43ebdf77-2197-4e5b-8237-2c02887a438b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:03 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-3e181557-9639-4875-b16e-19460d877e3b tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Volume 2071b381-05b2-47ca-80f9-24c058d7b1b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2071b381-05b2-47ca-80f9-24c058d7b1b1', 'volume_size': 1} Sep 17 22:11:03 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-3e181557-9639-4875-b16e-19460d877e3b tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:11:03 devstack sudo[104328]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:03 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-7d4abcae-464f-455d-b04b-db5b034c954c tempest-CreateVolumesFromImageTest-467947785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c8b42727-eee0-432a-973a-ee5651c7827b 1073741824" returned: 0 in 0.591s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:03 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-7d4abcae-464f-455d-b04b-db5b034c954c tempest-CreateVolumesFromImageTest-467947785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c8b42727-eee0-432a-973a-ee5651c7827b {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:03 devstack sudo[104334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c8b42727-eee0-432a-973a-ee5651c7827b Sep 17 22:11:03 devstack sudo[104334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:03 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-70457a52-abe5-4474-a038-776556509106 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 22:11:03 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-70457a52-abe5-4474-a038-776556509106 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Flow 'volume_create_manager' (475db5f4-2524-489d-805d-7a498036cd8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:11:03 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-70457a52-abe5-4474-a038-776556509106 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a4afccc-00f6-4365-b2f7-f8fed7f43b7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:03 devstack sudo[104334]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:03 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-70457a52-abe5-4474-a038-776556509106 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a4afccc-00f6-4365-b2f7-f8fed7f43b7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:11:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-87317255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2cc7187-c81e-4c2d-b5de-3cbe569fd11f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fca2e5554f39458694ef19aa1c2e0a3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:11:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:11:03Z,use_quota=True,user_id='9e3bf776ed4441c883eabadfac361819',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:03 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-70457a52-abe5-4474-a038-776556509106 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80770a5d-3e24-4b4e-9bc7-b7a46441641e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:03 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-70457a52-abe5-4474-a038-776556509106 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80770a5d-3e24-4b4e-9bc7-b7a46441641e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:03 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-70457a52-abe5-4474-a038-776556509106 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (496eabc7-c5b3-4a97-a14e-c78eb3c6dfc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:03 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-70457a52-abe5-4474-a038-776556509106 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (496eabc7-c5b3-4a97-a14e-c78eb3c6dfc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2cc7187-c81e-4c2d-b5de-3cbe569fd11f', 'volume_name': 'volume-d2cc7187-c81e-4c2d-b5de-3cbe569fd11f', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:03 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-70457a52-abe5-4474-a038-776556509106 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2422effb-7d00-4a76-a499-8ba624586acc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:03 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-70457a52-abe5-4474-a038-776556509106 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2422effb-7d00-4a76-a499-8ba624586acc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:03 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-70457a52-abe5-4474-a038-776556509106 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0a56973-091d-4917-827b-572915260786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:03 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-70457a52-abe5-4474-a038-776556509106 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Volume d2cc7187-c81e-4c2d-b5de-3cbe569fd11f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2cc7187-c81e-4c2d-b5de-3cbe569fd11f', 'volume_size': 1} Sep 17 22:11:03 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-70457a52-abe5-4474-a038-776556509106 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:11:03 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-7d4abcae-464f-455d-b04b-db5b034c954c tempest-CreateVolumesFromImageTest-467947785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c8b42727-eee0-432a-973a-ee5651c7827b" returned: 0 in 0.373s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:03 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-7d4abcae-464f-455d-b04b-db5b034c954c tempest-CreateVolumesFromImageTest-467947785 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 22:11:03 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-7d4abcae-464f-455d-b04b-db5b034c954c tempest-CreateVolumesFromImageTest-467947785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:11:03 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-9c8ca0ae-fd8a-4dd6-9c4b-b7a74e1fb2bd tempest-CreateVolumesFromImageTest-467947785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.789s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:11:03 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-9c8ca0ae-fd8a-4dd6-9c4b-b7a74e1fb2bd tempest-CreateVolumesFromImageTest-467947785 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:11:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1419413639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53c91d92-8615-4e22-8888-16d11f45d16a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cf4575c8c3d44aa9d83ab02572a28be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:11:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:11:01Z,use_quota=True,user_id='4a1d89cac38c49068cce7ca25ba7f2b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 22:11:03 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-9c8ca0ae-fd8a-4dd6-9c4b-b7a74e1fb2bd tempest-CreateVolumesFromImageTest-467947785 None] Creating volume 53c91d92-8615-4e22-8888-16d11f45d16a {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 22:11:03 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-9c8ca0ae-fd8a-4dd6-9c4b-b7a74e1fb2bd tempest-CreateVolumesFromImageTest-467947785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:11:03 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-9c8ca0ae-fd8a-4dd6-9c4b-b7a74e1fb2bd tempest-CreateVolumesFromImageTest-467947785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:11:03 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-9c8ca0ae-fd8a-4dd6-9c4b-b7a74e1fb2bd tempest-CreateVolumesFromImageTest-467947785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:11:03 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-9c8ca0ae-fd8a-4dd6-9c4b-b7a74e1fb2bd tempest-CreateVolumesFromImageTest-467947785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:11:03 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-9c8ca0ae-fd8a-4dd6-9c4b-b7a74e1fb2bd tempest-CreateVolumesFromImageTest-467947785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:11:03 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-9c8ca0ae-fd8a-4dd6-9c4b-b7a74e1fb2bd tempest-CreateVolumesFromImageTest-467947785 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 22:11:03 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-9c8ca0ae-fd8a-4dd6-9c4b-b7a74e1fb2bd tempest-CreateVolumesFromImageTest-467947785 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 22:11:03 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-9c8ca0ae-fd8a-4dd6-9c4b-b7a74e1fb2bd tempest-CreateVolumesFromImageTest-467947785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-53c91d92-8615-4e22-8888-16d11f45d16a 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:03 devstack sudo[104337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-53c91d92-8615-4e22-8888-16d11f45d16a 1073741824 Sep 17 22:11:03 devstack sudo[104337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:03 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-7d4abcae-464f-455d-b04b-db5b034c954c tempest-CreateVolumesFromImageTest-467947785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f90b62d2-9a91-4738-ab81-02bebcdd0982) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8b42727-eee0-432a-973a-ee5651c7827b', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:03 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-7d4abcae-464f-455d-b04b-db5b034c954c tempest-CreateVolumesFromImageTest-467947785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24e62642-a558-4aa3-8a3a-7f28b5660e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:03 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-7d4abcae-464f-455d-b04b-db5b034c954c tempest-CreateVolumesFromImageTest-467947785 None] Volume volume-c8b42727-eee0-432a-973a-ee5651c7827b (c8b42727-eee0-432a-973a-ee5651c7827b): created successfully Sep 17 22:11:03 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-7d4abcae-464f-455d-b04b-db5b034c954c tempest-CreateVolumesFromImageTest-467947785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24e62642-a558-4aa3-8a3a-7f28b5660e4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:03 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-7d4abcae-464f-455d-b04b-db5b034c954c tempest-CreateVolumesFromImageTest-467947785 None] Flow 'volume_create_manager' (a55cd624-3a79-4e70-acfa-400e96ce2346) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:11:03 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-7d4abcae-464f-455d-b04b-db5b034c954c tempest-CreateVolumesFromImageTest-467947785 None] Created volume successfully. Sep 17 22:11:04 devstack sudo[104337]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:04 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-9c8ca0ae-fd8a-4dd6-9c4b-b7a74e1fb2bd tempest-CreateVolumesFromImageTest-467947785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-53c91d92-8615-4e22-8888-16d11f45d16a 1073741824" returned: 0 in 0.531s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:04 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-9c8ca0ae-fd8a-4dd6-9c4b-b7a74e1fb2bd tempest-CreateVolumesFromImageTest-467947785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-53c91d92-8615-4e22-8888-16d11f45d16a {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:04 devstack sudo[104346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-53c91d92-8615-4e22-8888-16d11f45d16a Sep 17 22:11:04 devstack sudo[104346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:04 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6e4039c-d0b0-490d-ad64-9c8ed4a9db1a tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 22:11:04 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-d6e4039c-d0b0-490d-ad64-9c8ed4a9db1a tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Flow 'volume_create_manager' (dfd1f3b4-295a-49ca-82b4-6940f9f24a83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:11:04 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-d6e4039c-d0b0-490d-ad64-9c8ed4a9db1a tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca5d6447-279b-459c-9ba2-e619433272a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:04 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-d6e4039c-d0b0-490d-ad64-9c8ed4a9db1a tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca5d6447-279b-459c-9ba2-e619433272a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:11:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2102614815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9317c1bf-893f-4f1b-b995-749a0b15458c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fca2e5554f39458694ef19aa1c2e0a3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:11:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:11:04Z,use_quota=True,user_id='9e3bf776ed4441c883eabadfac361819',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:04 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-d6e4039c-d0b0-490d-ad64-9c8ed4a9db1a tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfa19c30-7bcb-4270-8999-bc26c5036987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:04 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-d6e4039c-d0b0-490d-ad64-9c8ed4a9db1a tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfa19c30-7bcb-4270-8999-bc26c5036987) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:04 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-d6e4039c-d0b0-490d-ad64-9c8ed4a9db1a tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (233f311f-e48b-4334-a900-a401d1ea09eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:04 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-d6e4039c-d0b0-490d-ad64-9c8ed4a9db1a tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (233f311f-e48b-4334-a900-a401d1ea09eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9317c1bf-893f-4f1b-b995-749a0b15458c', 'volume_name': 'volume-9317c1bf-893f-4f1b-b995-749a0b15458c', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:04 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-d6e4039c-d0b0-490d-ad64-9c8ed4a9db1a tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9393e8d9-c01f-4e17-84b0-f406b2d817fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:04 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-d6e4039c-d0b0-490d-ad64-9c8ed4a9db1a tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9393e8d9-c01f-4e17-84b0-f406b2d817fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:04 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-d6e4039c-d0b0-490d-ad64-9c8ed4a9db1a tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54a35285-4d76-4f36-8339-a7dfcefbd71c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:04 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-d6e4039c-d0b0-490d-ad64-9c8ed4a9db1a tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Volume 9317c1bf-893f-4f1b-b995-749a0b15458c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9317c1bf-893f-4f1b-b995-749a0b15458c', 'volume_size': 1} Sep 17 22:11:04 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-d6e4039c-d0b0-490d-ad64-9c8ed4a9db1a tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:11:04 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-134c7c7d-134b-405f-8be8-a85ce187b76f tempest-VolumeAndVolumeTypeFromImageTest-1224775445 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 22:11:04 devstack sudo[104346]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:04 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-134c7c7d-134b-405f-8be8-a85ce187b76f tempest-VolumeAndVolumeTypeFromImageTest-1224775445 None] Flow 'volume_create_manager' (f23a6e89-afc7-46fa-a765-3cb55eca12f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:11:04 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-134c7c7d-134b-405f-8be8-a85ce187b76f tempest-VolumeAndVolumeTypeFromImageTest-1224775445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecc944e4-eb07-4200-ad23-c3a674960f67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:04 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-9c8ca0ae-fd8a-4dd6-9c4b-b7a74e1fb2bd tempest-CreateVolumesFromImageTest-467947785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-53c91d92-8615-4e22-8888-16d11f45d16a" returned: 0 in 0.349s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:04 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-9c8ca0ae-fd8a-4dd6-9c4b-b7a74e1fb2bd tempest-CreateVolumesFromImageTest-467947785 None] <== create_volume: return (925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 22:11:04 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-9c8ca0ae-fd8a-4dd6-9c4b-b7a74e1fb2bd tempest-CreateVolumesFromImageTest-467947785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.928s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:11:04 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-10ad151d-6ef6-41ac-9196-507cfffab687 tempest-CreateVolumesFromImageTest-467947785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.302s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:11:04 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-10ad151d-6ef6-41ac-9196-507cfffab687 tempest-CreateVolumesFromImageTest-467947785 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:11:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1208622183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6c680cc-d2fc-4eee-97ed-dc18b798d0c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cf4575c8c3d44aa9d83ab02572a28be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:11:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:11:01Z,use_quota=True,user_id='4a1d89cac38c49068cce7ca25ba7f2b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 22:11:04 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-10ad151d-6ef6-41ac-9196-507cfffab687 tempest-CreateVolumesFromImageTest-467947785 None] Creating volume f6c680cc-d2fc-4eee-97ed-dc18b798d0c6 {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 22:11:04 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-10ad151d-6ef6-41ac-9196-507cfffab687 tempest-CreateVolumesFromImageTest-467947785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:11:04 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-10ad151d-6ef6-41ac-9196-507cfffab687 tempest-CreateVolumesFromImageTest-467947785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:11:04 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-10ad151d-6ef6-41ac-9196-507cfffab687 tempest-CreateVolumesFromImageTest-467947785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:11:04 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-10ad151d-6ef6-41ac-9196-507cfffab687 tempest-CreateVolumesFromImageTest-467947785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:11:04 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-10ad151d-6ef6-41ac-9196-507cfffab687 tempest-CreateVolumesFromImageTest-467947785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:11:04 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-10ad151d-6ef6-41ac-9196-507cfffab687 tempest-CreateVolumesFromImageTest-467947785 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 22:11:04 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-10ad151d-6ef6-41ac-9196-507cfffab687 tempest-CreateVolumesFromImageTest-467947785 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 22:11:04 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-10ad151d-6ef6-41ac-9196-507cfffab687 tempest-CreateVolumesFromImageTest-467947785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f6c680cc-d2fc-4eee-97ed-dc18b798d0c6 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:04 devstack sudo[104349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f6c680cc-d2fc-4eee-97ed-dc18b798d0c6 1073741824 Sep 17 22:11:04 devstack sudo[104349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:04 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-134c7c7d-134b-405f-8be8-a85ce187b76f tempest-VolumeAndVolumeTypeFromImageTest-1224775445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecc944e4-eb07-4200-ad23-c3a674960f67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:11:04Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a04f574-40dc-452c-8e79-ef5b59cf0a01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cea051bca120488c813353764418cfd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:11:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:11:04Z,use_quota=True,user_id='f73c0111124d48cc993df935e43612d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df49826d-cfda-4313-a9de-0ad88c8a3e3e),volume_type_id=df49826d-cfda-4313-a9de-0ad88c8a3e3e)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:04 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-134c7c7d-134b-405f-8be8-a85ce187b76f tempest-VolumeAndVolumeTypeFromImageTest-1224775445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1577fce-d497-4f5f-a01c-4281d27e4577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:04 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-134c7c7d-134b-405f-8be8-a85ce187b76f tempest-VolumeAndVolumeTypeFromImageTest-1224775445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1577fce-d497-4f5f-a01c-4281d27e4577) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:04 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-134c7c7d-134b-405f-8be8-a85ce187b76f tempest-VolumeAndVolumeTypeFromImageTest-1224775445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b957300-27d8-4b77-8a29-c5ff1e262704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:04 devstack cinder-volume[85458]: DEBUG cinder.image.glance [None req-134c7c7d-134b-405f-8be8-a85ce187b76f tempest-VolumeAndVolumeTypeFromImageTest-1224775445 None] Creating Keystone auth plugin from conf {{(pid=85458) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 17 22:11:04 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-9c8ca0ae-fd8a-4dd6-9c4b-b7a74e1fb2bd tempest-CreateVolumesFromImageTest-467947785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4f62d5d-596f-45a0-bfdc-f74059c255ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53c91d92-8615-4e22-8888-16d11f45d16a', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:04 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-9c8ca0ae-fd8a-4dd6-9c4b-b7a74e1fb2bd tempest-CreateVolumesFromImageTest-467947785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (753be7a7-24ed-4cc5-b7b2-caae93c54e6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:04 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a94ba21-0ce9-4777-ac24-877c5bc4773e tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 22:11:04 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-1a94ba21-0ce9-4777-ac24-877c5bc4773e tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Flow 'volume_create_manager' (f48a8b20-ef92-4f6a-a28c-8538ccf20eca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:11:04 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-1a94ba21-0ce9-4777-ac24-877c5bc4773e tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93075a63-cc75-4632-9466-1701143d1dc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:04 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-9c8ca0ae-fd8a-4dd6-9c4b-b7a74e1fb2bd tempest-CreateVolumesFromImageTest-467947785 None] Volume volume-53c91d92-8615-4e22-8888-16d11f45d16a (53c91d92-8615-4e22-8888-16d11f45d16a): created successfully Sep 17 22:11:04 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-9c8ca0ae-fd8a-4dd6-9c4b-b7a74e1fb2bd tempest-CreateVolumesFromImageTest-467947785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (753be7a7-24ed-4cc5-b7b2-caae93c54e6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:04 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-9c8ca0ae-fd8a-4dd6-9c4b-b7a74e1fb2bd tempest-CreateVolumesFromImageTest-467947785 None] Flow 'volume_create_manager' (03541031-b9a2-4639-9a13-298eab05e0db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:11:04 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-1a94ba21-0ce9-4777-ac24-877c5bc4773e tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93075a63-cc75-4632-9466-1701143d1dc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:11:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-112075774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8f716be-3dd9-487c-8bb8-d5c684dd82a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fca2e5554f39458694ef19aa1c2e0a3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:11:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:11:04Z,use_quota=True,user_id='9e3bf776ed4441c883eabadfac361819',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:04 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-1a94ba21-0ce9-4777-ac24-877c5bc4773e tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12de3a70-b4ac-42c0-a6ee-e925cc9a9978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:04 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-1a94ba21-0ce9-4777-ac24-877c5bc4773e tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12de3a70-b4ac-42c0-a6ee-e925cc9a9978) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:04 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-1a94ba21-0ce9-4777-ac24-877c5bc4773e tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8997654c-eeb1-4d70-8c33-84718e5e9dbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:04 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-1a94ba21-0ce9-4777-ac24-877c5bc4773e tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8997654c-eeb1-4d70-8c33-84718e5e9dbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8f716be-3dd9-487c-8bb8-d5c684dd82a2', 'volume_name': 'volume-f8f716be-3dd9-487c-8bb8-d5c684dd82a2', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:04 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-1a94ba21-0ce9-4777-ac24-877c5bc4773e tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74fcd9db-4fd1-4167-8e9d-40b2366bdc2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:04 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-1a94ba21-0ce9-4777-ac24-877c5bc4773e tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74fcd9db-4fd1-4167-8e9d-40b2366bdc2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:04 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-1a94ba21-0ce9-4777-ac24-877c5bc4773e tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (924f067e-6f4b-460a-a18c-3181c4381a20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:04 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-1a94ba21-0ce9-4777-ac24-877c5bc4773e tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Volume f8f716be-3dd9-487c-8bb8-d5c684dd82a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8f716be-3dd9-487c-8bb8-d5c684dd82a2', 'volume_size': 1} Sep 17 22:11:04 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-1a94ba21-0ce9-4777-ac24-877c5bc4773e tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:11:04 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-9c8ca0ae-fd8a-4dd6-9c4b-b7a74e1fb2bd tempest-CreateVolumesFromImageTest-467947785 None] Created volume successfully. Sep 17 22:11:04 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-01edc034-14fb-4f93-baf3-31a1493b1974 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 22:11:04 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-01edc034-14fb-4f93-baf3-31a1493b1974 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Flow 'volume_create_manager' (8f558790-dd39-4d5a-ad87-279e78c2d341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:11:04 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-01edc034-14fb-4f93-baf3-31a1493b1974 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05fdf01e-736b-46ab-ba62-460dda0a4e66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:04 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-01edc034-14fb-4f93-baf3-31a1493b1974 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05fdf01e-736b-46ab-ba62-460dda0a4e66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:11:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1838866964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e059f5c-485a-48f1-8558-2fe93ec4876e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fca2e5554f39458694ef19aa1c2e0a3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:11:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:11:05Z,use_quota=True,user_id='9e3bf776ed4441c883eabadfac361819',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:04 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-01edc034-14fb-4f93-baf3-31a1493b1974 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0a98c28-177d-4d7c-b828-d06a9aded5c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:04 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-01edc034-14fb-4f93-baf3-31a1493b1974 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0a98c28-177d-4d7c-b828-d06a9aded5c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:04 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-01edc034-14fb-4f93-baf3-31a1493b1974 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04cf79ec-e3cf-4dda-aed1-e7bc22559a8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:04 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-01edc034-14fb-4f93-baf3-31a1493b1974 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04cf79ec-e3cf-4dda-aed1-e7bc22559a8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e059f5c-485a-48f1-8558-2fe93ec4876e', 'volume_name': 'volume-4e059f5c-485a-48f1-8558-2fe93ec4876e', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:04 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-01edc034-14fb-4f93-baf3-31a1493b1974 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad3d81d1-d80b-423a-801b-e49d347a48ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:04 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-01edc034-14fb-4f93-baf3-31a1493b1974 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad3d81d1-d80b-423a-801b-e49d347a48ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:04 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-01edc034-14fb-4f93-baf3-31a1493b1974 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8bb7b1c-99f9-43f6-b694-88b48e68dc81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:04 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-01edc034-14fb-4f93-baf3-31a1493b1974 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Volume 4e059f5c-485a-48f1-8558-2fe93ec4876e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e059f5c-485a-48f1-8558-2fe93ec4876e', 'volume_size': 1} Sep 17 22:11:04 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-01edc034-14fb-4f93-baf3-31a1493b1974 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:11:04 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-134c7c7d-134b-405f-8be8-a85ce187b76f tempest-VolumeAndVolumeTypeFromImageTest-1224775445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b957300-27d8-4b77-8a29-c5ff1e262704) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0a04f574-40dc-452c-8e79-ef5b59cf0a01', 'volume_name': 'volume-0a04f574-40dc-452c-8e79-ef5b59cf0a01', 'volume_size': 1, 'image_id': '0d137fbd-12e6-4327-a79e-9da76a324e75', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0d137fbd-12e6-4327-a79e-9da76a324e75', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '608165f35d57ae62e8ead8e5e199b412', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'cea051bca120488c813353764418cfd9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '60a744f8a66bb7e235d27c192b1762ec0c43f1af5edff138e96b6bc21229779f192a049fd98f6aa74d8b741ebf68c356d6db46fc19e629a89ce4c6d4ba746bed', 'id': '0d137fbd-12e6-4327-a79e-9da76a324e75', 'created_at': datetime.datetime(2026, 9, 17, 20, 11, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 20, 11, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0d137fbd-12e6-4327-a79e-9da76a324e75/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:04 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-134c7c7d-134b-405f-8be8-a85ce187b76f tempest-VolumeAndVolumeTypeFromImageTest-1224775445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e707942a-6be6-4038-b433-552bba9a6d91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:04 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-134c7c7d-134b-405f-8be8-a85ce187b76f tempest-VolumeAndVolumeTypeFromImageTest-1224775445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e707942a-6be6-4038-b433-552bba9a6d91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:04 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-134c7c7d-134b-405f-8be8-a85ce187b76f tempest-VolumeAndVolumeTypeFromImageTest-1224775445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd8f7442-aa20-4469-a8e9-dff807b42931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:04 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-134c7c7d-134b-405f-8be8-a85ce187b76f tempest-VolumeAndVolumeTypeFromImageTest-1224775445 None] Volume 0a04f574-40dc-452c-8e79-ef5b59cf0a01: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0a04f574-40dc-452c-8e79-ef5b59cf0a01', 'volume_size': 1, 'image_id': '0d137fbd-12e6-4327-a79e-9da76a324e75', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0d137fbd-12e6-4327-a79e-9da76a324e75', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '608165f35d57ae62e8ead8e5e199b412', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'cea051bca120488c813353764418cfd9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '60a744f8a66bb7e235d27c192b1762ec0c43f1af5edff138e96b6bc21229779f192a049fd98f6aa74d8b741ebf68c356d6db46fc19e629a89ce4c6d4ba746bed', 'id': '0d137fbd-12e6-4327-a79e-9da76a324e75', 'created_at': datetime.datetime(2026, 9, 17, 20, 11, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 20, 11, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0d137fbd-12e6-4327-a79e-9da76a324e75/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 17 22:11:04 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-134c7c7d-134b-405f-8be8-a85ce187b76f tempest-VolumeAndVolumeTypeFromImageTest-1224775445 None] Trying to clone 0a04f574-40dc-452c-8e79-ef5b59cf0a01 from image 0d137fbd-12e6-4327-a79e-9da76a324e75 at location (None, [{'url': 'file:///opt/stack/data/glance/images/0d137fbd-12e6-4327-a79e-9da76a324e75', 'metadata': {}}]). {{(pid=85458) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 17 22:11:05 devstack cinder-volume[85458]: DEBUG cinder.image.image_utils [None req-134c7c7d-134b-405f-8be8-a85ce187b76f tempest-VolumeAndVolumeTypeFromImageTest-1224775445 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0d137fbd-12e6-4327-a79e-9da76a324e75_j8p86duvdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=85458) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 17 22:11:05 devstack cinder-volume[85458]: INFO cinder.image.image_utils [None req-134c7c7d-134b-405f-8be8-a85ce187b76f tempest-VolumeAndVolumeTypeFromImageTest-1224775445 None] Image download 0.00 MB at 0.00 MB/s Sep 17 22:11:05 devstack sudo[104349]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:05 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-10ad151d-6ef6-41ac-9196-507cfffab687 tempest-CreateVolumesFromImageTest-467947785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f6c680cc-d2fc-4eee-97ed-dc18b798d0c6 1073741824" returned: 0 in 0.540s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:05 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-10ad151d-6ef6-41ac-9196-507cfffab687 tempest-CreateVolumesFromImageTest-467947785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f6c680cc-d2fc-4eee-97ed-dc18b798d0c6 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:05 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f28ef96-6f79-46d3-89e7-c924fab589bf]: (4, 'raw') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:11:05 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-134c7c7d-134b-405f-8be8-a85ce187b76f tempest-VolumeAndVolumeTypeFromImageTest-1224775445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0d137fbd-12e6-4327-a79e-9da76a324e75_j8p86duvdevstack@QuobyteHD {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:05 devstack sudo[104355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f6c680cc-d2fc-4eee-97ed-dc18b798d0c6 Sep 17 22:11:05 devstack sudo[104355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:05 devstack sudo[104356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0d137fbd-12e6-4327-a79e-9da76a324e75_j8p86duvdevstack@QuobyteHD Sep 17 22:11:05 devstack sudo[104356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:05 devstack sudo[104355]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:05 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-10ad151d-6ef6-41ac-9196-507cfffab687 tempest-CreateVolumesFromImageTest-467947785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f6c680cc-d2fc-4eee-97ed-dc18b798d0c6" returned: 0 in 0.245s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:05 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-10ad151d-6ef6-41ac-9196-507cfffab687 tempest-CreateVolumesFromImageTest-467947785 None] <== create_volume: return (833ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 22:11:05 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-10ad151d-6ef6-41ac-9196-507cfffab687 tempest-CreateVolumesFromImageTest-467947785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.836s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:11:05 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-2267b7be-3b4b-41be-8517-9ef528d35275 tempest-CinderUnicodeTest-502091172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.036s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:11:05 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-2267b7be-3b4b-41be-8517-9ef528d35275 tempest-CinderUnicodeTest-502091172 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:11:01Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-904066976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5153193-2437-4b44-8d42-f07a9a670036,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea6e6be09d7e4895b55b3e3292f9a3fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:11:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:11:01Z,use_quota=True,user_id='a598a48bfa664848a24ec024754af276',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 22:11:05 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-2267b7be-3b4b-41be-8517-9ef528d35275 tempest-CinderUnicodeTest-502091172 None] Creating volume a5153193-2437-4b44-8d42-f07a9a670036 {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 22:11:05 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-2267b7be-3b4b-41be-8517-9ef528d35275 tempest-CinderUnicodeTest-502091172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:11:05 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-2267b7be-3b4b-41be-8517-9ef528d35275 tempest-CinderUnicodeTest-502091172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:11:05 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-2267b7be-3b4b-41be-8517-9ef528d35275 tempest-CinderUnicodeTest-502091172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:11:05 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-2267b7be-3b4b-41be-8517-9ef528d35275 tempest-CinderUnicodeTest-502091172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:11:05 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-2267b7be-3b4b-41be-8517-9ef528d35275 tempest-CinderUnicodeTest-502091172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:11:05 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-2267b7be-3b4b-41be-8517-9ef528d35275 tempest-CinderUnicodeTest-502091172 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 22:11:05 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-2267b7be-3b4b-41be-8517-9ef528d35275 tempest-CinderUnicodeTest-502091172 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 22:11:05 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-2267b7be-3b4b-41be-8517-9ef528d35275 tempest-CinderUnicodeTest-502091172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a5153193-2437-4b44-8d42-f07a9a670036 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:05 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-10ad151d-6ef6-41ac-9196-507cfffab687 tempest-CreateVolumesFromImageTest-467947785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e0d90f6-ebf2-4fa9-976d-0db845d1c143) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6c680cc-d2fc-4eee-97ed-dc18b798d0c6', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:05 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-10ad151d-6ef6-41ac-9196-507cfffab687 tempest-CreateVolumesFromImageTest-467947785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d2d6639-5a44-42ef-b548-d9e8c6cf11ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:05 devstack sudo[104360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a5153193-2437-4b44-8d42-f07a9a670036 1073741824 Sep 17 22:11:05 devstack sudo[104360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:05 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-10ad151d-6ef6-41ac-9196-507cfffab687 tempest-CreateVolumesFromImageTest-467947785 None] Volume volume-f6c680cc-d2fc-4eee-97ed-dc18b798d0c6 (f6c680cc-d2fc-4eee-97ed-dc18b798d0c6): created successfully Sep 17 22:11:05 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-10ad151d-6ef6-41ac-9196-507cfffab687 tempest-CreateVolumesFromImageTest-467947785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d2d6639-5a44-42ef-b548-d9e8c6cf11ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:05 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-10ad151d-6ef6-41ac-9196-507cfffab687 tempest-CreateVolumesFromImageTest-467947785 None] Flow 'volume_create_manager' (7fea9bb6-52b1-431c-9d8a-a26baa24bf8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:11:05 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-10ad151d-6ef6-41ac-9196-507cfffab687 tempest-CreateVolumesFromImageTest-467947785 None] Created volume successfully. Sep 17 22:11:05 devstack sudo[104356]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:05 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-134c7c7d-134b-405f-8be8-a85ce187b76f tempest-VolumeAndVolumeTypeFromImageTest-1224775445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0d137fbd-12e6-4327-a79e-9da76a324e75_j8p86duvdevstack@QuobyteHD" returned: 0 in 0.342s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:05 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-134c7c7d-134b-405f-8be8-a85ce187b76f tempest-VolumeAndVolumeTypeFromImageTest-1224775445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0d137fbd-12e6-4327-a79e-9da76a324e75_j8p86duvdevstack@QuobyteHD {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:05 devstack sudo[104364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0d137fbd-12e6-4327-a79e-9da76a324e75_j8p86duvdevstack@QuobyteHD Sep 17 22:11:05 devstack sudo[104364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:05 devstack sudo[104364]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:05 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-134c7c7d-134b-405f-8be8-a85ce187b76f tempest-VolumeAndVolumeTypeFromImageTest-1224775445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0d137fbd-12e6-4327-a79e-9da76a324e75_j8p86duvdevstack@QuobyteHD" returned: 1 in 0.344s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:05 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-134c7c7d-134b-405f-8be8-a85ce187b76f tempest-VolumeAndVolumeTypeFromImageTest-1224775445 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0d137fbd-12e6-4327-a79e-9da76a324e75_j8p86duvdevstack@QuobyteHD' failed. Not Retrying. {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 22:11:05 devstack cinder-volume[85458]: DEBUG cinder.image.image_utils [None req-134c7c7d-134b-405f-8be8-a85ce187b76f tempest-VolumeAndVolumeTypeFromImageTest-1224775445 None] Temporary image 0d137fbd-12e6-4327-a79e-9da76a324e75 is fetched for user f73c0111124d48cc993df935e43612d2. {{(pid=85458) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 17 22:11:05 devstack sudo[104360]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:05 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-2267b7be-3b4b-41be-8517-9ef528d35275 tempest-CinderUnicodeTest-502091172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a5153193-2437-4b44-8d42-f07a9a670036 1073741824" returned: 0 in 0.464s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:05 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-2267b7be-3b4b-41be-8517-9ef528d35275 tempest-CinderUnicodeTest-502091172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a5153193-2437-4b44-8d42-f07a9a670036 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:05 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a7e90a7-5906-4532-94f3-9949ca53a72f]: (4, 'raw') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:11:05 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-134c7c7d-134b-405f-8be8-a85ce187b76f tempest-VolumeAndVolumeTypeFromImageTest-1224775445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0d137fbd-12e6-4327-a79e-9da76a324e75_j8p86duvdevstack@QuobyteHD {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:05 devstack sudo[104372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a5153193-2437-4b44-8d42-f07a9a670036 Sep 17 22:11:05 devstack sudo[104372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:06 devstack sudo[104373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0d137fbd-12e6-4327-a79e-9da76a324e75_j8p86duvdevstack@QuobyteHD Sep 17 22:11:06 devstack sudo[104373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:06 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-eda5ebef-cbd9-46d0-9b22-05e5979a39b0 tempest-CreateVolumesFromImageTest-467947785 None] Acquiring lock "cinder-f6c680cc-d2fc-4eee-97ed-dc18b798d0c6-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:11:06 devstack sudo[104372]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:06 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-2267b7be-3b4b-41be-8517-9ef528d35275 tempest-CinderUnicodeTest-502091172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a5153193-2437-4b44-8d42-f07a9a670036" returned: 0 in 0.282s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:06 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-2267b7be-3b4b-41be-8517-9ef528d35275 tempest-CinderUnicodeTest-502091172 None] <== create_volume: return (802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 22:11:06 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-2267b7be-3b4b-41be-8517-9ef528d35275 tempest-CinderUnicodeTest-502091172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.805s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:11:06 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-3e181557-9639-4875-b16e-19460d877e3b tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.033s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:11:06 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-3e181557-9639-4875-b16e-19460d877e3b tempest-CreateVolumesFromSourceVolumeTest-191538477 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:11:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1653786166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2071b381-05b2-47ca-80f9-24c058d7b1b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fca2e5554f39458694ef19aa1c2e0a3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:11:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:11:03Z,use_quota=True,user_id='9e3bf776ed4441c883eabadfac361819',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 22:11:06 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-3e181557-9639-4875-b16e-19460d877e3b tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Creating volume 2071b381-05b2-47ca-80f9-24c058d7b1b1 {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 22:11:06 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-3e181557-9639-4875-b16e-19460d877e3b tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:11:06 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-3e181557-9639-4875-b16e-19460d877e3b tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:11:06 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-3e181557-9639-4875-b16e-19460d877e3b tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:11:06 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-3e181557-9639-4875-b16e-19460d877e3b tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:11:06 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-3e181557-9639-4875-b16e-19460d877e3b tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:11:06 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-3e181557-9639-4875-b16e-19460d877e3b tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 22:11:06 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-3e181557-9639-4875-b16e-19460d877e3b tempest-CreateVolumesFromSourceVolumeTest-191538477 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 22:11:06 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-3e181557-9639-4875-b16e-19460d877e3b tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-2071b381-05b2-47ca-80f9-24c058d7b1b1 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:06 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-eda5ebef-cbd9-46d0-9b22-05e5979a39b0 tempest-CreateVolumesFromImageTest-467947785 None] Lock "cinder-f6c680cc-d2fc-4eee-97ed-dc18b798d0c6-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:11:06 devstack sudo[104377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-2071b381-05b2-47ca-80f9-24c058d7b1b1 1073741824 Sep 17 22:11:06 devstack sudo[104377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:06 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-2267b7be-3b4b-41be-8517-9ef528d35275 tempest-CinderUnicodeTest-502091172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43590e02-e1c6-4a2f-a8e4-48a753169b09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5153193-2437-4b44-8d42-f07a9a670036', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:06 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-2267b7be-3b4b-41be-8517-9ef528d35275 tempest-CinderUnicodeTest-502091172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41a74a36-048b-4dc8-86cb-7c8bb5cbea60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:06 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-2267b7be-3b4b-41be-8517-9ef528d35275 tempest-CinderUnicodeTest-502091172 None] Volume volume-a5153193-2437-4b44-8d42-f07a9a670036 (a5153193-2437-4b44-8d42-f07a9a670036): created successfully Sep 17 22:11:06 devstack sudo[104373]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:06 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-2267b7be-3b4b-41be-8517-9ef528d35275 tempest-CinderUnicodeTest-502091172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41a74a36-048b-4dc8-86cb-7c8bb5cbea60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:06 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-2267b7be-3b4b-41be-8517-9ef528d35275 tempest-CinderUnicodeTest-502091172 None] Flow 'volume_create_manager' (1de266b8-549a-4a18-aea9-465f9b174c9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:11:06 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-134c7c7d-134b-405f-8be8-a85ce187b76f tempest-VolumeAndVolumeTypeFromImageTest-1224775445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0d137fbd-12e6-4327-a79e-9da76a324e75_j8p86duvdevstack@QuobyteHD" returned: 0 in 0.386s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:06 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-134c7c7d-134b-405f-8be8-a85ce187b76f tempest-VolumeAndVolumeTypeFromImageTest-1224775445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0d137fbd-12e6-4327-a79e-9da76a324e75_j8p86duvdevstack@QuobyteHD {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:06 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-2267b7be-3b4b-41be-8517-9ef528d35275 tempest-CinderUnicodeTest-502091172 None] Created volume successfully. Sep 17 22:11:06 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-eda5ebef-cbd9-46d0-9b22-05e5979a39b0 tempest-CreateVolumesFromImageTest-467947785 None] Acquiring lock "cinder-quobyte-f6c680cc-d2fc-4eee-97ed-dc18b798d0c6" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:11:06 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-eda5ebef-cbd9-46d0-9b22-05e5979a39b0 tempest-CreateVolumesFromImageTest-467947785 None] Lock "cinder-quobyte-f6c680cc-d2fc-4eee-97ed-dc18b798d0c6" acquired by "delete_volume" :: waited 0.018s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:11:06 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbf188dd-c830-4090-a36a-fe07a7e930d6]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:11:06 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-eda5ebef-cbd9-46d0-9b22-05e5979a39b0 tempest-CreateVolumesFromImageTest-467947785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f6c680cc-d2fc-4eee-97ed-dc18b798d0c6 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:06 devstack sudo[104381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0d137fbd-12e6-4327-a79e-9da76a324e75_j8p86duvdevstack@QuobyteHD Sep 17 22:11:06 devstack sudo[104381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:06 devstack sudo[104382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f6c680cc-d2fc-4eee-97ed-dc18b798d0c6 Sep 17 22:11:06 devstack sudo[104382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:06 devstack sudo[104381]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:06 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-134c7c7d-134b-405f-8be8-a85ce187b76f tempest-VolumeAndVolumeTypeFromImageTest-1224775445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0d137fbd-12e6-4327-a79e-9da76a324e75_j8p86duvdevstack@QuobyteHD" returned: 1 in 0.351s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:06 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-134c7c7d-134b-405f-8be8-a85ce187b76f tempest-VolumeAndVolumeTypeFromImageTest-1224775445 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0d137fbd-12e6-4327-a79e-9da76a324e75_j8p86duvdevstack@QuobyteHD' failed. Not Retrying. {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 22:11:06 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-134c7c7d-134b-405f-8be8-a85ce187b76f tempest-VolumeAndVolumeTypeFromImageTest-1224775445 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:11:06 devstack sudo[104377]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:06 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-3e181557-9639-4875-b16e-19460d877e3b tempest-CreateVolumesFromSourceVolumeTest-191538477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-2071b381-05b2-47ca-80f9-24c058d7b1b1 1073741824" returned: 0 in 0.544s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:06 devstack sudo[104382]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:06 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-3e181557-9639-4875-b16e-19460d877e3b tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-2071b381-05b2-47ca-80f9-24c058d7b1b1 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:06 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-eda5ebef-cbd9-46d0-9b22-05e5979a39b0 tempest-CreateVolumesFromImageTest-467947785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f6c680cc-d2fc-4eee-97ed-dc18b798d0c6" returned: 0 in 0.430s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:06 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-eda5ebef-cbd9-46d0-9b22-05e5979a39b0 tempest-CreateVolumesFromImageTest-467947785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f6c680cc-d2fc-4eee-97ed-dc18b798d0c6 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:06 devstack sudo[104395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-2071b381-05b2-47ca-80f9-24c058d7b1b1 Sep 17 22:11:06 devstack sudo[104395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:06 devstack sudo[104396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f6c680cc-d2fc-4eee-97ed-dc18b798d0c6 Sep 17 22:11:06 devstack sudo[104396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:06 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-351d7c47-0fce-48ed-8719-e697cce1de32 tempest-CinderUnicodeTest-502091172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:11:07 devstack sudo[104395]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:07 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-3e181557-9639-4875-b16e-19460d877e3b tempest-CreateVolumesFromSourceVolumeTest-191538477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-2071b381-05b2-47ca-80f9-24c058d7b1b1" returned: 0 in 0.290s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:07 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-3e181557-9639-4875-b16e-19460d877e3b tempest-CreateVolumesFromSourceVolumeTest-191538477 None] <== create_volume: return (893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 22:11:07 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-3e181557-9639-4875-b16e-19460d877e3b tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.895s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:11:07 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-70457a52-abe5-4474-a038-776556509106 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.491s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:11:07 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-70457a52-abe5-4474-a038-776556509106 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:11:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-87317255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2cc7187-c81e-4c2d-b5de-3cbe569fd11f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fca2e5554f39458694ef19aa1c2e0a3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:11:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:11:03Z,use_quota=True,user_id='9e3bf776ed4441c883eabadfac361819',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 22:11:07 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-70457a52-abe5-4474-a038-776556509106 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Creating volume d2cc7187-c81e-4c2d-b5de-3cbe569fd11f {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 22:11:07 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-70457a52-abe5-4474-a038-776556509106 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:11:07 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-70457a52-abe5-4474-a038-776556509106 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:11:07 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-70457a52-abe5-4474-a038-776556509106 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:11:07 devstack sudo[104396]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:07 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-70457a52-abe5-4474-a038-776556509106 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:11:07 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-70457a52-abe5-4474-a038-776556509106 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:11:07 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-70457a52-abe5-4474-a038-776556509106 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 22:11:07 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-70457a52-abe5-4474-a038-776556509106 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 22:11:07 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-70457a52-abe5-4474-a038-776556509106 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-d2cc7187-c81e-4c2d-b5de-3cbe569fd11f 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:07 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-eda5ebef-cbd9-46d0-9b22-05e5979a39b0 tempest-CreateVolumesFromImageTest-467947785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f6c680cc-d2fc-4eee-97ed-dc18b798d0c6" returned: 0 in 0.306s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:07 devstack sudo[104401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-d2cc7187-c81e-4c2d-b5de-3cbe569fd11f 1073741824 Sep 17 22:11:07 devstack sudo[104401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:07 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-3e181557-9639-4875-b16e-19460d877e3b tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43ebdf77-2197-4e5b-8237-2c02887a438b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2071b381-05b2-47ca-80f9-24c058d7b1b1', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:07 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-3e181557-9639-4875-b16e-19460d877e3b tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03ca558c-0345-4fcb-bf9e-f44d48765dae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:07 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-eda5ebef-cbd9-46d0-9b22-05e5979a39b0 tempest-CreateVolumesFromImageTest-467947785 None] Lock "cinder-quobyte-f6c680cc-d2fc-4eee-97ed-dc18b798d0c6" released by "delete_volume" :: held 0.798s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:11:07 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-3e181557-9639-4875-b16e-19460d877e3b tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Volume volume-2071b381-05b2-47ca-80f9-24c058d7b1b1 (2071b381-05b2-47ca-80f9-24c058d7b1b1): created successfully Sep 17 22:11:07 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-3e181557-9639-4875-b16e-19460d877e3b tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03ca558c-0345-4fcb-bf9e-f44d48765dae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:07 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-3e181557-9639-4875-b16e-19460d877e3b tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Flow 'volume_create_manager' (44f01c55-137f-4e16-8af3-8e46d97396a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:11:07 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-3e181557-9639-4875-b16e-19460d877e3b tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Created volume successfully. Sep 17 22:11:07 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-eda5ebef-cbd9-46d0-9b22-05e5979a39b0 tempest-CreateVolumesFromImageTest-467947785 None] Created reservations ['2eb90bee-8864-43d1-be72-00b5b2e06f96', '9d62371b-e12b-4596-a316-416d93a746e9', '63960fb3-5a9c-4d12-ba90-843453545a8f', '5d7a5d56-ff20-4fad-9ccc-9714c617b98a'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:11:07 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-eda5ebef-cbd9-46d0-9b22-05e5979a39b0 tempest-CreateVolumesFromImageTest-467947785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:11:07 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-eda5ebef-cbd9-46d0-9b22-05e5979a39b0 tempest-CreateVolumesFromImageTest-467947785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:11:07 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-eda5ebef-cbd9-46d0-9b22-05e5979a39b0 tempest-CreateVolumesFromImageTest-467947785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:11:07 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-eda5ebef-cbd9-46d0-9b22-05e5979a39b0 tempest-CreateVolumesFromImageTest-467947785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:11:07 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-eda5ebef-cbd9-46d0-9b22-05e5979a39b0 tempest-CreateVolumesFromImageTest-467947785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:11:07 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-eda5ebef-cbd9-46d0-9b22-05e5979a39b0 tempest-CreateVolumesFromImageTest-467947785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:07 devstack sudo[104405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:11:07 devstack sudo[104405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:07 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-a5763e86-784a-41e4-9614-11b1f491ce24 tempest-CreateVolumesFromImageTest-467947785 None] Acquiring lock "cinder-53c91d92-8615-4e22-8888-16d11f45d16a-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:11:07 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-a5763e86-784a-41e4-9614-11b1f491ce24 tempest-CreateVolumesFromImageTest-467947785 None] Lock "cinder-53c91d92-8615-4e22-8888-16d11f45d16a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:11:07 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-a5763e86-784a-41e4-9614-11b1f491ce24 tempest-CreateVolumesFromImageTest-467947785 None] Acquiring lock "cinder-quobyte-53c91d92-8615-4e22-8888-16d11f45d16a" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:11:07 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-a5763e86-784a-41e4-9614-11b1f491ce24 tempest-CreateVolumesFromImageTest-467947785 None] Lock "cinder-quobyte-53c91d92-8615-4e22-8888-16d11f45d16a" acquired by "delete_volume" :: waited 0.022s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:11:07 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[a229d202-5335-4005-9690-54c9074570bd]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:11:07 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a5763e86-784a-41e4-9614-11b1f491ce24 tempest-CreateVolumesFromImageTest-467947785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-53c91d92-8615-4e22-8888-16d11f45d16a {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:07 devstack sudo[104401]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:07 devstack sudo[104405]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:07 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-70457a52-abe5-4474-a038-776556509106 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-d2cc7187-c81e-4c2d-b5de-3cbe569fd11f 1073741824" returned: 0 in 0.514s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:07 devstack sudo[104408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-53c91d92-8615-4e22-8888-16d11f45d16a Sep 17 22:11:07 devstack sudo[104408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:07 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-eda5ebef-cbd9-46d0-9b22-05e5979a39b0 tempest-CreateVolumesFromImageTest-467947785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.313s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:07 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-eda5ebef-cbd9-46d0-9b22-05e5979a39b0 tempest-CreateVolumesFromImageTest-467947785 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:11:07 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-eda5ebef-cbd9-46d0-9b22-05e5979a39b0 tempest-CreateVolumesFromImageTest-467947785 None] Deleted volume successfully. Sep 17 22:11:07 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-70457a52-abe5-4474-a038-776556509106 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-d2cc7187-c81e-4c2d-b5de-3cbe569fd11f {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:07 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-eda5ebef-cbd9-46d0-9b22-05e5979a39b0 tempest-CreateVolumesFromImageTest-467947785 None] Lock "cinder-f6c680cc-d2fc-4eee-97ed-dc18b798d0c6-delete_volume" released by "delete_volume" :: held 1.431s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:11:07 devstack sudo[104411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-d2cc7187-c81e-4c2d-b5de-3cbe569fd11f Sep 17 22:11:07 devstack sudo[104411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:07 devstack sudo[104408]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:07 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a5763e86-784a-41e4-9614-11b1f491ce24 tempest-CreateVolumesFromImageTest-467947785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-53c91d92-8615-4e22-8888-16d11f45d16a" returned: 0 in 0.413s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:07 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a5763e86-784a-41e4-9614-11b1f491ce24 tempest-CreateVolumesFromImageTest-467947785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-53c91d92-8615-4e22-8888-16d11f45d16a {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:07 devstack sudo[104411]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:07 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-70457a52-abe5-4474-a038-776556509106 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-d2cc7187-c81e-4c2d-b5de-3cbe569fd11f" returned: 0 in 0.272s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:07 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-70457a52-abe5-4474-a038-776556509106 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] <== create_volume: return (840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 22:11:07 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-70457a52-abe5-4474-a038-776556509106 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.843s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:11:07 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-d6e4039c-d0b0-490d-ad64-9c8ed4a9db1a tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.514s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:11:07 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-d6e4039c-d0b0-490d-ad64-9c8ed4a9db1a tempest-CreateVolumesFromSourceVolumeTest-191538477 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:11:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2102614815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9317c1bf-893f-4f1b-b995-749a0b15458c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fca2e5554f39458694ef19aa1c2e0a3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:11:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:11:04Z,use_quota=True,user_id='9e3bf776ed4441c883eabadfac361819',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 22:11:07 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-d6e4039c-d0b0-490d-ad64-9c8ed4a9db1a tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Creating volume 9317c1bf-893f-4f1b-b995-749a0b15458c {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 22:11:07 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-d6e4039c-d0b0-490d-ad64-9c8ed4a9db1a tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:11:07 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-d6e4039c-d0b0-490d-ad64-9c8ed4a9db1a tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:11:07 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-d6e4039c-d0b0-490d-ad64-9c8ed4a9db1a tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:11:07 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-d6e4039c-d0b0-490d-ad64-9c8ed4a9db1a tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:11:07 devstack sudo[104417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-53c91d92-8615-4e22-8888-16d11f45d16a Sep 17 22:11:07 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-d6e4039c-d0b0-490d-ad64-9c8ed4a9db1a tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:11:07 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-d6e4039c-d0b0-490d-ad64-9c8ed4a9db1a tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 22:11:07 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-d6e4039c-d0b0-490d-ad64-9c8ed4a9db1a tempest-CreateVolumesFromSourceVolumeTest-191538477 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 22:11:07 devstack sudo[104417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:07 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-d6e4039c-d0b0-490d-ad64-9c8ed4a9db1a tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-9317c1bf-893f-4f1b-b995-749a0b15458c 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:07 devstack sudo[104419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-9317c1bf-893f-4f1b-b995-749a0b15458c 1073741824 Sep 17 22:11:07 devstack sudo[104419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:07 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-70457a52-abe5-4474-a038-776556509106 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0a56973-091d-4917-827b-572915260786) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2cc7187-c81e-4c2d-b5de-3cbe569fd11f', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:07 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-70457a52-abe5-4474-a038-776556509106 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9b672b9-80f6-4d22-9a29-80c2e2156797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:08 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-70457a52-abe5-4474-a038-776556509106 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Volume volume-d2cc7187-c81e-4c2d-b5de-3cbe569fd11f (d2cc7187-c81e-4c2d-b5de-3cbe569fd11f): created successfully Sep 17 22:11:08 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-70457a52-abe5-4474-a038-776556509106 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9b672b9-80f6-4d22-9a29-80c2e2156797) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:08 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-70457a52-abe5-4474-a038-776556509106 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Flow 'volume_create_manager' (475db5f4-2524-489d-805d-7a498036cd8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:11:08 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-70457a52-abe5-4474-a038-776556509106 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Created volume successfully. Sep 17 22:11:08 devstack sudo[104417]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:08 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a5763e86-784a-41e4-9614-11b1f491ce24 tempest-CreateVolumesFromImageTest-467947785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-53c91d92-8615-4e22-8888-16d11f45d16a" returned: 0 in 0.258s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:08 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-a5763e86-784a-41e4-9614-11b1f491ce24 tempest-CreateVolumesFromImageTest-467947785 None] Lock "cinder-quobyte-53c91d92-8615-4e22-8888-16d11f45d16a" released by "delete_volume" :: held 0.723s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:11:08 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-a5763e86-784a-41e4-9614-11b1f491ce24 tempest-CreateVolumesFromImageTest-467947785 None] Created reservations ['b650de68-3c8c-4cdf-96e1-3e8cf16d9ac8', '1a587201-6fb7-4ddd-82e5-95ed4a991960', '47ddf79f-2db1-4d15-9703-7cae4e60b39a', 'a94f8fc2-0e3a-47a0-b66e-a0c20683d9a9'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:11:08 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-a5763e86-784a-41e4-9614-11b1f491ce24 tempest-CreateVolumesFromImageTest-467947785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:11:08 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-a5763e86-784a-41e4-9614-11b1f491ce24 tempest-CreateVolumesFromImageTest-467947785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:11:08 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-a5763e86-784a-41e4-9614-11b1f491ce24 tempest-CreateVolumesFromImageTest-467947785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:11:08 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-a5763e86-784a-41e4-9614-11b1f491ce24 tempest-CreateVolumesFromImageTest-467947785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:11:08 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-a5763e86-784a-41e4-9614-11b1f491ce24 tempest-CreateVolumesFromImageTest-467947785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:11:08 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a5763e86-784a-41e4-9614-11b1f491ce24 tempest-CreateVolumesFromImageTest-467947785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:08 devstack sudo[104426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:11:08 devstack sudo[104426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:08 devstack sudo[104419]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:08 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-d6e4039c-d0b0-490d-ad64-9c8ed4a9db1a tempest-CreateVolumesFromSourceVolumeTest-191538477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-9317c1bf-893f-4f1b-b995-749a0b15458c 1073741824" returned: 0 in 0.516s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:08 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-d6e4039c-d0b0-490d-ad64-9c8ed4a9db1a tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-9317c1bf-893f-4f1b-b995-749a0b15458c {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:08 devstack sudo[104428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-9317c1bf-893f-4f1b-b995-749a0b15458c Sep 17 22:11:08 devstack sudo[104428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:08 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-01b213c4-d5a0-43aa-adcd-718f1fc5ed1c tempest-CreateVolumesFromImageTest-467947785 None] Acquiring lock "cinder-c8b42727-eee0-432a-973a-ee5651c7827b-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:11:08 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-01b213c4-d5a0-43aa-adcd-718f1fc5ed1c tempest-CreateVolumesFromImageTest-467947785 None] Lock "cinder-c8b42727-eee0-432a-973a-ee5651c7827b-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:11:08 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-01b213c4-d5a0-43aa-adcd-718f1fc5ed1c tempest-CreateVolumesFromImageTest-467947785 None] Acquiring lock "cinder-quobyte-c8b42727-eee0-432a-973a-ee5651c7827b" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:11:08 devstack sudo[104426]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:08 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a5763e86-784a-41e4-9614-11b1f491ce24 tempest-CreateVolumesFromImageTest-467947785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.295s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:08 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-01b213c4-d5a0-43aa-adcd-718f1fc5ed1c tempest-CreateVolumesFromImageTest-467947785 None] Lock "cinder-quobyte-c8b42727-eee0-432a-973a-ee5651c7827b" acquired by "delete_volume" :: waited 0.018s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:11:08 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-a5763e86-784a-41e4-9614-11b1f491ce24 tempest-CreateVolumesFromImageTest-467947785 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:11:08 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-a5763e86-784a-41e4-9614-11b1f491ce24 tempest-CreateVolumesFromImageTest-467947785 None] Deleted volume successfully. Sep 17 22:11:08 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[fce3301e-8869-4c1a-915e-e257f78642a9]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:11:08 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-01b213c4-d5a0-43aa-adcd-718f1fc5ed1c tempest-CreateVolumesFromImageTest-467947785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c8b42727-eee0-432a-973a-ee5651c7827b {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:08 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-a5763e86-784a-41e4-9614-11b1f491ce24 tempest-CreateVolumesFromImageTest-467947785 None] Lock "cinder-53c91d92-8615-4e22-8888-16d11f45d16a-delete_volume" released by "delete_volume" :: held 1.298s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:11:08 devstack sudo[104428]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:08 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-d6e4039c-d0b0-490d-ad64-9c8ed4a9db1a tempest-CreateVolumesFromSourceVolumeTest-191538477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-9317c1bf-893f-4f1b-b995-749a0b15458c" returned: 0 in 0.275s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:08 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-d6e4039c-d0b0-490d-ad64-9c8ed4a9db1a tempest-CreateVolumesFromSourceVolumeTest-191538477 None] <== create_volume: return (836ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 22:11:08 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-d6e4039c-d0b0-490d-ad64-9c8ed4a9db1a tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.840s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:11:08 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-1a94ba21-0ce9-4777-ac24-877c5bc4773e tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.983s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:11:08 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-1a94ba21-0ce9-4777-ac24-877c5bc4773e tempest-CreateVolumesFromSourceVolumeTest-191538477 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:11:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-112075774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8f716be-3dd9-487c-8bb8-d5c684dd82a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fca2e5554f39458694ef19aa1c2e0a3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:11:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:11:04Z,use_quota=True,user_id='9e3bf776ed4441c883eabadfac361819',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 22:11:08 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-1a94ba21-0ce9-4777-ac24-877c5bc4773e tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Creating volume f8f716be-3dd9-487c-8bb8-d5c684dd82a2 {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 22:11:08 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-1a94ba21-0ce9-4777-ac24-877c5bc4773e tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:11:08 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-1a94ba21-0ce9-4777-ac24-877c5bc4773e tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:11:08 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-1a94ba21-0ce9-4777-ac24-877c5bc4773e tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:11:08 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-1a94ba21-0ce9-4777-ac24-877c5bc4773e tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:11:08 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-1a94ba21-0ce9-4777-ac24-877c5bc4773e tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:11:08 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-1a94ba21-0ce9-4777-ac24-877c5bc4773e tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 22:11:08 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-1a94ba21-0ce9-4777-ac24-877c5bc4773e tempest-CreateVolumesFromSourceVolumeTest-191538477 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 22:11:08 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-1a94ba21-0ce9-4777-ac24-877c5bc4773e tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f8f716be-3dd9-487c-8bb8-d5c684dd82a2 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:08 devstack sudo[104431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c8b42727-eee0-432a-973a-ee5651c7827b Sep 17 22:11:08 devstack sudo[104431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:08 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-d6e4039c-d0b0-490d-ad64-9c8ed4a9db1a tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54a35285-4d76-4f36-8339-a7dfcefbd71c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9317c1bf-893f-4f1b-b995-749a0b15458c', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:08 devstack sudo[104434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f8f716be-3dd9-487c-8bb8-d5c684dd82a2 1073741824 Sep 17 22:11:08 devstack sudo[104434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:08 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-d6e4039c-d0b0-490d-ad64-9c8ed4a9db1a tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3f1cdda-f822-4eba-803f-648958e8f806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:08 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-d6e4039c-d0b0-490d-ad64-9c8ed4a9db1a tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Volume volume-9317c1bf-893f-4f1b-b995-749a0b15458c (9317c1bf-893f-4f1b-b995-749a0b15458c): created successfully Sep 17 22:11:08 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-d6e4039c-d0b0-490d-ad64-9c8ed4a9db1a tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3f1cdda-f822-4eba-803f-648958e8f806) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:08 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-d6e4039c-d0b0-490d-ad64-9c8ed4a9db1a tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Flow 'volume_create_manager' (dfd1f3b4-295a-49ca-82b4-6940f9f24a83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:11:08 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-d6e4039c-d0b0-490d-ad64-9c8ed4a9db1a tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Created volume successfully. Sep 17 22:11:09 devstack sudo[104431]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:09 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-01b213c4-d5a0-43aa-adcd-718f1fc5ed1c tempest-CreateVolumesFromImageTest-467947785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c8b42727-eee0-432a-973a-ee5651c7827b" returned: 0 in 0.405s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:09 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-01b213c4-d5a0-43aa-adcd-718f1fc5ed1c tempest-CreateVolumesFromImageTest-467947785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c8b42727-eee0-432a-973a-ee5651c7827b {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:09 devstack sudo[104442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c8b42727-eee0-432a-973a-ee5651c7827b Sep 17 22:11:09 devstack sudo[104442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:09 devstack sudo[104434]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:09 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-1a94ba21-0ce9-4777-ac24-877c5bc4773e tempest-CreateVolumesFromSourceVolumeTest-191538477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f8f716be-3dd9-487c-8bb8-d5c684dd82a2 1073741824" returned: 0 in 0.498s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:09 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-1a94ba21-0ce9-4777-ac24-877c5bc4773e tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f8f716be-3dd9-487c-8bb8-d5c684dd82a2 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:09 devstack sudo[104442]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:09 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-01b213c4-d5a0-43aa-adcd-718f1fc5ed1c tempest-CreateVolumesFromImageTest-467947785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c8b42727-eee0-432a-973a-ee5651c7827b" returned: 0 in 0.255s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:09 devstack sudo[104446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f8f716be-3dd9-487c-8bb8-d5c684dd82a2 Sep 17 22:11:09 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-01b213c4-d5a0-43aa-adcd-718f1fc5ed1c tempest-CreateVolumesFromImageTest-467947785 None] Lock "cinder-quobyte-c8b42727-eee0-432a-973a-ee5651c7827b" released by "delete_volume" :: held 0.714s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:11:09 devstack sudo[104446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:09 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-01b213c4-d5a0-43aa-adcd-718f1fc5ed1c tempest-CreateVolumesFromImageTest-467947785 None] Created reservations ['be60140e-bdf0-4624-86d6-bdf982f1f996', '67fde6cc-ef34-4c08-8515-ce6b23dbf57c', '13b3c6e7-f4a0-45d5-b8a1-75b32e2c88f2', '2ffa6bf5-a851-4e68-a537-f5be3ef79439'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:11:09 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-01b213c4-d5a0-43aa-adcd-718f1fc5ed1c tempest-CreateVolumesFromImageTest-467947785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:11:09 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-01b213c4-d5a0-43aa-adcd-718f1fc5ed1c tempest-CreateVolumesFromImageTest-467947785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:11:09 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-01b213c4-d5a0-43aa-adcd-718f1fc5ed1c tempest-CreateVolumesFromImageTest-467947785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:11:09 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-01b213c4-d5a0-43aa-adcd-718f1fc5ed1c tempest-CreateVolumesFromImageTest-467947785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:11:09 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-01b213c4-d5a0-43aa-adcd-718f1fc5ed1c tempest-CreateVolumesFromImageTest-467947785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:11:09 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-01b213c4-d5a0-43aa-adcd-718f1fc5ed1c tempest-CreateVolumesFromImageTest-467947785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:09 devstack sudo[104448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:11:09 devstack sudo[104448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:09 devstack sudo[104446]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:09 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-1a94ba21-0ce9-4777-ac24-877c5bc4773e tempest-CreateVolumesFromSourceVolumeTest-191538477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f8f716be-3dd9-487c-8bb8-d5c684dd82a2" returned: 0 in 0.275s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:09 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-1a94ba21-0ce9-4777-ac24-877c5bc4773e tempest-CreateVolumesFromSourceVolumeTest-191538477 None] <== create_volume: return (820ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 22:11:09 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-1a94ba21-0ce9-4777-ac24-877c5bc4773e tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.824s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:11:09 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-01edc034-14fb-4f93-baf3-31a1493b1974 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.706s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:11:09 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-01edc034-14fb-4f93-baf3-31a1493b1974 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:11:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1838866964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e059f5c-485a-48f1-8558-2fe93ec4876e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fca2e5554f39458694ef19aa1c2e0a3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:11:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:11:05Z,use_quota=True,user_id='9e3bf776ed4441c883eabadfac361819',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 22:11:09 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-01edc034-14fb-4f93-baf3-31a1493b1974 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Creating volume 4e059f5c-485a-48f1-8558-2fe93ec4876e {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 22:11:09 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-01edc034-14fb-4f93-baf3-31a1493b1974 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:11:09 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-01edc034-14fb-4f93-baf3-31a1493b1974 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:11:09 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-01edc034-14fb-4f93-baf3-31a1493b1974 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:11:09 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-01edc034-14fb-4f93-baf3-31a1493b1974 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:11:09 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-01edc034-14fb-4f93-baf3-31a1493b1974 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:11:09 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-01edc034-14fb-4f93-baf3-31a1493b1974 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 22:11:09 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-01edc034-14fb-4f93-baf3-31a1493b1974 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 22:11:09 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-01edc034-14fb-4f93-baf3-31a1493b1974 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-4e059f5c-485a-48f1-8558-2fe93ec4876e 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:09 devstack sudo[104452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-4e059f5c-485a-48f1-8558-2fe93ec4876e 1073741824 Sep 17 22:11:09 devstack sudo[104452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:09 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-1a94ba21-0ce9-4777-ac24-877c5bc4773e tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (924f067e-6f4b-460a-a18c-3181c4381a20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8f716be-3dd9-487c-8bb8-d5c684dd82a2', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:09 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-1a94ba21-0ce9-4777-ac24-877c5bc4773e tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6247ec53-ae67-4c2f-8ca0-de975af44d97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:09 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-1a94ba21-0ce9-4777-ac24-877c5bc4773e tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Volume volume-f8f716be-3dd9-487c-8bb8-d5c684dd82a2 (f8f716be-3dd9-487c-8bb8-d5c684dd82a2): created successfully Sep 17 22:11:09 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-1a94ba21-0ce9-4777-ac24-877c5bc4773e tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6247ec53-ae67-4c2f-8ca0-de975af44d97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:09 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-1a94ba21-0ce9-4777-ac24-877c5bc4773e tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Flow 'volume_create_manager' (f48a8b20-ef92-4f6a-a28c-8538ccf20eca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:11:09 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-1a94ba21-0ce9-4777-ac24-877c5bc4773e tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Created volume successfully. Sep 17 22:11:09 devstack sudo[104448]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:09 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-01b213c4-d5a0-43aa-adcd-718f1fc5ed1c tempest-CreateVolumesFromImageTest-467947785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.272s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:09 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-01b213c4-d5a0-43aa-adcd-718f1fc5ed1c tempest-CreateVolumesFromImageTest-467947785 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:11:09 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-01b213c4-d5a0-43aa-adcd-718f1fc5ed1c tempest-CreateVolumesFromImageTest-467947785 None] Deleted volume successfully. Sep 17 22:11:09 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-01b213c4-d5a0-43aa-adcd-718f1fc5ed1c tempest-CreateVolumesFromImageTest-467947785 None] Lock "cinder-c8b42727-eee0-432a-973a-ee5651c7827b-delete_volume" released by "delete_volume" :: held 1.175s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:11:09 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-66261b09-ea68-4633-bc0c-ba9ad8a51bc5 tempest-CreateVolumesFromImageTest-467947785 None] Acquiring lock "cinder-c50c2fd0-3c5b-4cf2-a002-b55cf1be89bc-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:11:09 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-66261b09-ea68-4633-bc0c-ba9ad8a51bc5 tempest-CreateVolumesFromImageTest-467947785 None] Lock "cinder-c50c2fd0-3c5b-4cf2-a002-b55cf1be89bc-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:11:09 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-66261b09-ea68-4633-bc0c-ba9ad8a51bc5 tempest-CreateVolumesFromImageTest-467947785 None] Acquiring lock "cinder-quobyte-c50c2fd0-3c5b-4cf2-a002-b55cf1be89bc" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:11:09 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-66261b09-ea68-4633-bc0c-ba9ad8a51bc5 tempest-CreateVolumesFromImageTest-467947785 None] Lock "cinder-quobyte-c50c2fd0-3c5b-4cf2-a002-b55cf1be89bc" acquired by "delete_volume" :: waited 0.018s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:11:09 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[d110556d-b423-4b7a-9bee-d7e17cb83c4e]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:11:09 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-66261b09-ea68-4633-bc0c-ba9ad8a51bc5 tempest-CreateVolumesFromImageTest-467947785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c50c2fd0-3c5b-4cf2-a002-b55cf1be89bc {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:09 devstack sudo[104457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c50c2fd0-3c5b-4cf2-a002-b55cf1be89bc Sep 17 22:11:09 devstack sudo[104457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:10 devstack sudo[104452]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:10 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-01edc034-14fb-4f93-baf3-31a1493b1974 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-4e059f5c-485a-48f1-8558-2fe93ec4876e 1073741824" returned: 0 in 0.493s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:10 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-01edc034-14fb-4f93-baf3-31a1493b1974 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-4e059f5c-485a-48f1-8558-2fe93ec4876e {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:10 devstack sudo[104461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-4e059f5c-485a-48f1-8558-2fe93ec4876e Sep 17 22:11:10 devstack sudo[104461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:10 devstack sudo[104457]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:10 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-66261b09-ea68-4633-bc0c-ba9ad8a51bc5 tempest-CreateVolumesFromImageTest-467947785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c50c2fd0-3c5b-4cf2-a002-b55cf1be89bc" returned: 0 in 0.394s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:10 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-66261b09-ea68-4633-bc0c-ba9ad8a51bc5 tempest-CreateVolumesFromImageTest-467947785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c50c2fd0-3c5b-4cf2-a002-b55cf1be89bc {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:10 devstack sudo[104466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c50c2fd0-3c5b-4cf2-a002-b55cf1be89bc Sep 17 22:11:10 devstack sudo[104466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:10 devstack sudo[104461]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:10 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-01edc034-14fb-4f93-baf3-31a1493b1974 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-4e059f5c-485a-48f1-8558-2fe93ec4876e" returned: 0 in 0.261s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:10 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-01edc034-14fb-4f93-baf3-31a1493b1974 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] <== create_volume: return (800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 22:11:10 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-01edc034-14fb-4f93-baf3-31a1493b1974 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.803s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:11:10 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-134c7c7d-134b-405f-8be8-a85ce187b76f tempest-VolumeAndVolumeTypeFromImageTest-1224775445 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.760s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:11:10 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-134c7c7d-134b-405f-8be8-a85ce187b76f tempest-VolumeAndVolumeTypeFromImageTest-1224775445 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:11:04Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a04f574-40dc-452c-8e79-ef5b59cf0a01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cea051bca120488c813353764418cfd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:11:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:11:04Z,use_quota=True,user_id='f73c0111124d48cc993df935e43612d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df49826d-cfda-4313-a9de-0ad88c8a3e3e),volume_type_id=df49826d-cfda-4313-a9de-0ad88c8a3e3e)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 22:11:10 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-134c7c7d-134b-405f-8be8-a85ce187b76f tempest-VolumeAndVolumeTypeFromImageTest-1224775445 None] Creating volume 0a04f574-40dc-452c-8e79-ef5b59cf0a01 {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 22:11:10 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-134c7c7d-134b-405f-8be8-a85ce187b76f tempest-VolumeAndVolumeTypeFromImageTest-1224775445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:11:10 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-134c7c7d-134b-405f-8be8-a85ce187b76f tempest-VolumeAndVolumeTypeFromImageTest-1224775445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:11:10 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-134c7c7d-134b-405f-8be8-a85ce187b76f tempest-VolumeAndVolumeTypeFromImageTest-1224775445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:11:10 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-134c7c7d-134b-405f-8be8-a85ce187b76f tempest-VolumeAndVolumeTypeFromImageTest-1224775445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:11:10 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-134c7c7d-134b-405f-8be8-a85ce187b76f tempest-VolumeAndVolumeTypeFromImageTest-1224775445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:11:10 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-134c7c7d-134b-405f-8be8-a85ce187b76f tempest-VolumeAndVolumeTypeFromImageTest-1224775445 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 22:11:10 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-134c7c7d-134b-405f-8be8-a85ce187b76f tempest-VolumeAndVolumeTypeFromImageTest-1224775445 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 22:11:10 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-134c7c7d-134b-405f-8be8-a85ce187b76f tempest-VolumeAndVolumeTypeFromImageTest-1224775445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0a04f574-40dc-452c-8e79-ef5b59cf0a01 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:10 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-01edc034-14fb-4f93-baf3-31a1493b1974 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8bb7b1c-99f9-43f6-b694-88b48e68dc81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e059f5c-485a-48f1-8558-2fe93ec4876e', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:10 devstack sudo[104469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0a04f574-40dc-452c-8e79-ef5b59cf0a01 1073741824 Sep 17 22:11:10 devstack sudo[104469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:10 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-01edc034-14fb-4f93-baf3-31a1493b1974 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2476bc32-b8ec-46bc-a494-a36fa0e709fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:10 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-01edc034-14fb-4f93-baf3-31a1493b1974 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Volume volume-4e059f5c-485a-48f1-8558-2fe93ec4876e (4e059f5c-485a-48f1-8558-2fe93ec4876e): created successfully Sep 17 22:11:10 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-01edc034-14fb-4f93-baf3-31a1493b1974 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2476bc32-b8ec-46bc-a494-a36fa0e709fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:10 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-01edc034-14fb-4f93-baf3-31a1493b1974 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Flow 'volume_create_manager' (8f558790-dd39-4d5a-ad87-279e78c2d341) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:11:10 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-01edc034-14fb-4f93-baf3-31a1493b1974 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Created volume successfully. Sep 17 22:11:10 devstack sudo[104466]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:10 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-66261b09-ea68-4633-bc0c-ba9ad8a51bc5 tempest-CreateVolumesFromImageTest-467947785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c50c2fd0-3c5b-4cf2-a002-b55cf1be89bc" returned: 0 in 0.283s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:10 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-66261b09-ea68-4633-bc0c-ba9ad8a51bc5 tempest-CreateVolumesFromImageTest-467947785 None] Lock "cinder-quobyte-c50c2fd0-3c5b-4cf2-a002-b55cf1be89bc" released by "delete_volume" :: held 0.719s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:11:10 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-66261b09-ea68-4633-bc0c-ba9ad8a51bc5 tempest-CreateVolumesFromImageTest-467947785 None] Created reservations ['d5a2a63e-03d7-4e15-920f-dceb06b98167', 'b0f76886-e715-4c70-a147-55041abd5be3', '77250188-25bb-4f8f-ac6a-355ada022289', 'faebbb8e-b02d-413d-bf5d-80344a0b9908'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:11:10 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-66261b09-ea68-4633-bc0c-ba9ad8a51bc5 tempest-CreateVolumesFromImageTest-467947785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:11:10 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-66261b09-ea68-4633-bc0c-ba9ad8a51bc5 tempest-CreateVolumesFromImageTest-467947785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:11:10 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-66261b09-ea68-4633-bc0c-ba9ad8a51bc5 tempest-CreateVolumesFromImageTest-467947785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:11:10 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-66261b09-ea68-4633-bc0c-ba9ad8a51bc5 tempest-CreateVolumesFromImageTest-467947785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:11:10 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-66261b09-ea68-4633-bc0c-ba9ad8a51bc5 tempest-CreateVolumesFromImageTest-467947785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:11:10 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-66261b09-ea68-4633-bc0c-ba9ad8a51bc5 tempest-CreateVolumesFromImageTest-467947785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:10 devstack sudo[104475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:11:10 devstack sudo[104475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:10 devstack sudo[104469]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:10 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-134c7c7d-134b-405f-8be8-a85ce187b76f tempest-VolumeAndVolumeTypeFromImageTest-1224775445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0a04f574-40dc-452c-8e79-ef5b59cf0a01 1073741824" returned: 0 in 0.451s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:10 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-134c7c7d-134b-405f-8be8-a85ce187b76f tempest-VolumeAndVolumeTypeFromImageTest-1224775445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0a04f574-40dc-452c-8e79-ef5b59cf0a01 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:10 devstack sudo[104475]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:10 devstack sudo[104478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0a04f574-40dc-452c-8e79-ef5b59cf0a01 Sep 17 22:11:10 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-66261b09-ea68-4633-bc0c-ba9ad8a51bc5 tempest-CreateVolumesFromImageTest-467947785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.279s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:10 devstack sudo[104478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:10 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-66261b09-ea68-4633-bc0c-ba9ad8a51bc5 tempest-CreateVolumesFromImageTest-467947785 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:11:10 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-54621dc2-a25c-4d97-a2b0-a30bcae73fef tempest-CreateVolumesFromImageTest-467947785 None] Acquiring lock "cinder-8d222051-d10c-47d4-9587-d77a319c7961-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:11:10 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-66261b09-ea68-4633-bc0c-ba9ad8a51bc5 tempest-CreateVolumesFromImageTest-467947785 None] Deleted volume successfully. Sep 17 22:11:11 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-54621dc2-a25c-4d97-a2b0-a30bcae73fef tempest-CreateVolumesFromImageTest-467947785 None] Lock "cinder-8d222051-d10c-47d4-9587-d77a319c7961-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:11:11 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-66261b09-ea68-4633-bc0c-ba9ad8a51bc5 tempest-CreateVolumesFromImageTest-467947785 None] Lock "cinder-c50c2fd0-3c5b-4cf2-a002-b55cf1be89bc-delete_volume" released by "delete_volume" :: held 1.225s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:11:11 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-54621dc2-a25c-4d97-a2b0-a30bcae73fef tempest-CreateVolumesFromImageTest-467947785 None] Acquiring lock "cinder-quobyte-8d222051-d10c-47d4-9587-d77a319c7961" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:11:11 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-54621dc2-a25c-4d97-a2b0-a30bcae73fef tempest-CreateVolumesFromImageTest-467947785 None] Lock "cinder-quobyte-8d222051-d10c-47d4-9587-d77a319c7961" acquired by "delete_volume" :: waited 0.017s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:11:11 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0221d9f-c780-4517-9844-f00b0c1607cd]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:11:11 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-54621dc2-a25c-4d97-a2b0-a30bcae73fef tempest-CreateVolumesFromImageTest-467947785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8d222051-d10c-47d4-9587-d77a319c7961 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:11 devstack sudo[104478]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:11 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-134c7c7d-134b-405f-8be8-a85ce187b76f tempest-VolumeAndVolumeTypeFromImageTest-1224775445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0a04f574-40dc-452c-8e79-ef5b59cf0a01" returned: 0 in 0.265s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:11 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-134c7c7d-134b-405f-8be8-a85ce187b76f tempest-VolumeAndVolumeTypeFromImageTest-1224775445 None] <== create_volume: return (766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 22:11:11 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-134c7c7d-134b-405f-8be8-a85ce187b76f tempest-VolumeAndVolumeTypeFromImageTest-1224775445 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.769s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:11:11 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-351d7c47-0fce-48ed-8719-e697cce1de32 tempest-CinderUnicodeTest-502091172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.208s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:11:11 devstack sudo[104480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8d222051-d10c-47d4-9587-d77a319c7961 Sep 17 22:11:11 devstack sudo[104480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:11 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-351d7c47-0fce-48ed-8719-e697cce1de32 tempest-CinderUnicodeTest-502091172 None] Creating offline snapshot 8652cd77-dc68-4040-bb96-2bf411fab7c3 of volume a5153193-2437-4b44-8d42-f07a9a670036 {{(pid=85458) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 22:11:11 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0eff055-83c9-48a6-a5d9-f47019d22118]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:11:11 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-351d7c47-0fce-48ed-8719-e697cce1de32 tempest-CinderUnicodeTest-502091172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a5153193-2437-4b44-8d42-f07a9a670036 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:11 devstack cinder-volume[85458]: DEBUG cinder.volume.volume_utils [None req-134c7c7d-134b-405f-8be8-a85ce187b76f tempest-VolumeAndVolumeTypeFromImageTest-1224775445 None] Attempting download of 0d137fbd-12e6-4327-a79e-9da76a324e75 ((None, [{'url': 'file:///opt/stack/data/glance/images/0d137fbd-12e6-4327-a79e-9da76a324e75', 'metadata': {}}])) to volume 0a04f574-40dc-452c-8e79-ef5b59cf0a01. {{(pid=85458) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 17 22:11:11 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb7e5f84-3590-467c-8fca-22826332ec7e]: (4, 'raw') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:11:11 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-134c7c7d-134b-405f-8be8-a85ce187b76f tempest-VolumeAndVolumeTypeFromImageTest-1224775445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0d137fbd-12e6-4327-a79e-9da76a324e75_myyljhx5 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:11 devstack sudo[104483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a5153193-2437-4b44-8d42-f07a9a670036 Sep 17 22:11:11 devstack sudo[104483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:11 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-c6340759-d3cd-45b8-a3b6-619a2994bbfb tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Acquiring lock "cinder-4e059f5c-485a-48f1-8558-2fe93ec4876e-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:11:11 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-c6340759-d3cd-45b8-a3b6-619a2994bbfb tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Lock "cinder-4e059f5c-485a-48f1-8558-2fe93ec4876e-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:11:11 devstack sudo[104484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0d137fbd-12e6-4327-a79e-9da76a324e75_myyljhx5 Sep 17 22:11:11 devstack sudo[104484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:11 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-c6340759-d3cd-45b8-a3b6-619a2994bbfb tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Acquiring lock "cinder-quobyte-4e059f5c-485a-48f1-8558-2fe93ec4876e" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:11:11 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-c6340759-d3cd-45b8-a3b6-619a2994bbfb tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Lock "cinder-quobyte-4e059f5c-485a-48f1-8558-2fe93ec4876e" acquired by "delete_volume" :: waited 0.015s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:11:11 devstack sudo[104480]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:11 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-54621dc2-a25c-4d97-a2b0-a30bcae73fef tempest-CreateVolumesFromImageTest-467947785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8d222051-d10c-47d4-9587-d77a319c7961" returned: 0 in 0.493s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:11 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-54621dc2-a25c-4d97-a2b0-a30bcae73fef tempest-CreateVolumesFromImageTest-467947785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8d222051-d10c-47d4-9587-d77a319c7961 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:11 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c121d5d-0b0b-4a44-9fc7-b9fd0acdebfb]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:11:11 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-c6340759-d3cd-45b8-a3b6-619a2994bbfb tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-4e059f5c-485a-48f1-8558-2fe93ec4876e {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:11 devstack sudo[104490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8d222051-d10c-47d4-9587-d77a319c7961 Sep 17 22:11:11 devstack sudo[104490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:11 devstack sudo[104483]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:11 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-351d7c47-0fce-48ed-8719-e697cce1de32 tempest-CinderUnicodeTest-502091172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a5153193-2437-4b44-8d42-f07a9a670036" returned: 0 in 0.447s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:11 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-351d7c47-0fce-48ed-8719-e697cce1de32 tempest-CinderUnicodeTest-502091172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a5153193-2437-4b44-8d42-f07a9a670036,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a5153193-2437-4b44-8d42-f07a9a670036.8652cd77-dc68-4040-bb96-2bf411fab7c3 1G {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:11 devstack sudo[104496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a5153193-2437-4b44-8d42-f07a9a670036,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a5153193-2437-4b44-8d42-f07a9a670036.8652cd77-dc68-4040-bb96-2bf411fab7c3 1G Sep 17 22:11:11 devstack sudo[104491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-4e059f5c-485a-48f1-8558-2fe93ec4876e Sep 17 22:11:11 devstack sudo[104496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:11 devstack sudo[104491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:11 devstack sudo[104484]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:11 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-134c7c7d-134b-405f-8be8-a85ce187b76f tempest-VolumeAndVolumeTypeFromImageTest-1224775445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0d137fbd-12e6-4327-a79e-9da76a324e75_myyljhx5" returned: 0 in 0.437s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:11 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-134c7c7d-134b-405f-8be8-a85ce187b76f tempest-VolumeAndVolumeTypeFromImageTest-1224775445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0d137fbd-12e6-4327-a79e-9da76a324e75_myyljhx5 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:11 devstack sudo[104490]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:11 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-54621dc2-a25c-4d97-a2b0-a30bcae73fef tempest-CreateVolumesFromImageTest-467947785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8d222051-d10c-47d4-9587-d77a319c7961" returned: 0 in 0.282s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:11 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-54621dc2-a25c-4d97-a2b0-a30bcae73fef tempest-CreateVolumesFromImageTest-467947785 None] Lock "cinder-quobyte-8d222051-d10c-47d4-9587-d77a319c7961" released by "delete_volume" :: held 0.824s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:11:11 devstack sudo[104501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0d137fbd-12e6-4327-a79e-9da76a324e75_myyljhx5 Sep 17 22:11:11 devstack sudo[104501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:11 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-54621dc2-a25c-4d97-a2b0-a30bcae73fef tempest-CreateVolumesFromImageTest-467947785 None] Created reservations ['48b4a355-dc53-4312-a2f3-5699d1bbf4fe', 'd1c7abe7-9299-443e-b64f-16286720740a', 'ca7a36c4-f6f1-4007-b1bd-b1be20bf531c', 'a1783fa5-c9f3-409a-9588-09c0674288a9'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:11:12 devstack sudo[104491]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:12 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-c6340759-d3cd-45b8-a3b6-619a2994bbfb tempest-CreateVolumesFromSourceVolumeTest-191538477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-4e059f5c-485a-48f1-8558-2fe93ec4876e" returned: 0 in 0.412s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:12 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-c6340759-d3cd-45b8-a3b6-619a2994bbfb tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-4e059f5c-485a-48f1-8558-2fe93ec4876e {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:12 devstack sudo[104510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-4e059f5c-485a-48f1-8558-2fe93ec4876e Sep 17 22:11:12 devstack sudo[104510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:12 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-54621dc2-a25c-4d97-a2b0-a30bcae73fef tempest-CreateVolumesFromImageTest-467947785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:11:12 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-54621dc2-a25c-4d97-a2b0-a30bcae73fef tempest-CreateVolumesFromImageTest-467947785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:11:12 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-54621dc2-a25c-4d97-a2b0-a30bcae73fef tempest-CreateVolumesFromImageTest-467947785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:11:12 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-54621dc2-a25c-4d97-a2b0-a30bcae73fef tempest-CreateVolumesFromImageTest-467947785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:11:12 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-54621dc2-a25c-4d97-a2b0-a30bcae73fef tempest-CreateVolumesFromImageTest-467947785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:11:12 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-54621dc2-a25c-4d97-a2b0-a30bcae73fef tempest-CreateVolumesFromImageTest-467947785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:12 devstack sudo[104512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:11:12 devstack sudo[104512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:12 devstack sudo[104501]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:12 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-134c7c7d-134b-405f-8be8-a85ce187b76f tempest-VolumeAndVolumeTypeFromImageTest-1224775445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0d137fbd-12e6-4327-a79e-9da76a324e75_myyljhx5" returned: 1 in 0.423s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:12 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-134c7c7d-134b-405f-8be8-a85ce187b76f tempest-VolumeAndVolumeTypeFromImageTest-1224775445 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0d137fbd-12e6-4327-a79e-9da76a324e75_myyljhx5' failed. Not Retrying. {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 22:11:12 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ac4f2a7-4334-43f9-bd42-a96ec4fa81f0]: (4, 'raw') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:11:12 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-134c7c7d-134b-405f-8be8-a85ce187b76f tempest-VolumeAndVolumeTypeFromImageTest-1224775445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0d137fbd-12e6-4327-a79e-9da76a324e75_j8p86duvdevstack@QuobyteHD {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:12 devstack sudo[104496]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:12 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-351d7c47-0fce-48ed-8719-e697cce1de32 tempest-CinderUnicodeTest-502091172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a5153193-2437-4b44-8d42-f07a9a670036,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a5153193-2437-4b44-8d42-f07a9a670036.8652cd77-dc68-4040-bb96-2bf411fab7c3 1G" returned: 0 in 0.551s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:12 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-351d7c47-0fce-48ed-8719-e697cce1de32 tempest-CinderUnicodeTest-502091172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5153193-2437-4b44-8d42-f07a9a670036 -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a5153193-2437-4b44-8d42-f07a9a670036.8652cd77-dc68-4040-bb96-2bf411fab7c3 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:12 devstack sudo[104517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5153193-2437-4b44-8d42-f07a9a670036 -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a5153193-2437-4b44-8d42-f07a9a670036.8652cd77-dc68-4040-bb96-2bf411fab7c3 Sep 17 22:11:12 devstack sudo[104517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:12 devstack sudo[104516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0d137fbd-12e6-4327-a79e-9da76a324e75_j8p86duvdevstack@QuobyteHD Sep 17 22:11:12 devstack sudo[104516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:12 devstack sudo[104510]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:12 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-c6340759-d3cd-45b8-a3b6-619a2994bbfb tempest-CreateVolumesFromSourceVolumeTest-191538477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-4e059f5c-485a-48f1-8558-2fe93ec4876e" returned: 0 in 0.353s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:12 devstack sudo[104512]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:12 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-54621dc2-a25c-4d97-a2b0-a30bcae73fef tempest-CreateVolumesFromImageTest-467947785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.310s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:12 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-54621dc2-a25c-4d97-a2b0-a30bcae73fef tempest-CreateVolumesFromImageTest-467947785 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:11:12 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-c6340759-d3cd-45b8-a3b6-619a2994bbfb tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Lock "cinder-quobyte-4e059f5c-485a-48f1-8558-2fe93ec4876e" released by "delete_volume" :: held 0.846s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:11:12 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-54621dc2-a25c-4d97-a2b0-a30bcae73fef tempest-CreateVolumesFromImageTest-467947785 None] Deleted volume successfully. Sep 17 22:11:12 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-54621dc2-a25c-4d97-a2b0-a30bcae73fef tempest-CreateVolumesFromImageTest-467947785 None] Lock "cinder-8d222051-d10c-47d4-9587-d77a319c7961-delete_volume" released by "delete_volume" :: held 1.452s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:11:12 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-c6340759-d3cd-45b8-a3b6-619a2994bbfb tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Created reservations ['be3743ba-bb8e-4695-8521-8dbb616fd12b', '5fb2f8fc-7a4b-467b-b5f1-c0922e7b0f7c', 'ee2754ac-7683-4195-92bc-0c19e53a90f2', '81a502d7-1841-4679-8fa3-d9db375022cc'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:11:12 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-c6340759-d3cd-45b8-a3b6-619a2994bbfb tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:11:12 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-c6340759-d3cd-45b8-a3b6-619a2994bbfb tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:11:12 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-c6340759-d3cd-45b8-a3b6-619a2994bbfb tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:11:12 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-c6340759-d3cd-45b8-a3b6-619a2994bbfb tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:11:12 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-c6340759-d3cd-45b8-a3b6-619a2994bbfb tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:11:12 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-c6340759-d3cd-45b8-a3b6-619a2994bbfb tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:12 devstack sudo[104525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:11:12 devstack sudo[104525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:12 devstack sudo[104517]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:12 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-351d7c47-0fce-48ed-8719-e697cce1de32 tempest-CinderUnicodeTest-502091172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5153193-2437-4b44-8d42-f07a9a670036 -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a5153193-2437-4b44-8d42-f07a9a670036.8652cd77-dc68-4040-bb96-2bf411fab7c3" returned: 0 in 0.405s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:12 devstack cinder-volume[85458]: WARNING cinder.volume.drivers.remotefs [None req-351d7c47-0fce-48ed-8719-e697cce1de32 tempest-CinderUnicodeTest-502091172 None] /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a5153193-2437-4b44-8d42-f07a9a670036.8652cd77-dc68-4040-bb96-2bf411fab7c3 is being set with open permissions: ugo+rw Sep 17 22:11:12 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-351d7c47-0fce-48ed-8719-e697cce1de32 tempest-CinderUnicodeTest-502091172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a5153193-2437-4b44-8d42-f07a9a670036.8652cd77-dc68-4040-bb96-2bf411fab7c3 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:12 devstack sudo[104516]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:12 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-134c7c7d-134b-405f-8be8-a85ce187b76f tempest-VolumeAndVolumeTypeFromImageTest-1224775445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0d137fbd-12e6-4327-a79e-9da76a324e75_j8p86duvdevstack@QuobyteHD" returned: 0 in 0.469s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:12 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-134c7c7d-134b-405f-8be8-a85ce187b76f tempest-VolumeAndVolumeTypeFromImageTest-1224775445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0d137fbd-12e6-4327-a79e-9da76a324e75_j8p86duvdevstack@QuobyteHD {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:12 devstack sudo[104529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a5153193-2437-4b44-8d42-f07a9a670036.8652cd77-dc68-4040-bb96-2bf411fab7c3 Sep 17 22:11:12 devstack sudo[104529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:12 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-9149f3be-c9ad-4a97-ac38-0b142853ba4d tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Acquiring lock "cinder-f8f716be-3dd9-487c-8bb8-d5c684dd82a2-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:11:12 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-9149f3be-c9ad-4a97-ac38-0b142853ba4d tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Lock "cinder-f8f716be-3dd9-487c-8bb8-d5c684dd82a2-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:11:12 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-9149f3be-c9ad-4a97-ac38-0b142853ba4d tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Acquiring lock "cinder-quobyte-f8f716be-3dd9-487c-8bb8-d5c684dd82a2" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:11:12 devstack sudo[104530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0d137fbd-12e6-4327-a79e-9da76a324e75_j8p86duvdevstack@QuobyteHD Sep 17 22:11:12 devstack sudo[104530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:12 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-9149f3be-c9ad-4a97-ac38-0b142853ba4d tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Lock "cinder-quobyte-f8f716be-3dd9-487c-8bb8-d5c684dd82a2" acquired by "delete_volume" :: waited 0.031s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:11:12 devstack sudo[104525]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:12 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-c6340759-d3cd-45b8-a3b6-619a2994bbfb tempest-CreateVolumesFromSourceVolumeTest-191538477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.319s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:12 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-c6340759-d3cd-45b8-a3b6-619a2994bbfb tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:11:12 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-c6340759-d3cd-45b8-a3b6-619a2994bbfb tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Deleted volume successfully. Sep 17 22:11:12 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[956be760-a39e-44ee-b841-4968cc9a3190]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:11:12 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-9149f3be-c9ad-4a97-ac38-0b142853ba4d tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f8f716be-3dd9-487c-8bb8-d5c684dd82a2 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:12 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-c6340759-d3cd-45b8-a3b6-619a2994bbfb tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Lock "cinder-4e059f5c-485a-48f1-8558-2fe93ec4876e-delete_volume" released by "delete_volume" :: held 1.493s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:11:13 devstack sudo[104529]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:13 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-351d7c47-0fce-48ed-8719-e697cce1de32 tempest-CinderUnicodeTest-502091172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a5153193-2437-4b44-8d42-f07a9a670036.8652cd77-dc68-4040-bb96-2bf411fab7c3" returned: 0 in 0.406s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:13 devstack sudo[104534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f8f716be-3dd9-487c-8bb8-d5c684dd82a2 Sep 17 22:11:13 devstack sudo[104534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:13 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-351d7c47-0fce-48ed-8719-e697cce1de32 tempest-CinderUnicodeTest-502091172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a5153193-2437-4b44-8d42-f07a9a670036.info {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:13 devstack sudo[104530]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:13 devstack sudo[104540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a5153193-2437-4b44-8d42-f07a9a670036.info Sep 17 22:11:13 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-134c7c7d-134b-405f-8be8-a85ce187b76f tempest-VolumeAndVolumeTypeFromImageTest-1224775445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0d137fbd-12e6-4327-a79e-9da76a324e75_j8p86duvdevstack@QuobyteHD" returned: 1 in 0.460s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:13 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-134c7c7d-134b-405f-8be8-a85ce187b76f tempest-VolumeAndVolumeTypeFromImageTest-1224775445 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0d137fbd-12e6-4327-a79e-9da76a324e75_j8p86duvdevstack@QuobyteHD' failed. Not Retrying. {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 22:11:13 devstack cinder-volume[85458]: DEBUG cinder.image.image_utils [None req-134c7c7d-134b-405f-8be8-a85ce187b76f tempest-VolumeAndVolumeTypeFromImageTest-1224775445 None] 0d137fbd-12e6-4327-a79e-9da76a324e75 was raw, converting to qcow2 {{(pid=85458) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 17 22:11:13 devstack sudo[104540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:13 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-134c7c7d-134b-405f-8be8-a85ce187b76f tempest-VolumeAndVolumeTypeFromImageTest-1224775445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_0d137fbd-12e6-4327-a79e-9da76a324e75_j8p86duvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0a04f574-40dc-452c-8e79-ef5b59cf0a01 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:13 devstack sudo[104542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_0d137fbd-12e6-4327-a79e-9da76a324e75_j8p86duvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0a04f574-40dc-452c-8e79-ef5b59cf0a01 Sep 17 22:11:13 devstack sudo[104542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:13 devstack sudo[104534]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:13 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-9149f3be-c9ad-4a97-ac38-0b142853ba4d tempest-CreateVolumesFromSourceVolumeTest-191538477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f8f716be-3dd9-487c-8bb8-d5c684dd82a2" returned: 0 in 0.531s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:13 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-9149f3be-c9ad-4a97-ac38-0b142853ba4d tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f8f716be-3dd9-487c-8bb8-d5c684dd82a2 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:13 devstack sudo[104550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f8f716be-3dd9-487c-8bb8-d5c684dd82a2 Sep 17 22:11:13 devstack sudo[104550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:13 devstack sudo[104540]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:13 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-351d7c47-0fce-48ed-8719-e697cce1de32 tempest-CinderUnicodeTest-502091172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a5153193-2437-4b44-8d42-f07a9a670036.info" returned: 0 in 0.408s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:13 devstack cinder-volume[85458]: WARNING cinder.volume.drivers.remotefs [None req-351d7c47-0fce-48ed-8719-e697cce1de32 tempest-CinderUnicodeTest-502091172 None] /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a5153193-2437-4b44-8d42-f07a9a670036.info is being set with open permissions: ugo+rw Sep 17 22:11:13 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-351d7c47-0fce-48ed-8719-e697cce1de32 tempest-CinderUnicodeTest-502091172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a5153193-2437-4b44-8d42-f07a9a670036.info {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:13 devstack sudo[104553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a5153193-2437-4b44-8d42-f07a9a670036.info Sep 17 22:11:13 devstack sudo[104553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:13 devstack sudo[104542]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:13 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-134c7c7d-134b-405f-8be8-a85ce187b76f tempest-VolumeAndVolumeTypeFromImageTest-1224775445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_0d137fbd-12e6-4327-a79e-9da76a324e75_j8p86duvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0a04f574-40dc-452c-8e79-ef5b59cf0a01" returned: 0 in 0.616s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:13 devstack cinder-volume[85458]: DEBUG cinder.image.image_utils [None req-134c7c7d-134b-405f-8be8-a85ce187b76f tempest-VolumeAndVolumeTypeFromImageTest-1224775445 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0d137fbd-12e6-4327-a79e-9da76a324e75_j8p86duvdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0a04f574-40dc-452c-8e79-ef5b59cf0a01 {{(pid=85458) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 17 22:11:13 devstack cinder-volume[85458]: INFO cinder.image.image_utils [None req-134c7c7d-134b-405f-8be8-a85ce187b76f tempest-VolumeAndVolumeTypeFromImageTest-1224775445 None] Converted 0.00 MB image at 0.00 MB/s Sep 17 22:11:13 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-134c7c7d-134b-405f-8be8-a85ce187b76f tempest-VolumeAndVolumeTypeFromImageTest-1224775445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0a04f574-40dc-452c-8e79-ef5b59cf0a01 1G {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:13 devstack sudo[104550]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:13 devstack sudo[104558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0a04f574-40dc-452c-8e79-ef5b59cf0a01 1G Sep 17 22:11:13 devstack sudo[104558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:13 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-9149f3be-c9ad-4a97-ac38-0b142853ba4d tempest-CreateVolumesFromSourceVolumeTest-191538477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-f8f716be-3dd9-487c-8bb8-d5c684dd82a2" returned: 0 in 0.354s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:13 devstack sudo[104553]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:13 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-351d7c47-0fce-48ed-8719-e697cce1de32 tempest-CinderUnicodeTest-502091172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a5153193-2437-4b44-8d42-f07a9a670036.info" returned: 0 in 0.311s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:13 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-351d7c47-0fce-48ed-8719-e697cce1de32 tempest-CinderUnicodeTest-502091172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.669s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:11:13 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-9149f3be-c9ad-4a97-ac38-0b142853ba4d tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Lock "cinder-quobyte-f8f716be-3dd9-487c-8bb8-d5c684dd82a2" released by "delete_volume" :: held 0.981s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:11:13 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-351d7c47-0fce-48ed-8719-e697cce1de32 tempest-CinderUnicodeTest-502091172 None] Create snapshot completed successfully Sep 17 22:11:13 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-9149f3be-c9ad-4a97-ac38-0b142853ba4d tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Created reservations ['a7e933f7-0c8c-4441-8c54-f9fa9c45b197', '63a97c67-9a98-417d-a982-6ff16412093f', 'e89212ce-9e2d-41cf-a440-34773b1ad672', 'fc58f725-ba6c-4c3c-85cf-9797f439737b'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:11:14 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-9149f3be-c9ad-4a97-ac38-0b142853ba4d tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:11:14 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-9149f3be-c9ad-4a97-ac38-0b142853ba4d tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:11:14 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-9149f3be-c9ad-4a97-ac38-0b142853ba4d tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:11:14 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-9149f3be-c9ad-4a97-ac38-0b142853ba4d tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:11:14 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-9149f3be-c9ad-4a97-ac38-0b142853ba4d tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:11:14 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-9149f3be-c9ad-4a97-ac38-0b142853ba4d tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:14 devstack sudo[104560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:11:14 devstack sudo[104560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:14 devstack sudo[104558]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:14 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-134c7c7d-134b-405f-8be8-a85ce187b76f tempest-VolumeAndVolumeTypeFromImageTest-1224775445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0a04f574-40dc-452c-8e79-ef5b59cf0a01 1G" returned: 0 in 0.405s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:14 devstack cinder-volume[85458]: DEBUG cinder.volume.volume_utils [None req-134c7c7d-134b-405f-8be8-a85ce187b76f tempest-VolumeAndVolumeTypeFromImageTest-1224775445 None] Downloaded image 0d137fbd-12e6-4327-a79e-9da76a324e75 ((None, [{'url': 'file:///opt/stack/data/glance/images/0d137fbd-12e6-4327-a79e-9da76a324e75', 'metadata': {}}])) to volume 0a04f574-40dc-452c-8e79-ef5b59cf0a01 successfully. {{(pid=85458) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 17 22:11:14 devstack cinder-volume[85458]: DEBUG cinder.image.image_utils [None req-134c7c7d-134b-405f-8be8-a85ce187b76f tempest-VolumeAndVolumeTypeFromImageTest-1224775445 None] Temporary image 0d137fbd-12e6-4327-a79e-9da76a324e75 for user f73c0111124d48cc993df935e43612d2 is deleted. {{(pid=85458) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 17 22:11:14 devstack cinder-volume[85458]: DEBUG cinder.volume.volume_utils [None req-134c7c7d-134b-405f-8be8-a85ce187b76f tempest-VolumeAndVolumeTypeFromImageTest-1224775445 None] Marking volume 0a04f574-40dc-452c-8e79-ef5b59cf0a01 as bootable. {{(pid=85458) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 17 22:11:14 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-134c7c7d-134b-405f-8be8-a85ce187b76f tempest-VolumeAndVolumeTypeFromImageTest-1224775445 None] Copying metadata from image 0d137fbd-12e6-4327-a79e-9da76a324e75 to 0a04f574-40dc-452c-8e79-ef5b59cf0a01. {{(pid=85458) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 17 22:11:14 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-134c7c7d-134b-405f-8be8-a85ce187b76f tempest-VolumeAndVolumeTypeFromImageTest-1224775445 None] Creating volume glance metadata for volume 0a04f574-40dc-452c-8e79-ef5b59cf0a01 backed by image 0d137fbd-12e6-4327-a79e-9da76a324e75 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '0d137fbd-12e6-4327-a79e-9da76a324e75', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '608165f35d57ae62e8ead8e5e199b412', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=85458) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 17 22:11:14 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-134c7c7d-134b-405f-8be8-a85ce187b76f tempest-VolumeAndVolumeTypeFromImageTest-1224775445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd8f7442-aa20-4469-a8e9-dff807b42931) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a04f574-40dc-452c-8e79-ef5b59cf0a01', 'volume_size': 1, 'image_id': '0d137fbd-12e6-4327-a79e-9da76a324e75', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0d137fbd-12e6-4327-a79e-9da76a324e75', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '608165f35d57ae62e8ead8e5e199b412', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'cea051bca120488c813353764418cfd9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '60a744f8a66bb7e235d27c192b1762ec0c43f1af5edff138e96b6bc21229779f192a049fd98f6aa74d8b741ebf68c356d6db46fc19e629a89ce4c6d4ba746bed', 'id': '0d137fbd-12e6-4327-a79e-9da76a324e75', 'created_at': datetime.datetime(2026, 9, 17, 20, 11, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 20, 11, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0d137fbd-12e6-4327-a79e-9da76a324e75/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:14 devstack sudo[104560]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:14 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-134c7c7d-134b-405f-8be8-a85ce187b76f tempest-VolumeAndVolumeTypeFromImageTest-1224775445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12e09d56-cc74-4fc6-85cd-1a111ff19ea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:14 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-9149f3be-c9ad-4a97-ac38-0b142853ba4d tempest-CreateVolumesFromSourceVolumeTest-191538477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.307s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:14 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-9149f3be-c9ad-4a97-ac38-0b142853ba4d tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:11:14 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-9149f3be-c9ad-4a97-ac38-0b142853ba4d tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Deleted volume successfully. Sep 17 22:11:14 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-134c7c7d-134b-405f-8be8-a85ce187b76f tempest-VolumeAndVolumeTypeFromImageTest-1224775445 None] Volume volume-0a04f574-40dc-452c-8e79-ef5b59cf0a01 (0a04f574-40dc-452c-8e79-ef5b59cf0a01): created successfully Sep 17 22:11:14 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-134c7c7d-134b-405f-8be8-a85ce187b76f tempest-VolumeAndVolumeTypeFromImageTest-1224775445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12e09d56-cc74-4fc6-85cd-1a111ff19ea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:14 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-134c7c7d-134b-405f-8be8-a85ce187b76f tempest-VolumeAndVolumeTypeFromImageTest-1224775445 None] Flow 'volume_create_manager' (f23a6e89-afc7-46fa-a765-3cb55eca12f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:11:14 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-27d720be-1093-4ed8-9b92-2cd54ce2233f tempest-CinderUnicodeTest-502091172 None] Acquiring lock "cinder-8652cd77-dc68-4040-bb96-2bf411fab7c3-delete_snapshot" by "delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:11:14 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-134c7c7d-134b-405f-8be8-a85ce187b76f tempest-VolumeAndVolumeTypeFromImageTest-1224775445 None] Created volume successfully. Sep 17 22:11:14 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-9149f3be-c9ad-4a97-ac38-0b142853ba4d tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Lock "cinder-f8f716be-3dd9-487c-8bb8-d5c684dd82a2-delete_volume" released by "delete_volume" :: held 1.630s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:11:14 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-27d720be-1093-4ed8-9b92-2cd54ce2233f tempest-CinderUnicodeTest-502091172 None] Lock "cinder-8652cd77-dc68-4040-bb96-2bf411fab7c3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:11:14 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-27d720be-1093-4ed8-9b92-2cd54ce2233f tempest-CinderUnicodeTest-502091172 None] Acquiring lock "cinder-quobyte-a5153193-2437-4b44-8d42-f07a9a670036" by "delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:11:14 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-27d720be-1093-4ed8-9b92-2cd54ce2233f tempest-CinderUnicodeTest-502091172 None] Lock "cinder-quobyte-a5153193-2437-4b44-8d42-f07a9a670036" acquired by "delete_snapshot" :: waited 0.015s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:11:14 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-27d720be-1093-4ed8-9b92-2cd54ce2233f tempest-CinderUnicodeTest-502091172 None] Acquiring lock "cinder-quobyte-8652cd77-dc68-4040-bb96-2bf411fab7c3" by "_delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:11:14 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-27d720be-1093-4ed8-9b92-2cd54ce2233f tempest-CinderUnicodeTest-502091172 None] Lock "cinder-quobyte-8652cd77-dc68-4040-bb96-2bf411fab7c3" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:11:14 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-27d720be-1093-4ed8-9b92-2cd54ce2233f tempest-CinderUnicodeTest-502091172 None] Deleting offline snapshot 8652cd77-dc68-4040-bb96-2bf411fab7c3 of volume a5153193-2437-4b44-8d42-f07a9a670036 {{(pid=85458) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 22:11:14 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-27d720be-1093-4ed8-9b92-2cd54ce2233f tempest-CinderUnicodeTest-502091172 None] snapshot_file for this snap is: volume-a5153193-2437-4b44-8d42-f07a9a670036.8652cd77-dc68-4040-bb96-2bf411fab7c3 {{(pid=85458) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 22:11:14 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c48ee9a-ca9e-4038-93da-02e808bdc8af]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:11:14 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-27d720be-1093-4ed8-9b92-2cd54ce2233f tempest-CinderUnicodeTest-502091172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a5153193-2437-4b44-8d42-f07a9a670036.8652cd77-dc68-4040-bb96-2bf411fab7c3 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:14 devstack sudo[104567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a5153193-2437-4b44-8d42-f07a9a670036.8652cd77-dc68-4040-bb96-2bf411fab7c3 Sep 17 22:11:14 devstack sudo[104567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:14 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-b06e74db-ef33-48fd-a70c-b8df111a9b85 tempest-VolumeAndVolumeTypeFromImageTest-1224775445 None] Acquiring lock "cinder-0a04f574-40dc-452c-8e79-ef5b59cf0a01-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:11:14 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-b06e74db-ef33-48fd-a70c-b8df111a9b85 tempest-VolumeAndVolumeTypeFromImageTest-1224775445 None] Lock "cinder-0a04f574-40dc-452c-8e79-ef5b59cf0a01-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:11:14 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-b06e74db-ef33-48fd-a70c-b8df111a9b85 tempest-VolumeAndVolumeTypeFromImageTest-1224775445 None] Acquiring lock "cinder-quobyte-0a04f574-40dc-452c-8e79-ef5b59cf0a01" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:11:14 devstack sudo[104567]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:14 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-27d720be-1093-4ed8-9b92-2cd54ce2233f tempest-CinderUnicodeTest-502091172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a5153193-2437-4b44-8d42-f07a9a670036.8652cd77-dc68-4040-bb96-2bf411fab7c3" returned: 0 in 0.417s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:14 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-27d720be-1093-4ed8-9b92-2cd54ce2233f tempest-CinderUnicodeTest-502091172 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a5153193-2437-4b44-8d42-f07a9a670036(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85458) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 22:11:14 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-b06e74db-ef33-48fd-a70c-b8df111a9b85 tempest-VolumeAndVolumeTypeFromImageTest-1224775445 None] Lock "cinder-quobyte-0a04f574-40dc-452c-8e79-ef5b59cf0a01" acquired by "delete_volume" :: waited 0.048s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:11:14 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[529a9226-f02f-4a7a-addf-5df473da9b9a]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:11:14 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-27d720be-1093-4ed8-9b92-2cd54ce2233f tempest-CinderUnicodeTest-502091172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a5153193-2437-4b44-8d42-f07a9a670036 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:14 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7e5cfe4-41c7-48df-a89a-95357f3fa680]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:11:14 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-b06e74db-ef33-48fd-a70c-b8df111a9b85 tempest-VolumeAndVolumeTypeFromImageTest-1224775445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0a04f574-40dc-452c-8e79-ef5b59cf0a01 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:15 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-50da1e0c-2cbe-4958-968d-5ecfacbb71ab tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Acquiring lock "cinder-9317c1bf-893f-4f1b-b995-749a0b15458c-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:11:15 devstack sudo[104572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a5153193-2437-4b44-8d42-f07a9a670036 Sep 17 22:11:15 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-50da1e0c-2cbe-4958-968d-5ecfacbb71ab tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Lock "cinder-9317c1bf-893f-4f1b-b995-749a0b15458c-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:11:15 devstack sudo[104572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:15 devstack sudo[104573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0a04f574-40dc-452c-8e79-ef5b59cf0a01 Sep 17 22:11:15 devstack sudo[104573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:15 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-50da1e0c-2cbe-4958-968d-5ecfacbb71ab tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Acquiring lock "cinder-quobyte-9317c1bf-893f-4f1b-b995-749a0b15458c" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:11:15 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-50da1e0c-2cbe-4958-968d-5ecfacbb71ab tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Lock "cinder-quobyte-9317c1bf-893f-4f1b-b995-749a0b15458c" acquired by "delete_volume" :: waited 0.015s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:11:15 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac9f7004-87e4-44ff-8873-cf6fa2eff325]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:11:15 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-50da1e0c-2cbe-4958-968d-5ecfacbb71ab tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-9317c1bf-893f-4f1b-b995-749a0b15458c {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:15 devstack sudo[104576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-9317c1bf-893f-4f1b-b995-749a0b15458c Sep 17 22:11:15 devstack sudo[104576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:15 devstack sudo[104573]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:15 devstack sudo[104572]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:15 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-b06e74db-ef33-48fd-a70c-b8df111a9b85 tempest-VolumeAndVolumeTypeFromImageTest-1224775445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0a04f574-40dc-452c-8e79-ef5b59cf0a01" returned: 0 in 0.475s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:15 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-b06e74db-ef33-48fd-a70c-b8df111a9b85 tempest-VolumeAndVolumeTypeFromImageTest-1224775445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0a04f574-40dc-452c-8e79-ef5b59cf0a01 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:15 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-27d720be-1093-4ed8-9b92-2cd54ce2233f tempest-CinderUnicodeTest-502091172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a5153193-2437-4b44-8d42-f07a9a670036" returned: 0 in 0.507s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:15 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-27d720be-1093-4ed8-9b92-2cd54ce2233f tempest-CinderUnicodeTest-502091172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a5153193-2437-4b44-8d42-f07a9a670036.8652cd77-dc68-4040-bb96-2bf411fab7c3 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:15 devstack sudo[104584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0a04f574-40dc-452c-8e79-ef5b59cf0a01 Sep 17 22:11:15 devstack sudo[104584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:15 devstack sudo[104585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a5153193-2437-4b44-8d42-f07a9a670036.8652cd77-dc68-4040-bb96-2bf411fab7c3 Sep 17 22:11:15 devstack sudo[104585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:15 devstack sudo[104576]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:15 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-50da1e0c-2cbe-4958-968d-5ecfacbb71ab tempest-CreateVolumesFromSourceVolumeTest-191538477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-9317c1bf-893f-4f1b-b995-749a0b15458c" returned: 0 in 0.432s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:15 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-50da1e0c-2cbe-4958-968d-5ecfacbb71ab tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-9317c1bf-893f-4f1b-b995-749a0b15458c {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:15 devstack sudo[104592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-9317c1bf-893f-4f1b-b995-749a0b15458c Sep 17 22:11:15 devstack sudo[104592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:15 devstack sudo[104584]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:15 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-b06e74db-ef33-48fd-a70c-b8df111a9b85 tempest-VolumeAndVolumeTypeFromImageTest-1224775445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0a04f574-40dc-452c-8e79-ef5b59cf0a01" returned: 0 in 0.334s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:15 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-b06e74db-ef33-48fd-a70c-b8df111a9b85 tempest-VolumeAndVolumeTypeFromImageTest-1224775445 None] Lock "cinder-quobyte-0a04f574-40dc-452c-8e79-ef5b59cf0a01" released by "delete_volume" :: held 0.867s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:11:15 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-b06e74db-ef33-48fd-a70c-b8df111a9b85 tempest-VolumeAndVolumeTypeFromImageTest-1224775445 None] Created reservations ['9e79031e-9ed6-4154-95a4-34166e58aaec', '2ec616fe-a88b-49f5-bb09-18a474b25952', '36813fa3-f929-4636-8e7b-b1ff95164f71', '13df9717-63c8-4c58-9542-acead64394ba'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:11:15 devstack sudo[104585]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:15 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-27d720be-1093-4ed8-9b92-2cd54ce2233f tempest-CinderUnicodeTest-502091172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a5153193-2437-4b44-8d42-f07a9a670036.8652cd77-dc68-4040-bb96-2bf411fab7c3" returned: 0 in 0.403s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:15 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-27d720be-1093-4ed8-9b92-2cd54ce2233f tempest-CinderUnicodeTest-502091172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a5153193-2437-4b44-8d42-f07a9a670036.8652cd77-dc68-4040-bb96-2bf411fab7c3 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:15 devstack sudo[104598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a5153193-2437-4b44-8d42-f07a9a670036.8652cd77-dc68-4040-bb96-2bf411fab7c3 Sep 17 22:11:15 devstack sudo[104598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:15 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-b06e74db-ef33-48fd-a70c-b8df111a9b85 tempest-VolumeAndVolumeTypeFromImageTest-1224775445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:11:15 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-b06e74db-ef33-48fd-a70c-b8df111a9b85 tempest-VolumeAndVolumeTypeFromImageTest-1224775445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:11:15 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-b06e74db-ef33-48fd-a70c-b8df111a9b85 tempest-VolumeAndVolumeTypeFromImageTest-1224775445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:11:15 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-b06e74db-ef33-48fd-a70c-b8df111a9b85 tempest-VolumeAndVolumeTypeFromImageTest-1224775445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:11:15 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-b06e74db-ef33-48fd-a70c-b8df111a9b85 tempest-VolumeAndVolumeTypeFromImageTest-1224775445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:11:15 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-b06e74db-ef33-48fd-a70c-b8df111a9b85 tempest-VolumeAndVolumeTypeFromImageTest-1224775445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:16 devstack sudo[104592]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:16 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-50da1e0c-2cbe-4958-968d-5ecfacbb71ab tempest-CreateVolumesFromSourceVolumeTest-191538477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-9317c1bf-893f-4f1b-b995-749a0b15458c" returned: 0 in 0.353s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:16 devstack sudo[104601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:11:16 devstack sudo[104601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:16 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-50da1e0c-2cbe-4958-968d-5ecfacbb71ab tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Lock "cinder-quobyte-9317c1bf-893f-4f1b-b995-749a0b15458c" released by "delete_volume" :: held 0.872s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:11:16 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-50da1e0c-2cbe-4958-968d-5ecfacbb71ab tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Created reservations ['8471b99d-4123-418c-b520-e7d0e0b1e5c4', 'd89f5497-a9d0-4587-af8d-e3b010a10de7', '1235e776-0765-44ba-aebe-b16dd5f22ecb', 'c601a31e-25a4-4b81-87e6-4a0b991daa4a'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:11:16 devstack sudo[104598]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:16 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-27d720be-1093-4ed8-9b92-2cd54ce2233f tempest-CinderUnicodeTest-502091172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a5153193-2437-4b44-8d42-f07a9a670036.8652cd77-dc68-4040-bb96-2bf411fab7c3" returned: 0 in 0.346s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:16 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-27d720be-1093-4ed8-9b92-2cd54ce2233f tempest-CinderUnicodeTest-502091172 None] Lock "cinder-quobyte-8652cd77-dc68-4040-bb96-2bf411fab7c3" released by "_delete_snapshot" :: held 1.847s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:11:16 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-50da1e0c-2cbe-4958-968d-5ecfacbb71ab tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:11:16 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-50da1e0c-2cbe-4958-968d-5ecfacbb71ab tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:11:16 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-50da1e0c-2cbe-4958-968d-5ecfacbb71ab tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:11:16 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-50da1e0c-2cbe-4958-968d-5ecfacbb71ab tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:11:16 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-50da1e0c-2cbe-4958-968d-5ecfacbb71ab tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:11:16 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-50da1e0c-2cbe-4958-968d-5ecfacbb71ab tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:16 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-27d720be-1093-4ed8-9b92-2cd54ce2233f tempest-CinderUnicodeTest-502091172 None] Lock "cinder-quobyte-a5153193-2437-4b44-8d42-f07a9a670036" released by "delete_snapshot" :: held 1.913s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:11:16 devstack sudo[104601]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:16 devstack sudo[104605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:11:16 devstack sudo[104605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:16 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-b06e74db-ef33-48fd-a70c-b8df111a9b85 tempest-VolumeAndVolumeTypeFromImageTest-1224775445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.382s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:16 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-b06e74db-ef33-48fd-a70c-b8df111a9b85 tempest-VolumeAndVolumeTypeFromImageTest-1224775445 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:11:16 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-b06e74db-ef33-48fd-a70c-b8df111a9b85 tempest-VolumeAndVolumeTypeFromImageTest-1224775445 None] Deleted volume successfully. Sep 17 22:11:16 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-b06e74db-ef33-48fd-a70c-b8df111a9b85 tempest-VolumeAndVolumeTypeFromImageTest-1224775445 None] Lock "cinder-0a04f574-40dc-452c-8e79-ef5b59cf0a01-delete_volume" released by "delete_volume" :: held 1.562s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:11:16 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-27d720be-1093-4ed8-9b92-2cd54ce2233f tempest-CinderUnicodeTest-502091172 None] Created reservations ['75a4fa84-d320-444e-99a7-10488727b13d', '3d739986-3502-4faf-81ef-c02c31e94447', 'e33bd5c2-8725-4449-9da4-b9d0619ed69a', '32f7e1dd-e519-4009-a685-cca30b9310fd'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:11:16 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-27d720be-1093-4ed8-9b92-2cd54ce2233f tempest-CinderUnicodeTest-502091172 None] Delete snapshot completed successfully. Sep 17 22:11:16 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-27d720be-1093-4ed8-9b92-2cd54ce2233f tempest-CinderUnicodeTest-502091172 None] Lock "cinder-8652cd77-dc68-4040-bb96-2bf411fab7c3-delete_snapshot" released by "delete_snapshot" :: held 2.181s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:11:16 devstack sudo[104605]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:16 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-50da1e0c-2cbe-4958-968d-5ecfacbb71ab tempest-CreateVolumesFromSourceVolumeTest-191538477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.317s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:16 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-50da1e0c-2cbe-4958-968d-5ecfacbb71ab tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:11:16 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-50da1e0c-2cbe-4958-968d-5ecfacbb71ab tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Deleted volume successfully. Sep 17 22:11:16 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-50da1e0c-2cbe-4958-968d-5ecfacbb71ab tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Lock "cinder-9317c1bf-893f-4f1b-b995-749a0b15458c-delete_volume" released by "delete_volume" :: held 1.579s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:11:16 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f886b10-1da9-448d-95f7-d6e912b8a84a tempest-ProjectMemberTests-1966135882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 22:11:16 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-4f886b10-1da9-448d-95f7-d6e912b8a84a tempest-ProjectMemberTests-1966135882 None] Flow 'volume_create_manager' (2be93ee2-9d2d-4f09-9ed2-5050779626ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:11:16 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-4f886b10-1da9-448d-95f7-d6e912b8a84a tempest-ProjectMemberTests-1966135882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (694ccc6b-ae04-459e-8ff5-42837c6c4921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:16 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-4f886b10-1da9-448d-95f7-d6e912b8a84a tempest-ProjectMemberTests-1966135882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (694ccc6b-ae04-459e-8ff5-42837c6c4921) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:11:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1992345384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a05cb841-e50a-4bd9-9c23-d0d341979b7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f277f501a340474ca5d0daea12e88955',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:11:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:11:17Z,use_quota=True,user_id='e584775bfb3c440aa7aac369d15efa55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:16 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-4f886b10-1da9-448d-95f7-d6e912b8a84a tempest-ProjectMemberTests-1966135882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (805bfd5f-292c-4e63-8ebc-d73bc7b4e18c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:16 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-4f886b10-1da9-448d-95f7-d6e912b8a84a tempest-ProjectMemberTests-1966135882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (805bfd5f-292c-4e63-8ebc-d73bc7b4e18c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:16 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-4f886b10-1da9-448d-95f7-d6e912b8a84a tempest-ProjectMemberTests-1966135882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (133221ec-d81b-43bd-bac7-02e7072d985c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:16 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-4f886b10-1da9-448d-95f7-d6e912b8a84a tempest-ProjectMemberTests-1966135882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (133221ec-d81b-43bd-bac7-02e7072d985c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a05cb841-e50a-4bd9-9c23-d0d341979b7c', 'volume_name': 'volume-a05cb841-e50a-4bd9-9c23-d0d341979b7c', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:16 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-4f886b10-1da9-448d-95f7-d6e912b8a84a tempest-ProjectMemberTests-1966135882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (572f4521-ca7b-45b8-9ef1-4b972b5649a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:16 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-4f886b10-1da9-448d-95f7-d6e912b8a84a tempest-ProjectMemberTests-1966135882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (572f4521-ca7b-45b8-9ef1-4b972b5649a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:16 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-4f886b10-1da9-448d-95f7-d6e912b8a84a tempest-ProjectMemberTests-1966135882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ebc667f-20cd-4756-8f01-72dc23a443be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:16 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-4f886b10-1da9-448d-95f7-d6e912b8a84a tempest-ProjectMemberTests-1966135882 None] Volume a05cb841-e50a-4bd9-9c23-d0d341979b7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a05cb841-e50a-4bd9-9c23-d0d341979b7c', 'volume_size': 1} Sep 17 22:11:16 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-4f886b10-1da9-448d-95f7-d6e912b8a84a tempest-ProjectMemberTests-1966135882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:11:16 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-4f886b10-1da9-448d-95f7-d6e912b8a84a tempest-ProjectMemberTests-1966135882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:11:16 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-4f886b10-1da9-448d-95f7-d6e912b8a84a tempest-ProjectMemberTests-1966135882 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:11:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1992345384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a05cb841-e50a-4bd9-9c23-d0d341979b7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f277f501a340474ca5d0daea12e88955',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:11:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:11:17Z,use_quota=True,user_id='e584775bfb3c440aa7aac369d15efa55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 22:11:16 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-4f886b10-1da9-448d-95f7-d6e912b8a84a tempest-ProjectMemberTests-1966135882 None] Creating volume a05cb841-e50a-4bd9-9c23-d0d341979b7c {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 22:11:16 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-4f886b10-1da9-448d-95f7-d6e912b8a84a tempest-ProjectMemberTests-1966135882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:11:16 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-4f886b10-1da9-448d-95f7-d6e912b8a84a tempest-ProjectMemberTests-1966135882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:11:16 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-4f886b10-1da9-448d-95f7-d6e912b8a84a tempest-ProjectMemberTests-1966135882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:11:16 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-4f886b10-1da9-448d-95f7-d6e912b8a84a tempest-ProjectMemberTests-1966135882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:11:16 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-4f886b10-1da9-448d-95f7-d6e912b8a84a tempest-ProjectMemberTests-1966135882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:11:16 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-4f886b10-1da9-448d-95f7-d6e912b8a84a tempest-ProjectMemberTests-1966135882 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 22:11:16 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-4f886b10-1da9-448d-95f7-d6e912b8a84a tempest-ProjectMemberTests-1966135882 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 22:11:16 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-4f886b10-1da9-448d-95f7-d6e912b8a84a tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a05cb841-e50a-4bd9-9c23-d0d341979b7c 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:17 devstack sudo[104608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a05cb841-e50a-4bd9-9c23-d0d341979b7c 1073741824 Sep 17 22:11:17 devstack sudo[104608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:17 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-5c7e0e90-c93c-4313-ae83-2dc80bd19908 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Acquiring lock "cinder-d2cc7187-c81e-4c2d-b5de-3cbe569fd11f-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:11:17 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-5c7e0e90-c93c-4313-ae83-2dc80bd19908 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Lock "cinder-d2cc7187-c81e-4c2d-b5de-3cbe569fd11f-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:11:17 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-5c7e0e90-c93c-4313-ae83-2dc80bd19908 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Acquiring lock "cinder-quobyte-d2cc7187-c81e-4c2d-b5de-3cbe569fd11f" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:11:17 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-5c7e0e90-c93c-4313-ae83-2dc80bd19908 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Lock "cinder-quobyte-d2cc7187-c81e-4c2d-b5de-3cbe569fd11f" acquired by "delete_volume" :: waited 0.025s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:11:17 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad0fb3a3-5b5e-400d-a47f-7682d98eb4e7]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:11:17 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-5c7e0e90-c93c-4313-ae83-2dc80bd19908 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-d2cc7187-c81e-4c2d-b5de-3cbe569fd11f {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:17 devstack sudo[104608]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:17 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-4f886b10-1da9-448d-95f7-d6e912b8a84a tempest-ProjectMemberTests-1966135882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a05cb841-e50a-4bd9-9c23-d0d341979b7c 1073741824" returned: 0 in 0.538s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:17 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-4f886b10-1da9-448d-95f7-d6e912b8a84a tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a05cb841-e50a-4bd9-9c23-d0d341979b7c {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:17 devstack sudo[104615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a05cb841-e50a-4bd9-9c23-d0d341979b7c Sep 17 22:11:17 devstack sudo[104615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:17 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-57efce3d-46ea-4748-98b7-0c1883da2ea3 tempest-CinderUnicodeTest-502091172 None] Acquiring lock "cinder-a5153193-2437-4b44-8d42-f07a9a670036-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:11:17 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-57efce3d-46ea-4748-98b7-0c1883da2ea3 tempest-CinderUnicodeTest-502091172 None] Lock "cinder-a5153193-2437-4b44-8d42-f07a9a670036-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:11:17 devstack sudo[104614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-d2cc7187-c81e-4c2d-b5de-3cbe569fd11f Sep 17 22:11:17 devstack sudo[104614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:17 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-57efce3d-46ea-4748-98b7-0c1883da2ea3 tempest-CinderUnicodeTest-502091172 None] Acquiring lock "cinder-quobyte-a5153193-2437-4b44-8d42-f07a9a670036" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:11:17 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-57efce3d-46ea-4748-98b7-0c1883da2ea3 tempest-CinderUnicodeTest-502091172 None] Lock "cinder-quobyte-a5153193-2437-4b44-8d42-f07a9a670036" acquired by "delete_volume" :: waited 0.020s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:11:17 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[011ec417-01c7-4e59-9a40-abe542b3005d]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:11:17 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-57efce3d-46ea-4748-98b7-0c1883da2ea3 tempest-CinderUnicodeTest-502091172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a5153193-2437-4b44-8d42-f07a9a670036 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:17 devstack sudo[104618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a5153193-2437-4b44-8d42-f07a9a670036 Sep 17 22:11:17 devstack sudo[104618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:17 devstack sudo[104615]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:17 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-4f886b10-1da9-448d-95f7-d6e912b8a84a tempest-ProjectMemberTests-1966135882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a05cb841-e50a-4bd9-9c23-d0d341979b7c" returned: 0 in 0.403s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:17 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-4f886b10-1da9-448d-95f7-d6e912b8a84a tempest-ProjectMemberTests-1966135882 None] <== create_volume: return (997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 22:11:17 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-4f886b10-1da9-448d-95f7-d6e912b8a84a tempest-ProjectMemberTests-1966135882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.999s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:11:17 devstack sudo[104614]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:17 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-5c7e0e90-c93c-4313-ae83-2dc80bd19908 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-d2cc7187-c81e-4c2d-b5de-3cbe569fd11f" returned: 0 in 0.484s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:17 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-5c7e0e90-c93c-4313-ae83-2dc80bd19908 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-d2cc7187-c81e-4c2d-b5de-3cbe569fd11f {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:18 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-4f886b10-1da9-448d-95f7-d6e912b8a84a tempest-ProjectMemberTests-1966135882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ebc667f-20cd-4756-8f01-72dc23a443be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a05cb841-e50a-4bd9-9c23-d0d341979b7c', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:18 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-4f886b10-1da9-448d-95f7-d6e912b8a84a tempest-ProjectMemberTests-1966135882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (538e1ff4-9f50-4712-b59c-5aa846efc3c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:18 devstack sudo[104624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-d2cc7187-c81e-4c2d-b5de-3cbe569fd11f Sep 17 22:11:18 devstack sudo[104624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:18 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-4f886b10-1da9-448d-95f7-d6e912b8a84a tempest-ProjectMemberTests-1966135882 None] Volume volume-a05cb841-e50a-4bd9-9c23-d0d341979b7c (a05cb841-e50a-4bd9-9c23-d0d341979b7c): created successfully Sep 17 22:11:18 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-4f886b10-1da9-448d-95f7-d6e912b8a84a tempest-ProjectMemberTests-1966135882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (538e1ff4-9f50-4712-b59c-5aa846efc3c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:18 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-4f886b10-1da9-448d-95f7-d6e912b8a84a tempest-ProjectMemberTests-1966135882 None] Flow 'volume_create_manager' (2be93ee2-9d2d-4f09-9ed2-5050779626ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:11:18 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-4f886b10-1da9-448d-95f7-d6e912b8a84a tempest-ProjectMemberTests-1966135882 None] Created volume successfully. Sep 17 22:11:18 devstack sudo[104618]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:18 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-57efce3d-46ea-4748-98b7-0c1883da2ea3 tempest-CinderUnicodeTest-502091172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a5153193-2437-4b44-8d42-f07a9a670036" returned: 0 in 0.454s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:18 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-57efce3d-46ea-4748-98b7-0c1883da2ea3 tempest-CinderUnicodeTest-502091172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a5153193-2437-4b44-8d42-f07a9a670036 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:18 devstack sudo[104624]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:18 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-5c7e0e90-c93c-4313-ae83-2dc80bd19908 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-d2cc7187-c81e-4c2d-b5de-3cbe569fd11f" returned: 0 in 0.306s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:18 devstack sudo[104630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a5153193-2437-4b44-8d42-f07a9a670036 Sep 17 22:11:18 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-5c7e0e90-c93c-4313-ae83-2dc80bd19908 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Lock "cinder-quobyte-d2cc7187-c81e-4c2d-b5de-3cbe569fd11f" released by "delete_volume" :: held 0.863s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:11:18 devstack sudo[104630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:18 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-5c7e0e90-c93c-4313-ae83-2dc80bd19908 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Created reservations ['427bac70-98bb-4a56-8bf9-6f6b15c81f21', '55be3257-ee45-4a60-bc4a-7999c4328e3d', '90b1b185-de4a-47ac-ac53-d9cf9fbbb350', '59b1ca95-3440-4474-9c87-1f6a1f593221'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:11:18 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-5c7e0e90-c93c-4313-ae83-2dc80bd19908 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:11:18 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-5c7e0e90-c93c-4313-ae83-2dc80bd19908 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:11:18 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-5c7e0e90-c93c-4313-ae83-2dc80bd19908 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:11:18 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-5c7e0e90-c93c-4313-ae83-2dc80bd19908 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:11:18 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-5c7e0e90-c93c-4313-ae83-2dc80bd19908 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:11:18 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-5c7e0e90-c93c-4313-ae83-2dc80bd19908 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:18 devstack sudo[104632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:11:18 devstack sudo[104632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:18 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-5707533e-caa8-4ef0-83cc-5f6e539c8787 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Acquiring lock "cinder-2071b381-05b2-47ca-80f9-24c058d7b1b1-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:11:18 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-5707533e-caa8-4ef0-83cc-5f6e539c8787 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Lock "cinder-2071b381-05b2-47ca-80f9-24c058d7b1b1-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:11:18 devstack sudo[104630]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:18 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-57efce3d-46ea-4748-98b7-0c1883da2ea3 tempest-CinderUnicodeTest-502091172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a5153193-2437-4b44-8d42-f07a9a670036" returned: 0 in 0.342s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:18 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-57efce3d-46ea-4748-98b7-0c1883da2ea3 tempest-CinderUnicodeTest-502091172 None] Lock "cinder-quobyte-a5153193-2437-4b44-8d42-f07a9a670036" released by "delete_volume" :: held 0.903s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:11:18 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-5707533e-caa8-4ef0-83cc-5f6e539c8787 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Acquiring lock "cinder-quobyte-2071b381-05b2-47ca-80f9-24c058d7b1b1" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:11:18 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-5707533e-caa8-4ef0-83cc-5f6e539c8787 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Lock "cinder-quobyte-2071b381-05b2-47ca-80f9-24c058d7b1b1" acquired by "delete_volume" :: waited 0.040s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:11:18 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-57efce3d-46ea-4748-98b7-0c1883da2ea3 tempest-CinderUnicodeTest-502091172 None] Created reservations ['cc4268ec-c24e-453d-b997-f17f9dc0ecaa', 'dd29025e-4e36-4a7b-a3a5-5291fbf64472', '1ffc96a4-0d87-4a42-921d-ac6d106a54ca', 'afe5f15e-8ef6-4529-a54f-fa4469481d93'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:11:18 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f83bea2-fb79-498f-9b4e-810236efc1bb]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:11:18 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-5707533e-caa8-4ef0-83cc-5f6e539c8787 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-2071b381-05b2-47ca-80f9-24c058d7b1b1 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:18 devstack sudo[104632]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:18 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-5c7e0e90-c93c-4313-ae83-2dc80bd19908 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.380s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:18 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-5c7e0e90-c93c-4313-ae83-2dc80bd19908 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:11:18 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-57efce3d-46ea-4748-98b7-0c1883da2ea3 tempest-CinderUnicodeTest-502091172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:11:18 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-57efce3d-46ea-4748-98b7-0c1883da2ea3 tempest-CinderUnicodeTest-502091172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:11:18 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-57efce3d-46ea-4748-98b7-0c1883da2ea3 tempest-CinderUnicodeTest-502091172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:11:18 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-57efce3d-46ea-4748-98b7-0c1883da2ea3 tempest-CinderUnicodeTest-502091172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:11:18 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-57efce3d-46ea-4748-98b7-0c1883da2ea3 tempest-CinderUnicodeTest-502091172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:11:18 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-57efce3d-46ea-4748-98b7-0c1883da2ea3 tempest-CinderUnicodeTest-502091172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:18 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-5c7e0e90-c93c-4313-ae83-2dc80bd19908 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Deleted volume successfully. Sep 17 22:11:18 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-5c7e0e90-c93c-4313-ae83-2dc80bd19908 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Lock "cinder-d2cc7187-c81e-4c2d-b5de-3cbe569fd11f-delete_volume" released by "delete_volume" :: held 1.544s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:11:18 devstack sudo[104637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:11:18 devstack sudo[104637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:18 devstack sudo[104636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-2071b381-05b2-47ca-80f9-24c058d7b1b1 Sep 17 22:11:18 devstack sudo[104636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:19 devstack sudo[104637]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:19 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-57efce3d-46ea-4748-98b7-0c1883da2ea3 tempest-CinderUnicodeTest-502091172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.312s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:19 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-57efce3d-46ea-4748-98b7-0c1883da2ea3 tempest-CinderUnicodeTest-502091172 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:11:19 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-57efce3d-46ea-4748-98b7-0c1883da2ea3 tempest-CinderUnicodeTest-502091172 None] Deleted volume successfully. Sep 17 22:11:19 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-57efce3d-46ea-4748-98b7-0c1883da2ea3 tempest-CinderUnicodeTest-502091172 None] Lock "cinder-a5153193-2437-4b44-8d42-f07a9a670036-delete_volume" released by "delete_volume" :: held 1.588s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:11:19 devstack sudo[104636]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:19 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-5707533e-caa8-4ef0-83cc-5f6e539c8787 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-2071b381-05b2-47ca-80f9-24c058d7b1b1" returned: 0 in 0.548s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:19 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-5707533e-caa8-4ef0-83cc-5f6e539c8787 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-2071b381-05b2-47ca-80f9-24c058d7b1b1 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:19 devstack sudo[104644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-2071b381-05b2-47ca-80f9-24c058d7b1b1 Sep 17 22:11:19 devstack sudo[104644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:19 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e7b7721a-55cd-4590-89d4-07cf9b9d70fd tempest-ProjectMemberTests-1966135882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:11:19 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e7b7721a-55cd-4590-89d4-07cf9b9d70fd tempest-ProjectMemberTests-1966135882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:11:19 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-e7b7721a-55cd-4590-89d4-07cf9b9d70fd tempest-ProjectMemberTests-1966135882 None] Creating offline snapshot 860c62e9-ba98-4978-bd20-8be8c5ffdce2 of volume a05cb841-e50a-4bd9-9c23-d0d341979b7c {{(pid=85458) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 22:11:19 devstack sudo[104644]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:19 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-5707533e-caa8-4ef0-83cc-5f6e539c8787 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-2071b381-05b2-47ca-80f9-24c058d7b1b1" returned: 0 in 0.293s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:19 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[a28d1439-d492-4891-85af-86667d96a374]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:11:19 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e7b7721a-55cd-4590-89d4-07cf9b9d70fd tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a05cb841-e50a-4bd9-9c23-d0d341979b7c {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:19 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-5707533e-caa8-4ef0-83cc-5f6e539c8787 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Lock "cinder-quobyte-2071b381-05b2-47ca-80f9-24c058d7b1b1" released by "delete_volume" :: held 0.921s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:11:19 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-5707533e-caa8-4ef0-83cc-5f6e539c8787 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Created reservations ['73b82ea0-5af8-46da-a4d1-b832269da51a', '954db7e0-1bba-42de-9064-5ae8c8163867', '2ae40fe2-096b-4298-acf8-706bab45dff2', 'bd30f845-cef4-42dc-a62c-7fb8ae2cc329'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:11:19 devstack sudo[104648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a05cb841-e50a-4bd9-9c23-d0d341979b7c Sep 17 22:11:19 devstack sudo[104648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:19 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-5707533e-caa8-4ef0-83cc-5f6e539c8787 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:11:19 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-5707533e-caa8-4ef0-83cc-5f6e539c8787 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:11:19 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-5707533e-caa8-4ef0-83cc-5f6e539c8787 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:11:19 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-5707533e-caa8-4ef0-83cc-5f6e539c8787 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:11:19 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-5707533e-caa8-4ef0-83cc-5f6e539c8787 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:11:19 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-5707533e-caa8-4ef0-83cc-5f6e539c8787 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:19 devstack sudo[104650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:11:19 devstack sudo[104650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:19 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-6e70b9ce-8577-4411-8c37-8d9ee51949bc tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Acquiring lock "cinder-fcbdc049-4cbd-41f1-9210-4d1a1e60ef86-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:11:19 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-6e70b9ce-8577-4411-8c37-8d9ee51949bc tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Lock "cinder-fcbdc049-4cbd-41f1-9210-4d1a1e60ef86-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:11:19 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-6e70b9ce-8577-4411-8c37-8d9ee51949bc tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Acquiring lock "cinder-quobyte-fcbdc049-4cbd-41f1-9210-4d1a1e60ef86" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:11:19 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-6e70b9ce-8577-4411-8c37-8d9ee51949bc tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Lock "cinder-quobyte-fcbdc049-4cbd-41f1-9210-4d1a1e60ef86" acquired by "delete_volume" :: waited 0.015s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:11:20 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-ece420b6-9a47-42bc-80b4-2112dbe138b9 tempest-CinderUnicodeTest-502091172 None] Acquiring lock "cinder-c5ae6aee-99d6-4c2f-93ad-912092b1392a-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:11:20 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-ece420b6-9a47-42bc-80b4-2112dbe138b9 tempest-CinderUnicodeTest-502091172 None] Lock "cinder-c5ae6aee-99d6-4c2f-93ad-912092b1392a-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:11:20 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[73525e3e-7599-4dad-8e56-88c26b191b88]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:11:20 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-6e70b9ce-8577-4411-8c37-8d9ee51949bc tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-fcbdc049-4cbd-41f1-9210-4d1a1e60ef86 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:20 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-ece420b6-9a47-42bc-80b4-2112dbe138b9 tempest-CinderUnicodeTest-502091172 None] Acquiring lock "cinder-quobyte-c5ae6aee-99d6-4c2f-93ad-912092b1392a" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:11:20 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-ece420b6-9a47-42bc-80b4-2112dbe138b9 tempest-CinderUnicodeTest-502091172 None] Lock "cinder-quobyte-c5ae6aee-99d6-4c2f-93ad-912092b1392a" acquired by "delete_volume" :: waited 0.020s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:11:20 devstack sudo[104648]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:20 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e7b7721a-55cd-4590-89d4-07cf9b9d70fd tempest-ProjectMemberTests-1966135882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a05cb841-e50a-4bd9-9c23-d0d341979b7c" returned: 0 in 0.534s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:20 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e7b7721a-55cd-4590-89d4-07cf9b9d70fd tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a05cb841-e50a-4bd9-9c23-d0d341979b7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a05cb841-e50a-4bd9-9c23-d0d341979b7c.860c62e9-ba98-4978-bd20-8be8c5ffdce2 1G {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:20 devstack sudo[104654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-fcbdc049-4cbd-41f1-9210-4d1a1e60ef86 Sep 17 22:11:20 devstack sudo[104654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:20 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[63edee60-1305-42c8-bf45-d52cb14ab7f7]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:11:20 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-ece420b6-9a47-42bc-80b4-2112dbe138b9 tempest-CinderUnicodeTest-502091172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c5ae6aee-99d6-4c2f-93ad-912092b1392a {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:20 devstack sudo[104650]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:20 devstack sudo[104658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a05cb841-e50a-4bd9-9c23-d0d341979b7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a05cb841-e50a-4bd9-9c23-d0d341979b7c.860c62e9-ba98-4978-bd20-8be8c5ffdce2 1G Sep 17 22:11:20 devstack sudo[104658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:20 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-5707533e-caa8-4ef0-83cc-5f6e539c8787 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.409s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:20 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-5707533e-caa8-4ef0-83cc-5f6e539c8787 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:11:20 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-5707533e-caa8-4ef0-83cc-5f6e539c8787 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Deleted volume successfully. Sep 17 22:11:20 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-5707533e-caa8-4ef0-83cc-5f6e539c8787 tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Lock "cinder-2071b381-05b2-47ca-80f9-24c058d7b1b1-delete_volume" released by "delete_volume" :: held 1.642s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:11:20 devstack sudo[104659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c5ae6aee-99d6-4c2f-93ad-912092b1392a Sep 17 22:11:20 devstack sudo[104659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:20 devstack sudo[104654]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:20 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-6e70b9ce-8577-4411-8c37-8d9ee51949bc tempest-CreateVolumesFromSourceVolumeTest-191538477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-fcbdc049-4cbd-41f1-9210-4d1a1e60ef86" returned: 0 in 0.488s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:20 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-6e70b9ce-8577-4411-8c37-8d9ee51949bc tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-fcbdc049-4cbd-41f1-9210-4d1a1e60ef86 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:20 devstack sudo[104671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-fcbdc049-4cbd-41f1-9210-4d1a1e60ef86 Sep 17 22:11:20 devstack sudo[104671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:20 devstack sudo[104658]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:20 devstack sudo[104659]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:20 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e7b7721a-55cd-4590-89d4-07cf9b9d70fd tempest-ProjectMemberTests-1966135882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a05cb841-e50a-4bd9-9c23-d0d341979b7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a05cb841-e50a-4bd9-9c23-d0d341979b7c.860c62e9-ba98-4978-bd20-8be8c5ffdce2 1G" returned: 0 in 0.472s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:20 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-ece420b6-9a47-42bc-80b4-2112dbe138b9 tempest-CinderUnicodeTest-502091172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c5ae6aee-99d6-4c2f-93ad-912092b1392a" returned: 0 in 0.458s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:20 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e7b7721a-55cd-4590-89d4-07cf9b9d70fd tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a05cb841-e50a-4bd9-9c23-d0d341979b7c -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a05cb841-e50a-4bd9-9c23-d0d341979b7c.860c62e9-ba98-4978-bd20-8be8c5ffdce2 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:20 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-ece420b6-9a47-42bc-80b4-2112dbe138b9 tempest-CinderUnicodeTest-502091172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c5ae6aee-99d6-4c2f-93ad-912092b1392a {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:20 devstack sudo[104675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a05cb841-e50a-4bd9-9c23-d0d341979b7c -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a05cb841-e50a-4bd9-9c23-d0d341979b7c.860c62e9-ba98-4978-bd20-8be8c5ffdce2 Sep 17 22:11:20 devstack sudo[104675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:20 devstack sudo[104676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c5ae6aee-99d6-4c2f-93ad-912092b1392a Sep 17 22:11:20 devstack sudo[104676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:20 devstack sudo[104671]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:20 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-6e70b9ce-8577-4411-8c37-8d9ee51949bc tempest-CreateVolumesFromSourceVolumeTest-191538477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-fcbdc049-4cbd-41f1-9210-4d1a1e60ef86" returned: 0 in 0.324s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:20 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-6e70b9ce-8577-4411-8c37-8d9ee51949bc tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Lock "cinder-quobyte-fcbdc049-4cbd-41f1-9210-4d1a1e60ef86" released by "delete_volume" :: held 0.910s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:11:20 devstack sudo[104676]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:20 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-ece420b6-9a47-42bc-80b4-2112dbe138b9 tempest-CinderUnicodeTest-502091172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c5ae6aee-99d6-4c2f-93ad-912092b1392a" returned: 0 in 0.291s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:20 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-6e70b9ce-8577-4411-8c37-8d9ee51949bc tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Created reservations ['c20ff424-6877-445e-9217-10052b970689', '6c2401b5-735d-4fd1-baf6-34e1f00cdb70', 'b9c8cf39-22a6-4f8c-a9f6-f0570dc07674', 'f53430f6-c452-4ea6-83ac-156eadcf7c7e'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:11:20 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-ece420b6-9a47-42bc-80b4-2112dbe138b9 tempest-CinderUnicodeTest-502091172 None] Lock "cinder-quobyte-c5ae6aee-99d6-4c2f-93ad-912092b1392a" released by "delete_volume" :: held 0.840s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:11:21 devstack sudo[104675]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:21 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e7b7721a-55cd-4590-89d4-07cf9b9d70fd tempest-ProjectMemberTests-1966135882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a05cb841-e50a-4bd9-9c23-d0d341979b7c -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a05cb841-e50a-4bd9-9c23-d0d341979b7c.860c62e9-ba98-4978-bd20-8be8c5ffdce2" returned: 0 in 0.385s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:21 devstack cinder-volume[85458]: WARNING cinder.volume.drivers.remotefs [None req-e7b7721a-55cd-4590-89d4-07cf9b9d70fd tempest-ProjectMemberTests-1966135882 None] /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a05cb841-e50a-4bd9-9c23-d0d341979b7c.860c62e9-ba98-4978-bd20-8be8c5ffdce2 is being set with open permissions: ugo+rw Sep 17 22:11:21 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e7b7721a-55cd-4590-89d4-07cf9b9d70fd tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a05cb841-e50a-4bd9-9c23-d0d341979b7c.860c62e9-ba98-4978-bd20-8be8c5ffdce2 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:21 devstack sudo[104685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a05cb841-e50a-4bd9-9c23-d0d341979b7c.860c62e9-ba98-4978-bd20-8be8c5ffdce2 Sep 17 22:11:21 devstack sudo[104685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:21 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-6e70b9ce-8577-4411-8c37-8d9ee51949bc tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:11:21 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-6e70b9ce-8577-4411-8c37-8d9ee51949bc tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:11:21 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-6e70b9ce-8577-4411-8c37-8d9ee51949bc tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:11:21 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-6e70b9ce-8577-4411-8c37-8d9ee51949bc tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:11:21 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-6e70b9ce-8577-4411-8c37-8d9ee51949bc tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:11:21 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-6e70b9ce-8577-4411-8c37-8d9ee51949bc tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:21 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-ece420b6-9a47-42bc-80b4-2112dbe138b9 tempest-CinderUnicodeTest-502091172 None] Created reservations ['376a93c8-b302-4944-ba2c-f4986023739f', '80a96543-42c2-45c3-9472-93c5fc71a430', '06c9f93e-8b51-4cfc-8ceb-d62da3d9b8ef', 'ce0d2b54-1960-460f-acba-dcd7e27006bf'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:11:21 devstack sudo[104687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:11:21 devstack sudo[104687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:21 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-ece420b6-9a47-42bc-80b4-2112dbe138b9 tempest-CinderUnicodeTest-502091172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:11:21 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-ece420b6-9a47-42bc-80b4-2112dbe138b9 tempest-CinderUnicodeTest-502091172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:11:21 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-ece420b6-9a47-42bc-80b4-2112dbe138b9 tempest-CinderUnicodeTest-502091172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:11:21 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-ece420b6-9a47-42bc-80b4-2112dbe138b9 tempest-CinderUnicodeTest-502091172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:11:21 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-ece420b6-9a47-42bc-80b4-2112dbe138b9 tempest-CinderUnicodeTest-502091172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:11:21 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-ece420b6-9a47-42bc-80b4-2112dbe138b9 tempest-CinderUnicodeTest-502091172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:21 devstack sudo[104689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:11:21 devstack sudo[104689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:21 devstack sudo[104685]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:21 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e7b7721a-55cd-4590-89d4-07cf9b9d70fd tempest-ProjectMemberTests-1966135882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a05cb841-e50a-4bd9-9c23-d0d341979b7c.860c62e9-ba98-4978-bd20-8be8c5ffdce2" returned: 0 in 0.379s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:21 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e7b7721a-55cd-4590-89d4-07cf9b9d70fd tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a05cb841-e50a-4bd9-9c23-d0d341979b7c.info {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:21 devstack sudo[104687]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:21 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-6e70b9ce-8577-4411-8c37-8d9ee51949bc tempest-CreateVolumesFromSourceVolumeTest-191538477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.421s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:21 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-6e70b9ce-8577-4411-8c37-8d9ee51949bc tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:11:21 devstack sudo[104693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a05cb841-e50a-4bd9-9c23-d0d341979b7c.info Sep 17 22:11:21 devstack sudo[104693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:21 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-6e70b9ce-8577-4411-8c37-8d9ee51949bc tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Deleted volume successfully. Sep 17 22:11:21 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-6e70b9ce-8577-4411-8c37-8d9ee51949bc tempest-CreateVolumesFromSourceVolumeTest-191538477 None] Lock "cinder-fcbdc049-4cbd-41f1-9210-4d1a1e60ef86-delete_volume" released by "delete_volume" :: held 1.664s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:11:21 devstack sudo[104689]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:21 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-ece420b6-9a47-42bc-80b4-2112dbe138b9 tempest-CinderUnicodeTest-502091172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.364s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:21 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-ece420b6-9a47-42bc-80b4-2112dbe138b9 tempest-CinderUnicodeTest-502091172 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:11:21 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-ece420b6-9a47-42bc-80b4-2112dbe138b9 tempest-CinderUnicodeTest-502091172 None] Deleted volume successfully. Sep 17 22:11:21 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-ece420b6-9a47-42bc-80b4-2112dbe138b9 tempest-CinderUnicodeTest-502091172 None] Lock "cinder-c5ae6aee-99d6-4c2f-93ad-912092b1392a-delete_volume" released by "delete_volume" :: held 1.623s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:11:21 devstack sudo[104693]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:21 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e7b7721a-55cd-4590-89d4-07cf9b9d70fd tempest-ProjectMemberTests-1966135882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a05cb841-e50a-4bd9-9c23-d0d341979b7c.info" returned: 0 in 0.340s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:21 devstack cinder-volume[85458]: WARNING cinder.volume.drivers.remotefs [None req-e7b7721a-55cd-4590-89d4-07cf9b9d70fd tempest-ProjectMemberTests-1966135882 None] /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a05cb841-e50a-4bd9-9c23-d0d341979b7c.info is being set with open permissions: ugo+rw Sep 17 22:11:21 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e7b7721a-55cd-4590-89d4-07cf9b9d70fd tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a05cb841-e50a-4bd9-9c23-d0d341979b7c.info {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:21 devstack sudo[104697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a05cb841-e50a-4bd9-9c23-d0d341979b7c.info Sep 17 22:11:21 devstack sudo[104697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:21 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-d56c431d-8486-401c-9e7b-bbee6dc6e70e tempest-CreateVolumesFromSnapshotTest-1444870577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 22:11:21 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-d56c431d-8486-401c-9e7b-bbee6dc6e70e tempest-CreateVolumesFromSnapshotTest-1444870577 None] Flow 'volume_create_manager' (4be6ab21-ad76-4a04-bccf-8ebe0ee05f8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:11:21 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-d56c431d-8486-401c-9e7b-bbee6dc6e70e tempest-CreateVolumesFromSnapshotTest-1444870577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36bc1c2f-feee-4a28-b445-4a709e26ec50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:21 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-d56c431d-8486-401c-9e7b-bbee6dc6e70e tempest-CreateVolumesFromSnapshotTest-1444870577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36bc1c2f-feee-4a28-b445-4a709e26ec50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:11:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2023461129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e6b5232-9223-4d7c-b5a1-fab05761fadc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='378205ccfa9949c1a6bae07a5e05d296',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:11:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:11:22Z,use_quota=True,user_id='1f5b811e4141485e8a7aa317d71d1870',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:21 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-d56c431d-8486-401c-9e7b-bbee6dc6e70e tempest-CreateVolumesFromSnapshotTest-1444870577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e8bffd1-ccac-4efd-b280-327cd09154bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:21 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-d56c431d-8486-401c-9e7b-bbee6dc6e70e tempest-CreateVolumesFromSnapshotTest-1444870577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e8bffd1-ccac-4efd-b280-327cd09154bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:21 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-d56c431d-8486-401c-9e7b-bbee6dc6e70e tempest-CreateVolumesFromSnapshotTest-1444870577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26fdf838-fd18-47e0-b011-273adeb4dd25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:21 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-d56c431d-8486-401c-9e7b-bbee6dc6e70e tempest-CreateVolumesFromSnapshotTest-1444870577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26fdf838-fd18-47e0-b011-273adeb4dd25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e6b5232-9223-4d7c-b5a1-fab05761fadc', 'volume_name': 'volume-9e6b5232-9223-4d7c-b5a1-fab05761fadc', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:21 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-d56c431d-8486-401c-9e7b-bbee6dc6e70e tempest-CreateVolumesFromSnapshotTest-1444870577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d3aa684-cf0b-4a25-98ab-248fb25ebdc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:21 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-d56c431d-8486-401c-9e7b-bbee6dc6e70e tempest-CreateVolumesFromSnapshotTest-1444870577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d3aa684-cf0b-4a25-98ab-248fb25ebdc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:21 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-d56c431d-8486-401c-9e7b-bbee6dc6e70e tempest-CreateVolumesFromSnapshotTest-1444870577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7de2558a-e0f1-4bf3-a0e7-222f08db1084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:21 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-d56c431d-8486-401c-9e7b-bbee6dc6e70e tempest-CreateVolumesFromSnapshotTest-1444870577 None] Volume 9e6b5232-9223-4d7c-b5a1-fab05761fadc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e6b5232-9223-4d7c-b5a1-fab05761fadc', 'volume_size': 1} Sep 17 22:11:21 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-d56c431d-8486-401c-9e7b-bbee6dc6e70e tempest-CreateVolumesFromSnapshotTest-1444870577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:11:22 devstack sudo[104697]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:22 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e7b7721a-55cd-4590-89d4-07cf9b9d70fd tempest-ProjectMemberTests-1966135882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a05cb841-e50a-4bd9-9c23-d0d341979b7c.info" returned: 0 in 0.275s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:22 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e7b7721a-55cd-4590-89d4-07cf9b9d70fd tempest-ProjectMemberTests-1966135882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.507s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:11:22 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-d56c431d-8486-401c-9e7b-bbee6dc6e70e tempest-CreateVolumesFromSnapshotTest-1444870577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.152s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:11:22 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-d56c431d-8486-401c-9e7b-bbee6dc6e70e tempest-CreateVolumesFromSnapshotTest-1444870577 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:11:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2023461129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e6b5232-9223-4d7c-b5a1-fab05761fadc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='378205ccfa9949c1a6bae07a5e05d296',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:11:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:11:22Z,use_quota=True,user_id='1f5b811e4141485e8a7aa317d71d1870',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 22:11:22 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-d56c431d-8486-401c-9e7b-bbee6dc6e70e tempest-CreateVolumesFromSnapshotTest-1444870577 None] Creating volume 9e6b5232-9223-4d7c-b5a1-fab05761fadc {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 22:11:22 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-d56c431d-8486-401c-9e7b-bbee6dc6e70e tempest-CreateVolumesFromSnapshotTest-1444870577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:11:22 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-d56c431d-8486-401c-9e7b-bbee6dc6e70e tempest-CreateVolumesFromSnapshotTest-1444870577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:11:22 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-d56c431d-8486-401c-9e7b-bbee6dc6e70e tempest-CreateVolumesFromSnapshotTest-1444870577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:11:22 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-d56c431d-8486-401c-9e7b-bbee6dc6e70e tempest-CreateVolumesFromSnapshotTest-1444870577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:11:22 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-d56c431d-8486-401c-9e7b-bbee6dc6e70e tempest-CreateVolumesFromSnapshotTest-1444870577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:11:22 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-d56c431d-8486-401c-9e7b-bbee6dc6e70e tempest-CreateVolumesFromSnapshotTest-1444870577 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 22:11:22 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-d56c431d-8486-401c-9e7b-bbee6dc6e70e tempest-CreateVolumesFromSnapshotTest-1444870577 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 22:11:22 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-d56c431d-8486-401c-9e7b-bbee6dc6e70e tempest-CreateVolumesFromSnapshotTest-1444870577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-9e6b5232-9223-4d7c-b5a1-fab05761fadc 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:22 devstack sudo[104700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-9e6b5232-9223-4d7c-b5a1-fab05761fadc 1073741824 Sep 17 22:11:22 devstack sudo[104700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:22 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-e7b7721a-55cd-4590-89d4-07cf9b9d70fd tempest-ProjectMemberTests-1966135882 None] Create snapshot completed successfully Sep 17 22:11:22 devstack sudo[104700]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:22 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-d56c431d-8486-401c-9e7b-bbee6dc6e70e tempest-CreateVolumesFromSnapshotTest-1444870577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-9e6b5232-9223-4d7c-b5a1-fab05761fadc 1073741824" returned: 0 in 0.541s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:22 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-d56c431d-8486-401c-9e7b-bbee6dc6e70e tempest-CreateVolumesFromSnapshotTest-1444870577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-9e6b5232-9223-4d7c-b5a1-fab05761fadc {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:22 devstack sudo[104707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-9e6b5232-9223-4d7c-b5a1-fab05761fadc Sep 17 22:11:22 devstack sudo[104707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:22 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-e0c4e93b-45df-499b-82e2-794c619af523 tempest-ProjectMemberTests-1966135882 None] Acquiring lock "cinder-860c62e9-ba98-4978-bd20-8be8c5ffdce2-delete_snapshot" by "delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:11:22 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-e0c4e93b-45df-499b-82e2-794c619af523 tempest-ProjectMemberTests-1966135882 None] Lock "cinder-860c62e9-ba98-4978-bd20-8be8c5ffdce2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:11:22 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-e0c4e93b-45df-499b-82e2-794c619af523 tempest-ProjectMemberTests-1966135882 None] Acquiring lock "cinder-quobyte-a05cb841-e50a-4bd9-9c23-d0d341979b7c" by "delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:11:22 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-e0c4e93b-45df-499b-82e2-794c619af523 tempest-ProjectMemberTests-1966135882 None] Lock "cinder-quobyte-a05cb841-e50a-4bd9-9c23-d0d341979b7c" acquired by "delete_snapshot" :: waited 0.037s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:11:22 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-e0c4e93b-45df-499b-82e2-794c619af523 tempest-ProjectMemberTests-1966135882 None] Acquiring lock "cinder-quobyte-860c62e9-ba98-4978-bd20-8be8c5ffdce2" by "_delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:11:23 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-e0c4e93b-45df-499b-82e2-794c619af523 tempest-ProjectMemberTests-1966135882 None] Lock "cinder-quobyte-860c62e9-ba98-4978-bd20-8be8c5ffdce2" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:11:23 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-e0c4e93b-45df-499b-82e2-794c619af523 tempest-ProjectMemberTests-1966135882 None] Deleting offline snapshot 860c62e9-ba98-4978-bd20-8be8c5ffdce2 of volume a05cb841-e50a-4bd9-9c23-d0d341979b7c {{(pid=85458) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 22:11:23 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-e0c4e93b-45df-499b-82e2-794c619af523 tempest-ProjectMemberTests-1966135882 None] snapshot_file for this snap is: volume-a05cb841-e50a-4bd9-9c23-d0d341979b7c.860c62e9-ba98-4978-bd20-8be8c5ffdce2 {{(pid=85458) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 22:11:23 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3f681d1-1351-4be4-abcb-2511cdf94e2c]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:11:23 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e0c4e93b-45df-499b-82e2-794c619af523 tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a05cb841-e50a-4bd9-9c23-d0d341979b7c.860c62e9-ba98-4978-bd20-8be8c5ffdce2 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:23 devstack sudo[104707]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:23 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-d56c431d-8486-401c-9e7b-bbee6dc6e70e tempest-CreateVolumesFromSnapshotTest-1444870577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-9e6b5232-9223-4d7c-b5a1-fab05761fadc" returned: 0 in 0.432s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:23 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-d56c431d-8486-401c-9e7b-bbee6dc6e70e tempest-CreateVolumesFromSnapshotTest-1444870577 None] <== create_volume: return (1017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 22:11:23 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-d56c431d-8486-401c-9e7b-bbee6dc6e70e tempest-CreateVolumesFromSnapshotTest-1444870577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.019s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:11:23 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-d56c431d-8486-401c-9e7b-bbee6dc6e70e tempest-CreateVolumesFromSnapshotTest-1444870577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7de2558a-e0f1-4bf3-a0e7-222f08db1084) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e6b5232-9223-4d7c-b5a1-fab05761fadc', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:23 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-d56c431d-8486-401c-9e7b-bbee6dc6e70e tempest-CreateVolumesFromSnapshotTest-1444870577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01dee470-0935-4a83-aee5-19c79d930379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:23 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-d56c431d-8486-401c-9e7b-bbee6dc6e70e tempest-CreateVolumesFromSnapshotTest-1444870577 None] Volume volume-9e6b5232-9223-4d7c-b5a1-fab05761fadc (9e6b5232-9223-4d7c-b5a1-fab05761fadc): created successfully Sep 17 22:11:23 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-d56c431d-8486-401c-9e7b-bbee6dc6e70e tempest-CreateVolumesFromSnapshotTest-1444870577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01dee470-0935-4a83-aee5-19c79d930379) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:23 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-d56c431d-8486-401c-9e7b-bbee6dc6e70e tempest-CreateVolumesFromSnapshotTest-1444870577 None] Flow 'volume_create_manager' (4be6ab21-ad76-4a04-bccf-8ebe0ee05f8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:11:23 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-d56c431d-8486-401c-9e7b-bbee6dc6e70e tempest-CreateVolumesFromSnapshotTest-1444870577 None] Created volume successfully. Sep 17 22:11:23 devstack sudo[104710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a05cb841-e50a-4bd9-9c23-d0d341979b7c.860c62e9-ba98-4978-bd20-8be8c5ffdce2 Sep 17 22:11:23 devstack sudo[104710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:23 devstack sudo[104710]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:23 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e0c4e93b-45df-499b-82e2-794c619af523 tempest-ProjectMemberTests-1966135882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a05cb841-e50a-4bd9-9c23-d0d341979b7c.860c62e9-ba98-4978-bd20-8be8c5ffdce2" returned: 0 in 0.494s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:23 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-e0c4e93b-45df-499b-82e2-794c619af523 tempest-ProjectMemberTests-1966135882 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a05cb841-e50a-4bd9-9c23-d0d341979b7c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85458) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 22:11:23 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfe037f1-3f14-4a94-86d8-0754edded18e]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:11:23 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e0c4e93b-45df-499b-82e2-794c619af523 tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a05cb841-e50a-4bd9-9c23-d0d341979b7c {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:23 devstack sudo[104715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a05cb841-e50a-4bd9-9c23-d0d341979b7c Sep 17 22:11:23 devstack sudo[104715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:24 devstack sudo[104715]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:24 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e0c4e93b-45df-499b-82e2-794c619af523 tempest-ProjectMemberTests-1966135882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a05cb841-e50a-4bd9-9c23-d0d341979b7c" returned: 0 in 0.472s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:24 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e0c4e93b-45df-499b-82e2-794c619af523 tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a05cb841-e50a-4bd9-9c23-d0d341979b7c.860c62e9-ba98-4978-bd20-8be8c5ffdce2 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:24 devstack sudo[104720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a05cb841-e50a-4bd9-9c23-d0d341979b7c.860c62e9-ba98-4978-bd20-8be8c5ffdce2 Sep 17 22:11:24 devstack sudo[104720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:24 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-2c724512-4e86-47ed-8a2a-86d549adfb3d tempest-CreateVolumesFromSnapshotTest-1444870577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:11:24 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-2c724512-4e86-47ed-8a2a-86d549adfb3d tempest-CreateVolumesFromSnapshotTest-1444870577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:11:24 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-2c724512-4e86-47ed-8a2a-86d549adfb3d tempest-CreateVolumesFromSnapshotTest-1444870577 None] Creating offline snapshot 6c62fdad-4460-499f-b0c1-cc4bfa84999d of volume 9e6b5232-9223-4d7c-b5a1-fab05761fadc {{(pid=85458) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 22:11:24 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0077b26-9c03-4f32-83a8-b92e9b4092c7]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:11:24 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-2c724512-4e86-47ed-8a2a-86d549adfb3d tempest-CreateVolumesFromSnapshotTest-1444870577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-9e6b5232-9223-4d7c-b5a1-fab05761fadc {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:24 devstack sudo[104722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-9e6b5232-9223-4d7c-b5a1-fab05761fadc Sep 17 22:11:24 devstack sudo[104722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:24 devstack sudo[104720]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:24 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e0c4e93b-45df-499b-82e2-794c619af523 tempest-ProjectMemberTests-1966135882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a05cb841-e50a-4bd9-9c23-d0d341979b7c.860c62e9-ba98-4978-bd20-8be8c5ffdce2" returned: 0 in 0.459s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:24 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e0c4e93b-45df-499b-82e2-794c619af523 tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a05cb841-e50a-4bd9-9c23-d0d341979b7c.860c62e9-ba98-4978-bd20-8be8c5ffdce2 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:24 devstack sudo[104728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a05cb841-e50a-4bd9-9c23-d0d341979b7c.860c62e9-ba98-4978-bd20-8be8c5ffdce2 Sep 17 22:11:24 devstack sudo[104728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:24 devstack sudo[104722]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:24 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-2c724512-4e86-47ed-8a2a-86d549adfb3d tempest-CreateVolumesFromSnapshotTest-1444870577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-9e6b5232-9223-4d7c-b5a1-fab05761fadc" returned: 0 in 0.482s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:24 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-2c724512-4e86-47ed-8a2a-86d549adfb3d tempest-CreateVolumesFromSnapshotTest-1444870577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-9e6b5232-9223-4d7c-b5a1-fab05761fadc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-9e6b5232-9223-4d7c-b5a1-fab05761fadc.6c62fdad-4460-499f-b0c1-cc4bfa84999d 1G {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:24 devstack sudo[104733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-9e6b5232-9223-4d7c-b5a1-fab05761fadc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-9e6b5232-9223-4d7c-b5a1-fab05761fadc.6c62fdad-4460-499f-b0c1-cc4bfa84999d 1G Sep 17 22:11:24 devstack sudo[104733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:24 devstack sudo[104728]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:24 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e0c4e93b-45df-499b-82e2-794c619af523 tempest-ProjectMemberTests-1966135882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a05cb841-e50a-4bd9-9c23-d0d341979b7c.860c62e9-ba98-4978-bd20-8be8c5ffdce2" returned: 0 in 0.344s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:24 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-e0c4e93b-45df-499b-82e2-794c619af523 tempest-ProjectMemberTests-1966135882 None] Lock "cinder-quobyte-860c62e9-ba98-4978-bd20-8be8c5ffdce2" released by "_delete_snapshot" :: held 1.954s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:11:24 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-e0c4e93b-45df-499b-82e2-794c619af523 tempest-ProjectMemberTests-1966135882 None] Lock "cinder-quobyte-a05cb841-e50a-4bd9-9c23-d0d341979b7c" released by "delete_snapshot" :: held 2.005s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:11:25 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-273ec950-8499-4fe2-8913-c23f2b790a88 tempest-VolumeDependencyTests-1793337236 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 22:11:25 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-273ec950-8499-4fe2-8913-c23f2b790a88 tempest-VolumeDependencyTests-1793337236 None] Flow 'volume_create_manager' (9d3d7434-833b-4468-8253-8634c8ed765c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:11:25 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-273ec950-8499-4fe2-8913-c23f2b790a88 tempest-VolumeDependencyTests-1793337236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee5ee44a-ae94-4409-a4ba-1949dc9f2af0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:25 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-273ec950-8499-4fe2-8913-c23f2b790a88 tempest-VolumeDependencyTests-1793337236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee5ee44a-ae94-4409-a4ba-1949dc9f2af0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:11:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-242864991',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb27067a-148e-4e64-8962-3ac16bc80cf8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d28e78916bc9453387f9808dbfc231f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:11:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:11:25Z,use_quota=True,user_id='737af02dd74a4a3b988468eec18e881e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:25 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-273ec950-8499-4fe2-8913-c23f2b790a88 tempest-VolumeDependencyTests-1793337236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5f260f3-2648-44e7-86ff-1f89f4923299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:25 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-273ec950-8499-4fe2-8913-c23f2b790a88 tempest-VolumeDependencyTests-1793337236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5f260f3-2648-44e7-86ff-1f89f4923299) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:25 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-273ec950-8499-4fe2-8913-c23f2b790a88 tempest-VolumeDependencyTests-1793337236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d689565-a40c-4b21-9817-299e4ed80b84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:25 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-273ec950-8499-4fe2-8913-c23f2b790a88 tempest-VolumeDependencyTests-1793337236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d689565-a40c-4b21-9817-299e4ed80b84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb27067a-148e-4e64-8962-3ac16bc80cf8', 'volume_name': 'volume-cb27067a-148e-4e64-8962-3ac16bc80cf8', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:25 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-273ec950-8499-4fe2-8913-c23f2b790a88 tempest-VolumeDependencyTests-1793337236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c150bad-e757-41ce-838b-482b80606070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:25 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-273ec950-8499-4fe2-8913-c23f2b790a88 tempest-VolumeDependencyTests-1793337236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c150bad-e757-41ce-838b-482b80606070) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:25 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-273ec950-8499-4fe2-8913-c23f2b790a88 tempest-VolumeDependencyTests-1793337236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (260e0323-ed9d-4c62-a600-9abbc0bbb275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:25 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-273ec950-8499-4fe2-8913-c23f2b790a88 tempest-VolumeDependencyTests-1793337236 None] Volume cb27067a-148e-4e64-8962-3ac16bc80cf8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb27067a-148e-4e64-8962-3ac16bc80cf8', 'volume_size': 1} Sep 17 22:11:25 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-273ec950-8499-4fe2-8913-c23f2b790a88 tempest-VolumeDependencyTests-1793337236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:11:25 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-e0c4e93b-45df-499b-82e2-794c619af523 tempest-ProjectMemberTests-1966135882 None] Created reservations ['b84a8f00-31b1-4f86-a99a-7e7f271c08e7', '0a5efad5-0fff-4d2e-8795-ac607395b2c4', 'cb7a8b78-c3a4-4391-8eb0-8e0fb3683ffc', '3fc1ef0d-0b84-498f-b85a-63748b179a8f'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:11:25 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-e0c4e93b-45df-499b-82e2-794c619af523 tempest-ProjectMemberTests-1966135882 None] Delete snapshot completed successfully. Sep 17 22:11:25 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-e0c4e93b-45df-499b-82e2-794c619af523 tempest-ProjectMemberTests-1966135882 None] Lock "cinder-860c62e9-ba98-4978-bd20-8be8c5ffdce2-delete_snapshot" released by "delete_snapshot" :: held 2.333s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:11:25 devstack sudo[104733]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:25 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-2c724512-4e86-47ed-8a2a-86d549adfb3d tempest-CreateVolumesFromSnapshotTest-1444870577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-9e6b5232-9223-4d7c-b5a1-fab05761fadc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-9e6b5232-9223-4d7c-b5a1-fab05761fadc.6c62fdad-4460-499f-b0c1-cc4bfa84999d 1G" returned: 0 in 0.555s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:25 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-2c724512-4e86-47ed-8a2a-86d549adfb3d tempest-CreateVolumesFromSnapshotTest-1444870577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e6b5232-9223-4d7c-b5a1-fab05761fadc -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-9e6b5232-9223-4d7c-b5a1-fab05761fadc.6c62fdad-4460-499f-b0c1-cc4bfa84999d {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:25 devstack sudo[104762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e6b5232-9223-4d7c-b5a1-fab05761fadc -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-9e6b5232-9223-4d7c-b5a1-fab05761fadc.6c62fdad-4460-499f-b0c1-cc4bfa84999d Sep 17 22:11:25 devstack sudo[104762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:25 devstack sudo[104762]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:25 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-2c724512-4e86-47ed-8a2a-86d549adfb3d tempest-CreateVolumesFromSnapshotTest-1444870577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e6b5232-9223-4d7c-b5a1-fab05761fadc -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-9e6b5232-9223-4d7c-b5a1-fab05761fadc.6c62fdad-4460-499f-b0c1-cc4bfa84999d" returned: 0 in 0.336s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:25 devstack cinder-volume[85458]: WARNING cinder.volume.drivers.remotefs [None req-2c724512-4e86-47ed-8a2a-86d549adfb3d tempest-CreateVolumesFromSnapshotTest-1444870577 None] /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-9e6b5232-9223-4d7c-b5a1-fab05761fadc.6c62fdad-4460-499f-b0c1-cc4bfa84999d is being set with open permissions: ugo+rw Sep 17 22:11:25 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-2c724512-4e86-47ed-8a2a-86d549adfb3d tempest-CreateVolumesFromSnapshotTest-1444870577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-9e6b5232-9223-4d7c-b5a1-fab05761fadc.6c62fdad-4460-499f-b0c1-cc4bfa84999d {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:25 devstack sudo[104781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-9e6b5232-9223-4d7c-b5a1-fab05761fadc.6c62fdad-4460-499f-b0c1-cc4bfa84999d Sep 17 22:11:25 devstack sudo[104781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:25 devstack sudo[104781]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:25 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-2c724512-4e86-47ed-8a2a-86d549adfb3d tempest-CreateVolumesFromSnapshotTest-1444870577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-9e6b5232-9223-4d7c-b5a1-fab05761fadc.6c62fdad-4460-499f-b0c1-cc4bfa84999d" returned: 0 in 0.266s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:25 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-2c724512-4e86-47ed-8a2a-86d549adfb3d tempest-CreateVolumesFromSnapshotTest-1444870577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-9e6b5232-9223-4d7c-b5a1-fab05761fadc.info {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:25 devstack sudo[104784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-9e6b5232-9223-4d7c-b5a1-fab05761fadc.info Sep 17 22:11:25 devstack sudo[104784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:26 devstack sudo[104784]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:26 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-2c724512-4e86-47ed-8a2a-86d549adfb3d tempest-CreateVolumesFromSnapshotTest-1444870577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-9e6b5232-9223-4d7c-b5a1-fab05761fadc.info" returned: 0 in 0.259s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:26 devstack cinder-volume[85458]: WARNING cinder.volume.drivers.remotefs [None req-2c724512-4e86-47ed-8a2a-86d549adfb3d tempest-CreateVolumesFromSnapshotTest-1444870577 None] /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-9e6b5232-9223-4d7c-b5a1-fab05761fadc.info is being set with open permissions: ugo+rw Sep 17 22:11:26 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-2c724512-4e86-47ed-8a2a-86d549adfb3d tempest-CreateVolumesFromSnapshotTest-1444870577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-9e6b5232-9223-4d7c-b5a1-fab05761fadc.info {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:26 devstack sudo[104787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-9e6b5232-9223-4d7c-b5a1-fab05761fadc.info Sep 17 22:11:26 devstack sudo[104787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:26 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-dd652e2f-32cc-4a2c-b96a-a31e947b5a31 tempest-ProjectMemberTests-1966135882 None] Acquiring lock "cinder-a05cb841-e50a-4bd9-9c23-d0d341979b7c-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:11:26 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-dd652e2f-32cc-4a2c-b96a-a31e947b5a31 tempest-ProjectMemberTests-1966135882 None] Lock "cinder-a05cb841-e50a-4bd9-9c23-d0d341979b7c-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:11:26 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-dd652e2f-32cc-4a2c-b96a-a31e947b5a31 tempest-ProjectMemberTests-1966135882 None] Acquiring lock "cinder-quobyte-a05cb841-e50a-4bd9-9c23-d0d341979b7c" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:11:26 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-dd652e2f-32cc-4a2c-b96a-a31e947b5a31 tempest-ProjectMemberTests-1966135882 None] Lock "cinder-quobyte-a05cb841-e50a-4bd9-9c23-d0d341979b7c" acquired by "delete_volume" :: waited 0.015s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:11:26 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[aed24a14-a058-4f3d-a2dd-ec84436c3d1e]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:11:26 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-dd652e2f-32cc-4a2c-b96a-a31e947b5a31 tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a05cb841-e50a-4bd9-9c23-d0d341979b7c {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:26 devstack sudo[104787]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:26 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-2c724512-4e86-47ed-8a2a-86d549adfb3d tempest-CreateVolumesFromSnapshotTest-1444870577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-9e6b5232-9223-4d7c-b5a1-fab05761fadc.info" returned: 0 in 0.309s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:26 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-2c724512-4e86-47ed-8a2a-86d549adfb3d tempest-CreateVolumesFromSnapshotTest-1444870577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.322s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:11:26 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-273ec950-8499-4fe2-8913-c23f2b790a88 tempest-VolumeDependencyTests-1793337236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.394s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:11:26 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-273ec950-8499-4fe2-8913-c23f2b790a88 tempest-VolumeDependencyTests-1793337236 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:11:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-242864991',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb27067a-148e-4e64-8962-3ac16bc80cf8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d28e78916bc9453387f9808dbfc231f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:11:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:11:25Z,use_quota=True,user_id='737af02dd74a4a3b988468eec18e881e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 22:11:26 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-273ec950-8499-4fe2-8913-c23f2b790a88 tempest-VolumeDependencyTests-1793337236 None] Creating volume cb27067a-148e-4e64-8962-3ac16bc80cf8 {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 22:11:26 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-273ec950-8499-4fe2-8913-c23f2b790a88 tempest-VolumeDependencyTests-1793337236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:11:26 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-273ec950-8499-4fe2-8913-c23f2b790a88 tempest-VolumeDependencyTests-1793337236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:11:26 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-273ec950-8499-4fe2-8913-c23f2b790a88 tempest-VolumeDependencyTests-1793337236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:11:26 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-273ec950-8499-4fe2-8913-c23f2b790a88 tempest-VolumeDependencyTests-1793337236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:11:26 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-273ec950-8499-4fe2-8913-c23f2b790a88 tempest-VolumeDependencyTests-1793337236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:11:26 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-273ec950-8499-4fe2-8913-c23f2b790a88 tempest-VolumeDependencyTests-1793337236 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 22:11:26 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-273ec950-8499-4fe2-8913-c23f2b790a88 tempest-VolumeDependencyTests-1793337236 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 22:11:26 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-273ec950-8499-4fe2-8913-c23f2b790a88 tempest-VolumeDependencyTests-1793337236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb27067a-148e-4e64-8962-3ac16bc80cf8 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:26 devstack sudo[104791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb27067a-148e-4e64-8962-3ac16bc80cf8 1073741824 Sep 17 22:11:26 devstack sudo[104791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:26 devstack sudo[104790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a05cb841-e50a-4bd9-9c23-d0d341979b7c Sep 17 22:11:26 devstack sudo[104790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:26 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-2c724512-4e86-47ed-8a2a-86d549adfb3d tempest-CreateVolumesFromSnapshotTest-1444870577 None] Create snapshot completed successfully Sep 17 22:11:26 devstack sudo[104790]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:26 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-dd652e2f-32cc-4a2c-b96a-a31e947b5a31 tempest-ProjectMemberTests-1966135882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a05cb841-e50a-4bd9-9c23-d0d341979b7c" returned: 0 in 0.404s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:26 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-dd652e2f-32cc-4a2c-b96a-a31e947b5a31 tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a05cb841-e50a-4bd9-9c23-d0d341979b7c {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:26 devstack sudo[104800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a05cb841-e50a-4bd9-9c23-d0d341979b7c Sep 17 22:11:26 devstack sudo[104800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:27 devstack sudo[104791]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-273ec950-8499-4fe2-8913-c23f2b790a88 tempest-VolumeDependencyTests-1793337236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb27067a-148e-4e64-8962-3ac16bc80cf8 1073741824" returned: 0 in 0.531s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-273ec950-8499-4fe2-8913-c23f2b790a88 tempest-VolumeDependencyTests-1793337236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb27067a-148e-4e64-8962-3ac16bc80cf8 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:27 devstack sudo[104803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb27067a-148e-4e64-8962-3ac16bc80cf8 Sep 17 22:11:27 devstack sudo[104803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:27 devstack sudo[104800]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-dd652e2f-32cc-4a2c-b96a-a31e947b5a31 tempest-ProjectMemberTests-1966135882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a05cb841-e50a-4bd9-9c23-d0d341979b7c" returned: 0 in 0.284s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:27 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-dd652e2f-32cc-4a2c-b96a-a31e947b5a31 tempest-ProjectMemberTests-1966135882 None] Lock "cinder-quobyte-a05cb841-e50a-4bd9-9c23-d0d341979b7c" released by "delete_volume" :: held 0.775s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:11:27 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-dd652e2f-32cc-4a2c-b96a-a31e947b5a31 tempest-ProjectMemberTests-1966135882 None] Created reservations ['8116cfca-8bfe-4713-b539-68eaf18af2b8', '19661af6-5ef6-4ed3-9151-b05bae9af9cf', '93eeab52-6b30-4efb-b6eb-f7b56e2453ea', '51b5959f-37f6-4fc5-a039-5ca67aad958c'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:11:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-dd652e2f-32cc-4a2c-b96a-a31e947b5a31 tempest-ProjectMemberTests-1966135882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:11:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-dd652e2f-32cc-4a2c-b96a-a31e947b5a31 tempest-ProjectMemberTests-1966135882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:11:27 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-dd652e2f-32cc-4a2c-b96a-a31e947b5a31 tempest-ProjectMemberTests-1966135882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:11:27 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-dd652e2f-32cc-4a2c-b96a-a31e947b5a31 tempest-ProjectMemberTests-1966135882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:11:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-dd652e2f-32cc-4a2c-b96a-a31e947b5a31 tempest-ProjectMemberTests-1966135882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:11:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-dd652e2f-32cc-4a2c-b96a-a31e947b5a31 tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:27 devstack sudo[104806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:11:27 devstack sudo[104806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:27 devstack sudo[104803]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-273ec950-8499-4fe2-8913-c23f2b790a88 tempest-VolumeDependencyTests-1793337236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb27067a-148e-4e64-8962-3ac16bc80cf8" returned: 0 in 0.282s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:27 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-273ec950-8499-4fe2-8913-c23f2b790a88 tempest-VolumeDependencyTests-1793337236 None] <== create_volume: return (857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 22:11:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-273ec950-8499-4fe2-8913-c23f2b790a88 tempest-VolumeDependencyTests-1793337236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.863s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:11:27 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-273ec950-8499-4fe2-8913-c23f2b790a88 tempest-VolumeDependencyTests-1793337236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (260e0323-ed9d-4c62-a600-9abbc0bbb275) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb27067a-148e-4e64-8962-3ac16bc80cf8', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:27 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-273ec950-8499-4fe2-8913-c23f2b790a88 tempest-VolumeDependencyTests-1793337236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (912e1a9a-db25-458c-a205-092f67cac7f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:27 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-273ec950-8499-4fe2-8913-c23f2b790a88 tempest-VolumeDependencyTests-1793337236 None] Volume volume-cb27067a-148e-4e64-8962-3ac16bc80cf8 (cb27067a-148e-4e64-8962-3ac16bc80cf8): created successfully Sep 17 22:11:27 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-273ec950-8499-4fe2-8913-c23f2b790a88 tempest-VolumeDependencyTests-1793337236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (912e1a9a-db25-458c-a205-092f67cac7f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:27 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-273ec950-8499-4fe2-8913-c23f2b790a88 tempest-VolumeDependencyTests-1793337236 None] Flow 'volume_create_manager' (9d3d7434-833b-4468-8253-8634c8ed765c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:11:27 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-273ec950-8499-4fe2-8913-c23f2b790a88 tempest-VolumeDependencyTests-1793337236 None] Created volume successfully. Sep 17 22:11:27 devstack sudo[104806]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-dd652e2f-32cc-4a2c-b96a-a31e947b5a31 tempest-ProjectMemberTests-1966135882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.404s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:27 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-dd652e2f-32cc-4a2c-b96a-a31e947b5a31 tempest-ProjectMemberTests-1966135882 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:11:27 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-dd652e2f-32cc-4a2c-b96a-a31e947b5a31 tempest-ProjectMemberTests-1966135882 None] Deleted volume successfully. Sep 17 22:11:27 devstack cinder-volume[85458]: DEBUG oslo_service.periodic_task [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85458) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 22:11:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:11:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:11:27 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:11:27 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:11:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:11:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:27 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-dd652e2f-32cc-4a2c-b96a-a31e947b5a31 tempest-ProjectMemberTests-1966135882 None] Lock "cinder-a05cb841-e50a-4bd9-9c23-d0d341979b7c-delete_volume" released by "delete_volume" :: held 1.480s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:11:27 devstack sudo[104812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:11:27 devstack sudo[104812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:28 devstack sudo[104812]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:28 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.366s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:28 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:11:28 devstack cinder-volume[85458]: DEBUG oslo_service.periodic_task [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Running periodic task VolumeManager._thread_info {{(pid=85458) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 22:11:28 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] thread count: 28 {{(pid=85458) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 22:11:28 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] thread info: [<_MainThread(MainThread, started 127546830999680)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85458) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 22:11:28 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-7aad7ea2-748b-498d-9486-cbbba460de5f tempest-CreateVolumesFromSnapshotTest-1444870577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 22:11:28 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-7aad7ea2-748b-498d-9486-cbbba460de5f tempest-CreateVolumesFromSnapshotTest-1444870577 None] Flow 'volume_create_manager' (38c86fae-fb4d-4eb8-89c8-e3b600649e17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:11:28 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-7aad7ea2-748b-498d-9486-cbbba460de5f tempest-CreateVolumesFromSnapshotTest-1444870577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (903deeca-9f22-4aa4-9d39-1ecf0c44ec95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:28 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-7aad7ea2-748b-498d-9486-cbbba460de5f tempest-CreateVolumesFromSnapshotTest-1444870577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (903deeca-9f22-4aa4-9d39-1ecf0c44ec95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:11:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-919809116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ae18736-0263-4b13-893d-34ff1a9cc7f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='378205ccfa9949c1a6bae07a5e05d296',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:11:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:11:28Z,use_quota=True,user_id='1f5b811e4141485e8a7aa317d71d1870',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:28 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-7aad7ea2-748b-498d-9486-cbbba460de5f tempest-CreateVolumesFromSnapshotTest-1444870577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f104355-e2f6-4a38-a52c-0861010a0f09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:28 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-7aad7ea2-748b-498d-9486-cbbba460de5f tempest-CreateVolumesFromSnapshotTest-1444870577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f104355-e2f6-4a38-a52c-0861010a0f09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:28 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-7aad7ea2-748b-498d-9486-cbbba460de5f tempest-CreateVolumesFromSnapshotTest-1444870577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cedb32f8-943d-4b19-8f74-f9921959b679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:28 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-7aad7ea2-748b-498d-9486-cbbba460de5f tempest-CreateVolumesFromSnapshotTest-1444870577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cedb32f8-943d-4b19-8f74-f9921959b679) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ae18736-0263-4b13-893d-34ff1a9cc7f9', 'volume_name': 'volume-7ae18736-0263-4b13-893d-34ff1a9cc7f9', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:28 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-7aad7ea2-748b-498d-9486-cbbba460de5f tempest-CreateVolumesFromSnapshotTest-1444870577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a70bb852-9d61-4f1a-a7b6-d93a6e8dd6ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:28 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-7aad7ea2-748b-498d-9486-cbbba460de5f tempest-CreateVolumesFromSnapshotTest-1444870577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a70bb852-9d61-4f1a-a7b6-d93a6e8dd6ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:28 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-7aad7ea2-748b-498d-9486-cbbba460de5f tempest-CreateVolumesFromSnapshotTest-1444870577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d711e83f-a254-4c17-9379-5e6606d5b827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:28 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-7aad7ea2-748b-498d-9486-cbbba460de5f tempest-CreateVolumesFromSnapshotTest-1444870577 None] Volume 7ae18736-0263-4b13-893d-34ff1a9cc7f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ae18736-0263-4b13-893d-34ff1a9cc7f9', 'volume_size': 1} Sep 17 22:11:28 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-7aad7ea2-748b-498d-9486-cbbba460de5f tempest-CreateVolumesFromSnapshotTest-1444870577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:11:28 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-7aad7ea2-748b-498d-9486-cbbba460de5f tempest-CreateVolumesFromSnapshotTest-1444870577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:11:28 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-7aad7ea2-748b-498d-9486-cbbba460de5f tempest-CreateVolumesFromSnapshotTest-1444870577 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:11:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-919809116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ae18736-0263-4b13-893d-34ff1a9cc7f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='378205ccfa9949c1a6bae07a5e05d296',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:11:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:11:28Z,use_quota=True,user_id='1f5b811e4141485e8a7aa317d71d1870',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 22:11:28 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-7aad7ea2-748b-498d-9486-cbbba460de5f tempest-CreateVolumesFromSnapshotTest-1444870577 None] Creating volume 7ae18736-0263-4b13-893d-34ff1a9cc7f9 {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 22:11:28 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-7aad7ea2-748b-498d-9486-cbbba460de5f tempest-CreateVolumesFromSnapshotTest-1444870577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:11:28 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-7aad7ea2-748b-498d-9486-cbbba460de5f tempest-CreateVolumesFromSnapshotTest-1444870577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:11:28 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-7aad7ea2-748b-498d-9486-cbbba460de5f tempest-CreateVolumesFromSnapshotTest-1444870577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:11:28 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-7aad7ea2-748b-498d-9486-cbbba460de5f tempest-CreateVolumesFromSnapshotTest-1444870577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:11:28 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-7aad7ea2-748b-498d-9486-cbbba460de5f tempest-CreateVolumesFromSnapshotTest-1444870577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:11:28 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-7aad7ea2-748b-498d-9486-cbbba460de5f tempest-CreateVolumesFromSnapshotTest-1444870577 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 22:11:28 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-7aad7ea2-748b-498d-9486-cbbba460de5f tempest-CreateVolumesFromSnapshotTest-1444870577 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 22:11:28 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-7aad7ea2-748b-498d-9486-cbbba460de5f tempest-CreateVolumesFromSnapshotTest-1444870577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7ae18736-0263-4b13-893d-34ff1a9cc7f9 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:28 devstack sudo[104815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7ae18736-0263-4b13-893d-34ff1a9cc7f9 1073741824 Sep 17 22:11:28 devstack sudo[104815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:28 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-c026ec8f-06e9-434c-a876-4291f9d64eb0 tempest-ProjectMemberTests-1966135882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 22:11:28 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-c026ec8f-06e9-434c-a876-4291f9d64eb0 tempest-ProjectMemberTests-1966135882 None] Flow 'volume_create_manager' (f9c2da4e-849d-45fb-abb9-06873e8ff576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:11:28 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-c026ec8f-06e9-434c-a876-4291f9d64eb0 tempest-ProjectMemberTests-1966135882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (271f7d39-e45c-4e88-a27f-a932ee807c48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:28 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-c026ec8f-06e9-434c-a876-4291f9d64eb0 tempest-ProjectMemberTests-1966135882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (271f7d39-e45c-4e88-a27f-a932ee807c48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:11:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1201014239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67b2590f-6b10-4780-a42c-e4c537b68286,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f277f501a340474ca5d0daea12e88955',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:11:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:11:28Z,use_quota=True,user_id='e584775bfb3c440aa7aac369d15efa55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:28 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-c026ec8f-06e9-434c-a876-4291f9d64eb0 tempest-ProjectMemberTests-1966135882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (129e736e-33f3-419f-8c4e-45cc418a0f3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:28 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-c026ec8f-06e9-434c-a876-4291f9d64eb0 tempest-ProjectMemberTests-1966135882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (129e736e-33f3-419f-8c4e-45cc418a0f3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:28 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-c026ec8f-06e9-434c-a876-4291f9d64eb0 tempest-ProjectMemberTests-1966135882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5434f15-e7c2-47a9-b9d2-20c59c3b2113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:28 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-c026ec8f-06e9-434c-a876-4291f9d64eb0 tempest-ProjectMemberTests-1966135882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5434f15-e7c2-47a9-b9d2-20c59c3b2113) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67b2590f-6b10-4780-a42c-e4c537b68286', 'volume_name': 'volume-67b2590f-6b10-4780-a42c-e4c537b68286', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:28 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-c026ec8f-06e9-434c-a876-4291f9d64eb0 tempest-ProjectMemberTests-1966135882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d54bf3f0-bf67-4f9f-96b4-98428e952181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:28 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-c026ec8f-06e9-434c-a876-4291f9d64eb0 tempest-ProjectMemberTests-1966135882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d54bf3f0-bf67-4f9f-96b4-98428e952181) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:28 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-c026ec8f-06e9-434c-a876-4291f9d64eb0 tempest-ProjectMemberTests-1966135882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (439ca7f9-d5b2-47eb-96e2-8359bf0d04bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:28 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-c026ec8f-06e9-434c-a876-4291f9d64eb0 tempest-ProjectMemberTests-1966135882 None] Volume 67b2590f-6b10-4780-a42c-e4c537b68286: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67b2590f-6b10-4780-a42c-e4c537b68286', 'volume_size': 1} Sep 17 22:11:28 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-c026ec8f-06e9-434c-a876-4291f9d64eb0 tempest-ProjectMemberTests-1966135882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:11:28 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-847d2621-6348-48a0-81c6-e3539cb020dd tempest-VolumeDependencyTests-1793337236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:11:28 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-e14ffc47-2052-4d3d-86e1-f6dced762663 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 22:11:28 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e14ffc47-2052-4d3d-86e1-f6dced762663 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Flow 'volume_create_manager' (7f2fd0ac-b50a-49ec-af9d-40d6db44ad75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:11:28 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e14ffc47-2052-4d3d-86e1-f6dced762663 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db61eab8-d0b8-411c-972f-75e71d024efe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:28 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e14ffc47-2052-4d3d-86e1-f6dced762663 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db61eab8-d0b8-411c-972f-75e71d024efe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:11:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1126606519',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=449d06b1-6efd-4c73-910f-134797feab9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='378205ccfa9949c1a6bae07a5e05d296',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:11:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:11:29Z,use_quota=True,user_id='1f5b811e4141485e8a7aa317d71d1870',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:28 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e14ffc47-2052-4d3d-86e1-f6dced762663 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13d23ad2-13d0-481c-a7fd-36cdcf6da318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:29 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e14ffc47-2052-4d3d-86e1-f6dced762663 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13d23ad2-13d0-481c-a7fd-36cdcf6da318) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:29 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e14ffc47-2052-4d3d-86e1-f6dced762663 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61df56e9-2b26-4484-a795-b7298cbddfcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:29 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e14ffc47-2052-4d3d-86e1-f6dced762663 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61df56e9-2b26-4484-a795-b7298cbddfcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '449d06b1-6efd-4c73-910f-134797feab9d', 'volume_name': 'volume-449d06b1-6efd-4c73-910f-134797feab9d', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:29 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e14ffc47-2052-4d3d-86e1-f6dced762663 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (136acb79-88ec-407b-aba8-4ca3581bb518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:29 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e14ffc47-2052-4d3d-86e1-f6dced762663 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (136acb79-88ec-407b-aba8-4ca3581bb518) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:29 devstack sudo[104815]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:29 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e14ffc47-2052-4d3d-86e1-f6dced762663 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c839562-d086-4f0b-9db7-34b090f39bc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:29 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-e14ffc47-2052-4d3d-86e1-f6dced762663 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Volume 449d06b1-6efd-4c73-910f-134797feab9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-449d06b1-6efd-4c73-910f-134797feab9d', 'volume_size': 1} Sep 17 22:11:29 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e14ffc47-2052-4d3d-86e1-f6dced762663 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:11:29 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-7aad7ea2-748b-498d-9486-cbbba460de5f tempest-CreateVolumesFromSnapshotTest-1444870577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7ae18736-0263-4b13-893d-34ff1a9cc7f9 1073741824" returned: 0 in 0.643s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:29 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-7aad7ea2-748b-498d-9486-cbbba460de5f tempest-CreateVolumesFromSnapshotTest-1444870577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7ae18736-0263-4b13-893d-34ff1a9cc7f9 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:29 devstack sudo[104821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7ae18736-0263-4b13-893d-34ff1a9cc7f9 Sep 17 22:11:29 devstack sudo[104821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:29 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-001b30ba-3bc3-4dcc-9bd8-0926037be51c tempest-CreateVolumesFromSnapshotTest-1444870577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 22:11:29 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-001b30ba-3bc3-4dcc-9bd8-0926037be51c tempest-CreateVolumesFromSnapshotTest-1444870577 None] Flow 'volume_create_manager' (f42bab06-6920-4579-b367-aaabb5ea1abf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:11:29 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-001b30ba-3bc3-4dcc-9bd8-0926037be51c tempest-CreateVolumesFromSnapshotTest-1444870577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac828649-23a8-4522-a9c4-d441d7c94cd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:29 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-001b30ba-3bc3-4dcc-9bd8-0926037be51c tempest-CreateVolumesFromSnapshotTest-1444870577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac828649-23a8-4522-a9c4-d441d7c94cd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:11:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1848315660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9010853-de9b-4b58-83a9-2b64ec8c8130,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='378205ccfa9949c1a6bae07a5e05d296',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:11:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:11:29Z,use_quota=True,user_id='1f5b811e4141485e8a7aa317d71d1870',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:29 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-001b30ba-3bc3-4dcc-9bd8-0926037be51c tempest-CreateVolumesFromSnapshotTest-1444870577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (323abd0d-34b1-4504-a2e0-fe8da63d1e3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:29 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-001b30ba-3bc3-4dcc-9bd8-0926037be51c tempest-CreateVolumesFromSnapshotTest-1444870577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (323abd0d-34b1-4504-a2e0-fe8da63d1e3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:29 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-001b30ba-3bc3-4dcc-9bd8-0926037be51c tempest-CreateVolumesFromSnapshotTest-1444870577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (981e2dba-c841-4fac-93bd-6780e4af6e63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:29 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-001b30ba-3bc3-4dcc-9bd8-0926037be51c tempest-CreateVolumesFromSnapshotTest-1444870577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (981e2dba-c841-4fac-93bd-6780e4af6e63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9010853-de9b-4b58-83a9-2b64ec8c8130', 'volume_name': 'volume-d9010853-de9b-4b58-83a9-2b64ec8c8130', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:29 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-001b30ba-3bc3-4dcc-9bd8-0926037be51c tempest-CreateVolumesFromSnapshotTest-1444870577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c9648bd-efc5-4e03-989b-ded887f29883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:29 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-001b30ba-3bc3-4dcc-9bd8-0926037be51c tempest-CreateVolumesFromSnapshotTest-1444870577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c9648bd-efc5-4e03-989b-ded887f29883) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:29 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-001b30ba-3bc3-4dcc-9bd8-0926037be51c tempest-CreateVolumesFromSnapshotTest-1444870577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5567fb1d-e230-416d-86c2-17539c684d9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:29 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-001b30ba-3bc3-4dcc-9bd8-0926037be51c tempest-CreateVolumesFromSnapshotTest-1444870577 None] Volume d9010853-de9b-4b58-83a9-2b64ec8c8130: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9010853-de9b-4b58-83a9-2b64ec8c8130', 'volume_size': 1} Sep 17 22:11:29 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-001b30ba-3bc3-4dcc-9bd8-0926037be51c tempest-CreateVolumesFromSnapshotTest-1444870577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:11:29 devstack sudo[104821]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:29 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-7aad7ea2-748b-498d-9486-cbbba460de5f tempest-CreateVolumesFromSnapshotTest-1444870577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7ae18736-0263-4b13-893d-34ff1a9cc7f9" returned: 0 in 0.366s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:29 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-7aad7ea2-748b-498d-9486-cbbba460de5f tempest-CreateVolumesFromSnapshotTest-1444870577 None] <== create_volume: return (1087ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 22:11:29 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-7aad7ea2-748b-498d-9486-cbbba460de5f tempest-CreateVolumesFromSnapshotTest-1444870577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.092s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:11:29 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-c026ec8f-06e9-434c-a876-4291f9d64eb0 tempest-ProjectMemberTests-1966135882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.888s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:11:29 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-c026ec8f-06e9-434c-a876-4291f9d64eb0 tempest-ProjectMemberTests-1966135882 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:11:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1201014239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67b2590f-6b10-4780-a42c-e4c537b68286,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f277f501a340474ca5d0daea12e88955',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:11:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:11:28Z,use_quota=True,user_id='e584775bfb3c440aa7aac369d15efa55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 22:11:29 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-c026ec8f-06e9-434c-a876-4291f9d64eb0 tempest-ProjectMemberTests-1966135882 None] Creating volume 67b2590f-6b10-4780-a42c-e4c537b68286 {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 22:11:29 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-c026ec8f-06e9-434c-a876-4291f9d64eb0 tempest-ProjectMemberTests-1966135882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:11:29 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-c026ec8f-06e9-434c-a876-4291f9d64eb0 tempest-ProjectMemberTests-1966135882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:11:29 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-c026ec8f-06e9-434c-a876-4291f9d64eb0 tempest-ProjectMemberTests-1966135882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:11:29 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-c026ec8f-06e9-434c-a876-4291f9d64eb0 tempest-ProjectMemberTests-1966135882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:11:29 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-c026ec8f-06e9-434c-a876-4291f9d64eb0 tempest-ProjectMemberTests-1966135882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:11:29 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-c026ec8f-06e9-434c-a876-4291f9d64eb0 tempest-ProjectMemberTests-1966135882 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 22:11:29 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-c026ec8f-06e9-434c-a876-4291f9d64eb0 tempest-ProjectMemberTests-1966135882 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 22:11:29 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-c026ec8f-06e9-434c-a876-4291f9d64eb0 tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-67b2590f-6b10-4780-a42c-e4c537b68286 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:29 devstack sudo[104824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-67b2590f-6b10-4780-a42c-e4c537b68286 1073741824 Sep 17 22:11:29 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-7aad7ea2-748b-498d-9486-cbbba460de5f tempest-CreateVolumesFromSnapshotTest-1444870577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d711e83f-a254-4c17-9379-5e6606d5b827) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ae18736-0263-4b13-893d-34ff1a9cc7f9', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:29 devstack sudo[104824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:29 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-7aad7ea2-748b-498d-9486-cbbba460de5f tempest-CreateVolumesFromSnapshotTest-1444870577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f266296f-089a-4938-a1ca-844230957a11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:29 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-7aad7ea2-748b-498d-9486-cbbba460de5f tempest-CreateVolumesFromSnapshotTest-1444870577 None] Volume volume-7ae18736-0263-4b13-893d-34ff1a9cc7f9 (7ae18736-0263-4b13-893d-34ff1a9cc7f9): created successfully Sep 17 22:11:29 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-7aad7ea2-748b-498d-9486-cbbba460de5f tempest-CreateVolumesFromSnapshotTest-1444870577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f266296f-089a-4938-a1ca-844230957a11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:29 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-7aad7ea2-748b-498d-9486-cbbba460de5f tempest-CreateVolumesFromSnapshotTest-1444870577 None] Flow 'volume_create_manager' (38c86fae-fb4d-4eb8-89c8-e3b600649e17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:11:29 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-7aad7ea2-748b-498d-9486-cbbba460de5f tempest-CreateVolumesFromSnapshotTest-1444870577 None] Created volume successfully. Sep 17 22:11:29 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa41a12a-7707-4166-82f7-788f58f03d3c tempest-CreateVolumesFromSnapshotTest-1444870577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 22:11:29 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-fa41a12a-7707-4166-82f7-788f58f03d3c tempest-CreateVolumesFromSnapshotTest-1444870577 None] Flow 'volume_create_manager' (5837288c-8217-4622-ae3c-f6deee96a146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:11:29 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-fa41a12a-7707-4166-82f7-788f58f03d3c tempest-CreateVolumesFromSnapshotTest-1444870577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9856e5f8-6ed5-4864-9353-5d97dcdc98b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:29 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-fa41a12a-7707-4166-82f7-788f58f03d3c tempest-CreateVolumesFromSnapshotTest-1444870577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9856e5f8-6ed5-4864-9353-5d97dcdc98b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:11:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-387281999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37a6008a-c0c6-4bfd-bb0f-eb3a0c64d4a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='378205ccfa9949c1a6bae07a5e05d296',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:11:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:11:30Z,use_quota=True,user_id='1f5b811e4141485e8a7aa317d71d1870',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:29 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-fa41a12a-7707-4166-82f7-788f58f03d3c tempest-CreateVolumesFromSnapshotTest-1444870577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb69ddd7-4618-4422-b7ee-0b8166e836c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:29 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-fa41a12a-7707-4166-82f7-788f58f03d3c tempest-CreateVolumesFromSnapshotTest-1444870577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb69ddd7-4618-4422-b7ee-0b8166e836c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:29 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-fa41a12a-7707-4166-82f7-788f58f03d3c tempest-CreateVolumesFromSnapshotTest-1444870577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2e7184d-10da-4327-9205-e1f2a2e66066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:29 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-fa41a12a-7707-4166-82f7-788f58f03d3c tempest-CreateVolumesFromSnapshotTest-1444870577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2e7184d-10da-4327-9205-e1f2a2e66066) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37a6008a-c0c6-4bfd-bb0f-eb3a0c64d4a5', 'volume_name': 'volume-37a6008a-c0c6-4bfd-bb0f-eb3a0c64d4a5', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:29 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-fa41a12a-7707-4166-82f7-788f58f03d3c tempest-CreateVolumesFromSnapshotTest-1444870577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d3ece7f-76c5-46ec-a791-fa082ce925c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:29 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-fa41a12a-7707-4166-82f7-788f58f03d3c tempest-CreateVolumesFromSnapshotTest-1444870577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d3ece7f-76c5-46ec-a791-fa082ce925c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:29 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-fa41a12a-7707-4166-82f7-788f58f03d3c tempest-CreateVolumesFromSnapshotTest-1444870577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e59dc33e-24a9-4079-b5e1-61f3f1f21cbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:29 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-fa41a12a-7707-4166-82f7-788f58f03d3c tempest-CreateVolumesFromSnapshotTest-1444870577 None] Volume 37a6008a-c0c6-4bfd-bb0f-eb3a0c64d4a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37a6008a-c0c6-4bfd-bb0f-eb3a0c64d4a5', 'volume_size': 1} Sep 17 22:11:29 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-fa41a12a-7707-4166-82f7-788f58f03d3c tempest-CreateVolumesFromSnapshotTest-1444870577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:11:30 devstack sudo[104824]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:30 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-c026ec8f-06e9-434c-a876-4291f9d64eb0 tempest-ProjectMemberTests-1966135882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-67b2590f-6b10-4780-a42c-e4c537b68286 1073741824" returned: 0 in 0.591s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:30 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-c026ec8f-06e9-434c-a876-4291f9d64eb0 tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-67b2590f-6b10-4780-a42c-e4c537b68286 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:30 devstack sudo[104831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-67b2590f-6b10-4780-a42c-e4c537b68286 Sep 17 22:11:30 devstack sudo[104831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:30 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-96b5b9de-49b4-4f6f-99b3-28850d814513 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 22:11:30 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-96b5b9de-49b4-4f6f-99b3-28850d814513 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Flow 'volume_create_manager' (03f3d83a-36b5-4e37-b218-58afb73ceae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:11:30 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-96b5b9de-49b4-4f6f-99b3-28850d814513 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8873284e-ab22-4bb1-bc98-679c0027e780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:30 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-96b5b9de-49b4-4f6f-99b3-28850d814513 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8873284e-ab22-4bb1-bc98-679c0027e780) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:11:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1094504913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92eba308-3af6-4c0b-a79e-63550d2e58c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='378205ccfa9949c1a6bae07a5e05d296',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:11:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:11:30Z,use_quota=True,user_id='1f5b811e4141485e8a7aa317d71d1870',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:30 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-96b5b9de-49b4-4f6f-99b3-28850d814513 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (587b19a2-acf9-4b18-8d76-8da2ba2b56ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:30 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-96b5b9de-49b4-4f6f-99b3-28850d814513 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (587b19a2-acf9-4b18-8d76-8da2ba2b56ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:30 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-96b5b9de-49b4-4f6f-99b3-28850d814513 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55efc225-d207-4d79-8934-3c70ac2f7c52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:30 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-96b5b9de-49b4-4f6f-99b3-28850d814513 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55efc225-d207-4d79-8934-3c70ac2f7c52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92eba308-3af6-4c0b-a79e-63550d2e58c2', 'volume_name': 'volume-92eba308-3af6-4c0b-a79e-63550d2e58c2', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:30 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-96b5b9de-49b4-4f6f-99b3-28850d814513 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cece412-1470-4aff-bd0c-fa2a7f5ed148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:30 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-96b5b9de-49b4-4f6f-99b3-28850d814513 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cece412-1470-4aff-bd0c-fa2a7f5ed148) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:30 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-96b5b9de-49b4-4f6f-99b3-28850d814513 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45090ad3-284c-4d73-b7b0-3850026fe934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:30 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-96b5b9de-49b4-4f6f-99b3-28850d814513 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Volume 92eba308-3af6-4c0b-a79e-63550d2e58c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92eba308-3af6-4c0b-a79e-63550d2e58c2', 'volume_size': 1} Sep 17 22:11:30 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-96b5b9de-49b4-4f6f-99b3-28850d814513 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:11:30 devstack sudo[104831]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:30 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-c026ec8f-06e9-434c-a876-4291f9d64eb0 tempest-ProjectMemberTests-1966135882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-67b2590f-6b10-4780-a42c-e4c537b68286" returned: 0 in 0.308s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:30 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-c026ec8f-06e9-434c-a876-4291f9d64eb0 tempest-ProjectMemberTests-1966135882 None] <== create_volume: return (963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 22:11:30 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-c026ec8f-06e9-434c-a876-4291f9d64eb0 tempest-ProjectMemberTests-1966135882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.972s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:11:30 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-847d2621-6348-48a0-81c6-e3539cb020dd tempest-VolumeDependencyTests-1793337236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.554s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:11:30 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-c026ec8f-06e9-434c-a876-4291f9d64eb0 tempest-ProjectMemberTests-1966135882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (439ca7f9-d5b2-47eb-96e2-8359bf0d04bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67b2590f-6b10-4780-a42c-e4c537b68286', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:30 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-c026ec8f-06e9-434c-a876-4291f9d64eb0 tempest-ProjectMemberTests-1966135882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbcc753e-e53c-4d10-b29c-27cb31a8052a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:30 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-847d2621-6348-48a0-81c6-e3539cb020dd tempest-VolumeDependencyTests-1793337236 None] Creating offline snapshot cf711ded-39fa-4af0-be22-b89e14cfbc4a of volume cb27067a-148e-4e64-8962-3ac16bc80cf8 {{(pid=85458) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 22:11:30 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-c026ec8f-06e9-434c-a876-4291f9d64eb0 tempest-ProjectMemberTests-1966135882 None] Volume volume-67b2590f-6b10-4780-a42c-e4c537b68286 (67b2590f-6b10-4780-a42c-e4c537b68286): created successfully Sep 17 22:11:30 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-c026ec8f-06e9-434c-a876-4291f9d64eb0 tempest-ProjectMemberTests-1966135882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbcc753e-e53c-4d10-b29c-27cb31a8052a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:30 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-c026ec8f-06e9-434c-a876-4291f9d64eb0 tempest-ProjectMemberTests-1966135882 None] Flow 'volume_create_manager' (f9c2da4e-849d-45fb-abb9-06873e8ff576) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:11:30 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[47d4f4ff-668e-4c16-ac51-4f0a4b579d33]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:11:30 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-847d2621-6348-48a0-81c6-e3539cb020dd tempest-VolumeDependencyTests-1793337236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb27067a-148e-4e64-8962-3ac16bc80cf8 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:30 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-c026ec8f-06e9-434c-a876-4291f9d64eb0 tempest-ProjectMemberTests-1966135882 None] Created volume successfully. Sep 17 22:11:30 devstack sudo[104836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb27067a-148e-4e64-8962-3ac16bc80cf8 Sep 17 22:11:30 devstack sudo[104836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:30 devstack sudo[104836]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:30 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-847d2621-6348-48a0-81c6-e3539cb020dd tempest-VolumeDependencyTests-1793337236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb27067a-148e-4e64-8962-3ac16bc80cf8" returned: 0 in 0.379s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:30 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-847d2621-6348-48a0-81c6-e3539cb020dd tempest-VolumeDependencyTests-1793337236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb27067a-148e-4e64-8962-3ac16bc80cf8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb27067a-148e-4e64-8962-3ac16bc80cf8.cf711ded-39fa-4af0-be22-b89e14cfbc4a 1G {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:30 devstack sudo[104841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb27067a-148e-4e64-8962-3ac16bc80cf8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb27067a-148e-4e64-8962-3ac16bc80cf8.cf711ded-39fa-4af0-be22-b89e14cfbc4a 1G Sep 17 22:11:30 devstack sudo[104841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:31 devstack sudo[104841]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:31 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-847d2621-6348-48a0-81c6-e3539cb020dd tempest-VolumeDependencyTests-1793337236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb27067a-148e-4e64-8962-3ac16bc80cf8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb27067a-148e-4e64-8962-3ac16bc80cf8.cf711ded-39fa-4af0-be22-b89e14cfbc4a 1G" returned: 0 in 0.477s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:31 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-847d2621-6348-48a0-81c6-e3539cb020dd tempest-VolumeDependencyTests-1793337236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb27067a-148e-4e64-8962-3ac16bc80cf8 -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb27067a-148e-4e64-8962-3ac16bc80cf8.cf711ded-39fa-4af0-be22-b89e14cfbc4a {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:31 devstack sudo[104853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb27067a-148e-4e64-8962-3ac16bc80cf8 -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb27067a-148e-4e64-8962-3ac16bc80cf8.cf711ded-39fa-4af0-be22-b89e14cfbc4a Sep 17 22:11:31 devstack sudo[104853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:31 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-28bef49a-562a-4897-9755-d34626cfceee tempest-ProjectMemberTests-1966135882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:11:31 devstack sudo[104853]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:31 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-847d2621-6348-48a0-81c6-e3539cb020dd tempest-VolumeDependencyTests-1793337236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb27067a-148e-4e64-8962-3ac16bc80cf8 -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb27067a-148e-4e64-8962-3ac16bc80cf8.cf711ded-39fa-4af0-be22-b89e14cfbc4a" returned: 0 in 0.332s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:31 devstack cinder-volume[85458]: WARNING cinder.volume.drivers.remotefs [None req-847d2621-6348-48a0-81c6-e3539cb020dd tempest-VolumeDependencyTests-1793337236 None] /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb27067a-148e-4e64-8962-3ac16bc80cf8.cf711ded-39fa-4af0-be22-b89e14cfbc4a is being set with open permissions: ugo+rw Sep 17 22:11:31 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-847d2621-6348-48a0-81c6-e3539cb020dd tempest-VolumeDependencyTests-1793337236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb27067a-148e-4e64-8962-3ac16bc80cf8.cf711ded-39fa-4af0-be22-b89e14cfbc4a {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:31 devstack sudo[104859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb27067a-148e-4e64-8962-3ac16bc80cf8.cf711ded-39fa-4af0-be22-b89e14cfbc4a Sep 17 22:11:31 devstack sudo[104859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:31 devstack sudo[104859]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:31 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-847d2621-6348-48a0-81c6-e3539cb020dd tempest-VolumeDependencyTests-1793337236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb27067a-148e-4e64-8962-3ac16bc80cf8.cf711ded-39fa-4af0-be22-b89e14cfbc4a" returned: 0 in 0.256s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:31 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-847d2621-6348-48a0-81c6-e3539cb020dd tempest-VolumeDependencyTests-1793337236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb27067a-148e-4e64-8962-3ac16bc80cf8.info {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:32 devstack sudo[104862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb27067a-148e-4e64-8962-3ac16bc80cf8.info Sep 17 22:11:32 devstack sudo[104862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:32 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b558e8f-149b-4612-85e8-802b1a1f385a tempest-ProjectReaderTests-1676955223 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 22:11:32 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-2b558e8f-149b-4612-85e8-802b1a1f385a tempest-ProjectReaderTests-1676955223 None] Flow 'volume_create_manager' (bfef9281-e7c6-4b19-9c50-05bea5fc0ee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:11:32 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-2b558e8f-149b-4612-85e8-802b1a1f385a tempest-ProjectReaderTests-1676955223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9b20fa7-7144-43e9-bf9e-f719b4a82b3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:32 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-2b558e8f-149b-4612-85e8-802b1a1f385a tempest-ProjectReaderTests-1676955223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9b20fa7-7144-43e9-bf9e-f719b4a82b3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:11:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2333777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74f1819f-1676-43ba-91bf-1656df943b55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e4464b587ad40759679fd10b5eda168',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:11:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:11:32Z,use_quota=True,user_id='dcf31a786e3845bab1a502363d0f3482',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:32 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-2b558e8f-149b-4612-85e8-802b1a1f385a tempest-ProjectReaderTests-1676955223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9213e2e8-d785-4130-b7d3-3868703144c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:32 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-2b558e8f-149b-4612-85e8-802b1a1f385a tempest-ProjectReaderTests-1676955223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9213e2e8-d785-4130-b7d3-3868703144c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:32 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-2b558e8f-149b-4612-85e8-802b1a1f385a tempest-ProjectReaderTests-1676955223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a193feb-9b81-40b9-b57f-f870864303a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:32 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-2b558e8f-149b-4612-85e8-802b1a1f385a tempest-ProjectReaderTests-1676955223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a193feb-9b81-40b9-b57f-f870864303a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74f1819f-1676-43ba-91bf-1656df943b55', 'volume_name': 'volume-74f1819f-1676-43ba-91bf-1656df943b55', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:32 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-2b558e8f-149b-4612-85e8-802b1a1f385a tempest-ProjectReaderTests-1676955223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44bc15c0-4968-473d-aa16-3581c4878b60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:32 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-2b558e8f-149b-4612-85e8-802b1a1f385a tempest-ProjectReaderTests-1676955223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44bc15c0-4968-473d-aa16-3581c4878b60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:32 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-2b558e8f-149b-4612-85e8-802b1a1f385a tempest-ProjectReaderTests-1676955223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e8f97f6-1f95-4851-b060-626ef66f20f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:32 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-2b558e8f-149b-4612-85e8-802b1a1f385a tempest-ProjectReaderTests-1676955223 None] Volume 74f1819f-1676-43ba-91bf-1656df943b55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74f1819f-1676-43ba-91bf-1656df943b55', 'volume_size': 1} Sep 17 22:11:32 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-2b558e8f-149b-4612-85e8-802b1a1f385a tempest-ProjectReaderTests-1676955223 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:11:32 devstack sudo[104862]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:32 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-847d2621-6348-48a0-81c6-e3539cb020dd tempest-VolumeDependencyTests-1793337236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb27067a-148e-4e64-8962-3ac16bc80cf8.info" returned: 0 in 0.254s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:32 devstack cinder-volume[85458]: WARNING cinder.volume.drivers.remotefs [None req-847d2621-6348-48a0-81c6-e3539cb020dd tempest-VolumeDependencyTests-1793337236 None] /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb27067a-148e-4e64-8962-3ac16bc80cf8.info is being set with open permissions: ugo+rw Sep 17 22:11:32 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-847d2621-6348-48a0-81c6-e3539cb020dd tempest-VolumeDependencyTests-1793337236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb27067a-148e-4e64-8962-3ac16bc80cf8.info {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:32 devstack sudo[104865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb27067a-148e-4e64-8962-3ac16bc80cf8.info Sep 17 22:11:32 devstack sudo[104865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:32 devstack sudo[104865]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:32 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-847d2621-6348-48a0-81c6-e3539cb020dd tempest-VolumeDependencyTests-1793337236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb27067a-148e-4e64-8962-3ac16bc80cf8.info" returned: 0 in 0.253s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:32 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-847d2621-6348-48a0-81c6-e3539cb020dd tempest-VolumeDependencyTests-1793337236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.065s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:11:32 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e14ffc47-2052-4d3d-86e1-f6dced762663 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.487s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:11:32 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-e14ffc47-2052-4d3d-86e1-f6dced762663 tempest-CreateVolumesFromSnapshotTest-1444870577 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:11:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1126606519',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=449d06b1-6efd-4c73-910f-134797feab9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='378205ccfa9949c1a6bae07a5e05d296',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:11:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:11:29Z,use_quota=True,user_id='1f5b811e4141485e8a7aa317d71d1870',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 22:11:32 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-e14ffc47-2052-4d3d-86e1-f6dced762663 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Creating volume 449d06b1-6efd-4c73-910f-134797feab9d {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 22:11:32 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e14ffc47-2052-4d3d-86e1-f6dced762663 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:11:32 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e14ffc47-2052-4d3d-86e1-f6dced762663 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:11:32 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-e14ffc47-2052-4d3d-86e1-f6dced762663 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:11:32 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-e14ffc47-2052-4d3d-86e1-f6dced762663 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:11:32 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e14ffc47-2052-4d3d-86e1-f6dced762663 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:11:32 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-e14ffc47-2052-4d3d-86e1-f6dced762663 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 22:11:32 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-e14ffc47-2052-4d3d-86e1-f6dced762663 tempest-CreateVolumesFromSnapshotTest-1444870577 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 22:11:32 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e14ffc47-2052-4d3d-86e1-f6dced762663 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-449d06b1-6efd-4c73-910f-134797feab9d 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:32 devstack sudo[104868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-449d06b1-6efd-4c73-910f-134797feab9d 1073741824 Sep 17 22:11:32 devstack sudo[104868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:32 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-847d2621-6348-48a0-81c6-e3539cb020dd tempest-VolumeDependencyTests-1793337236 None] Create snapshot completed successfully Sep 17 22:11:32 devstack sudo[104868]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:32 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e14ffc47-2052-4d3d-86e1-f6dced762663 tempest-CreateVolumesFromSnapshotTest-1444870577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-449d06b1-6efd-4c73-910f-134797feab9d 1073741824" returned: 0 in 0.426s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:32 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e14ffc47-2052-4d3d-86e1-f6dced762663 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-449d06b1-6efd-4c73-910f-134797feab9d {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:33 devstack sudo[104874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-449d06b1-6efd-4c73-910f-134797feab9d Sep 17 22:11:33 devstack sudo[104874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:33 devstack sudo[104874]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:33 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e14ffc47-2052-4d3d-86e1-f6dced762663 tempest-CreateVolumesFromSnapshotTest-1444870577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-449d06b1-6efd-4c73-910f-134797feab9d" returned: 0 in 0.259s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:33 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-e14ffc47-2052-4d3d-86e1-f6dced762663 tempest-CreateVolumesFromSnapshotTest-1444870577 None] <== create_volume: return (729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 22:11:33 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e14ffc47-2052-4d3d-86e1-f6dced762663 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.732s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:11:33 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-001b30ba-3bc3-4dcc-9bd8-0926037be51c tempest-CreateVolumesFromSnapshotTest-1444870577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.840s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:11:33 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-001b30ba-3bc3-4dcc-9bd8-0926037be51c tempest-CreateVolumesFromSnapshotTest-1444870577 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:11:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1848315660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9010853-de9b-4b58-83a9-2b64ec8c8130,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='378205ccfa9949c1a6bae07a5e05d296',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:11:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:11:29Z,use_quota=True,user_id='1f5b811e4141485e8a7aa317d71d1870',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 22:11:33 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-001b30ba-3bc3-4dcc-9bd8-0926037be51c tempest-CreateVolumesFromSnapshotTest-1444870577 None] Creating volume d9010853-de9b-4b58-83a9-2b64ec8c8130 {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 22:11:33 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-001b30ba-3bc3-4dcc-9bd8-0926037be51c tempest-CreateVolumesFromSnapshotTest-1444870577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:11:33 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-001b30ba-3bc3-4dcc-9bd8-0926037be51c tempest-CreateVolumesFromSnapshotTest-1444870577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:11:33 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-001b30ba-3bc3-4dcc-9bd8-0926037be51c tempest-CreateVolumesFromSnapshotTest-1444870577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:11:33 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-001b30ba-3bc3-4dcc-9bd8-0926037be51c tempest-CreateVolumesFromSnapshotTest-1444870577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:11:33 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-001b30ba-3bc3-4dcc-9bd8-0926037be51c tempest-CreateVolumesFromSnapshotTest-1444870577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:11:33 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-001b30ba-3bc3-4dcc-9bd8-0926037be51c tempest-CreateVolumesFromSnapshotTest-1444870577 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 22:11:33 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-001b30ba-3bc3-4dcc-9bd8-0926037be51c tempest-CreateVolumesFromSnapshotTest-1444870577 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 22:11:33 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-001b30ba-3bc3-4dcc-9bd8-0926037be51c tempest-CreateVolumesFromSnapshotTest-1444870577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-d9010853-de9b-4b58-83a9-2b64ec8c8130 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:33 devstack sudo[104877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-d9010853-de9b-4b58-83a9-2b64ec8c8130 1073741824 Sep 17 22:11:33 devstack sudo[104877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:33 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e14ffc47-2052-4d3d-86e1-f6dced762663 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c839562-d086-4f0b-9db7-34b090f39bc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-449d06b1-6efd-4c73-910f-134797feab9d', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:33 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e14ffc47-2052-4d3d-86e1-f6dced762663 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b15d282-da8e-4d43-9ca0-4c8d68148399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:33 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c066446-f41e-41e0-9dcb-32e2de36551d tempest-VolumeDependencyTests-1793337236 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 22:11:33 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-e14ffc47-2052-4d3d-86e1-f6dced762663 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Volume volume-449d06b1-6efd-4c73-910f-134797feab9d (449d06b1-6efd-4c73-910f-134797feab9d): created successfully Sep 17 22:11:33 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e14ffc47-2052-4d3d-86e1-f6dced762663 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b15d282-da8e-4d43-9ca0-4c8d68148399) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:33 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e14ffc47-2052-4d3d-86e1-f6dced762663 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Flow 'volume_create_manager' (7f2fd0ac-b50a-49ec-af9d-40d6db44ad75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:11:33 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-3c066446-f41e-41e0-9dcb-32e2de36551d tempest-VolumeDependencyTests-1793337236 None] Flow 'volume_create_manager' (42ea582d-8015-4025-a1f0-66b440f32471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:11:33 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-3c066446-f41e-41e0-9dcb-32e2de36551d tempest-VolumeDependencyTests-1793337236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf9c42f5-16b7-4289-8e1f-6179dab345a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:33 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-e14ffc47-2052-4d3d-86e1-f6dced762663 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Created volume successfully. Sep 17 22:11:33 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-3c066446-f41e-41e0-9dcb-32e2de36551d tempest-VolumeDependencyTests-1793337236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf9c42f5-16b7-4289-8e1f-6179dab345a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:11:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1797432266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c587dbcf-9e7d-43db-a9ce-738bbb31d59b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d28e78916bc9453387f9808dbfc231f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:11:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=cf711ded-39fa-4af0-be22-b89e14cfbc4a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:11:33Z,use_quota=True,user_id='737af02dd74a4a3b988468eec18e881e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:33 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-3c066446-f41e-41e0-9dcb-32e2de36551d tempest-VolumeDependencyTests-1793337236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6757dc3e-a0d1-4c72-8f5f-9146e6606ba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:33 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-3c066446-f41e-41e0-9dcb-32e2de36551d tempest-VolumeDependencyTests-1793337236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6757dc3e-a0d1-4c72-8f5f-9146e6606ba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:33 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-3c066446-f41e-41e0-9dcb-32e2de36551d tempest-VolumeDependencyTests-1793337236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (faaeddcd-ffa0-41a8-93a9-d33c4b8e9d4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:33 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-3c066446-f41e-41e0-9dcb-32e2de36551d tempest-VolumeDependencyTests-1793337236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (faaeddcd-ffa0-41a8-93a9-d33c4b8e9d4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c587dbcf-9e7d-43db-a9ce-738bbb31d59b', 'volume_name': 'volume-c587dbcf-9e7d-43db-a9ce-738bbb31d59b', 'volume_size': 1, 'snapshot_id': 'cf711ded-39fa-4af0-be22-b89e14cfbc4a'}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:33 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-3c066446-f41e-41e0-9dcb-32e2de36551d tempest-VolumeDependencyTests-1793337236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c134c32-59aa-4bcd-9037-0aac284cba35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:33 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-3c066446-f41e-41e0-9dcb-32e2de36551d tempest-VolumeDependencyTests-1793337236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c134c32-59aa-4bcd-9037-0aac284cba35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:33 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-3c066446-f41e-41e0-9dcb-32e2de36551d tempest-VolumeDependencyTests-1793337236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0e686c6-9911-4cc2-a8a8-b63125b220b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:33 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-3c066446-f41e-41e0-9dcb-32e2de36551d tempest-VolumeDependencyTests-1793337236 None] Volume c587dbcf-9e7d-43db-a9ce-738bbb31d59b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c587dbcf-9e7d-43db-a9ce-738bbb31d59b', 'volume_size': 1, 'snapshot_id': 'cf711ded-39fa-4af0-be22-b89e14cfbc4a'} Sep 17 22:11:33 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-3c066446-f41e-41e0-9dcb-32e2de36551d tempest-VolumeDependencyTests-1793337236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:11:33 devstack sudo[104877]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:33 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-001b30ba-3bc3-4dcc-9bd8-0926037be51c tempest-CreateVolumesFromSnapshotTest-1444870577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-d9010853-de9b-4b58-83a9-2b64ec8c8130 1073741824" returned: 0 in 0.428s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:33 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-001b30ba-3bc3-4dcc-9bd8-0926037be51c tempest-CreateVolumesFromSnapshotTest-1444870577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-d9010853-de9b-4b58-83a9-2b64ec8c8130 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:33 devstack sudo[104883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-d9010853-de9b-4b58-83a9-2b64ec8c8130 Sep 17 22:11:33 devstack sudo[104883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:33 devstack sudo[104883]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:33 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-001b30ba-3bc3-4dcc-9bd8-0926037be51c tempest-CreateVolumesFromSnapshotTest-1444870577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-d9010853-de9b-4b58-83a9-2b64ec8c8130" returned: 0 in 0.238s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:33 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-001b30ba-3bc3-4dcc-9bd8-0926037be51c tempest-CreateVolumesFromSnapshotTest-1444870577 None] <== create_volume: return (702ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 22:11:33 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-001b30ba-3bc3-4dcc-9bd8-0926037be51c tempest-CreateVolumesFromSnapshotTest-1444870577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.706s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:11:33 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-fa41a12a-7707-4166-82f7-788f58f03d3c tempest-CreateVolumesFromSnapshotTest-1444870577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.032s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:11:33 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-fa41a12a-7707-4166-82f7-788f58f03d3c tempest-CreateVolumesFromSnapshotTest-1444870577 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:11:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-387281999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37a6008a-c0c6-4bfd-bb0f-eb3a0c64d4a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='378205ccfa9949c1a6bae07a5e05d296',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:11:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:11:30Z,use_quota=True,user_id='1f5b811e4141485e8a7aa317d71d1870',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 22:11:33 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-fa41a12a-7707-4166-82f7-788f58f03d3c tempest-CreateVolumesFromSnapshotTest-1444870577 None] Creating volume 37a6008a-c0c6-4bfd-bb0f-eb3a0c64d4a5 {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 22:11:33 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-fa41a12a-7707-4166-82f7-788f58f03d3c tempest-CreateVolumesFromSnapshotTest-1444870577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:11:33 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-fa41a12a-7707-4166-82f7-788f58f03d3c tempest-CreateVolumesFromSnapshotTest-1444870577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:11:33 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-fa41a12a-7707-4166-82f7-788f58f03d3c tempest-CreateVolumesFromSnapshotTest-1444870577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:11:33 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-fa41a12a-7707-4166-82f7-788f58f03d3c tempest-CreateVolumesFromSnapshotTest-1444870577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:11:33 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-fa41a12a-7707-4166-82f7-788f58f03d3c tempest-CreateVolumesFromSnapshotTest-1444870577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:11:33 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-fa41a12a-7707-4166-82f7-788f58f03d3c tempest-CreateVolumesFromSnapshotTest-1444870577 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 22:11:33 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-fa41a12a-7707-4166-82f7-788f58f03d3c tempest-CreateVolumesFromSnapshotTest-1444870577 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 22:11:33 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-fa41a12a-7707-4166-82f7-788f58f03d3c tempest-CreateVolumesFromSnapshotTest-1444870577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-37a6008a-c0c6-4bfd-bb0f-eb3a0c64d4a5 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:34 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-001b30ba-3bc3-4dcc-9bd8-0926037be51c tempest-CreateVolumesFromSnapshotTest-1444870577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5567fb1d-e230-416d-86c2-17539c684d9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9010853-de9b-4b58-83a9-2b64ec8c8130', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:34 devstack sudo[104886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-37a6008a-c0c6-4bfd-bb0f-eb3a0c64d4a5 1073741824 Sep 17 22:11:34 devstack sudo[104886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:34 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-001b30ba-3bc3-4dcc-9bd8-0926037be51c tempest-CreateVolumesFromSnapshotTest-1444870577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43cf1854-bfb0-4272-93c8-4d8a99e0c1a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:34 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-001b30ba-3bc3-4dcc-9bd8-0926037be51c tempest-CreateVolumesFromSnapshotTest-1444870577 None] Volume volume-d9010853-de9b-4b58-83a9-2b64ec8c8130 (d9010853-de9b-4b58-83a9-2b64ec8c8130): created successfully Sep 17 22:11:34 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-001b30ba-3bc3-4dcc-9bd8-0926037be51c tempest-CreateVolumesFromSnapshotTest-1444870577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43cf1854-bfb0-4272-93c8-4d8a99e0c1a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:34 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-001b30ba-3bc3-4dcc-9bd8-0926037be51c tempest-CreateVolumesFromSnapshotTest-1444870577 None] Flow 'volume_create_manager' (f42bab06-6920-4579-b367-aaabb5ea1abf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:11:34 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-001b30ba-3bc3-4dcc-9bd8-0926037be51c tempest-CreateVolumesFromSnapshotTest-1444870577 None] Created volume successfully. Sep 17 22:11:34 devstack sudo[104886]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:34 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-fa41a12a-7707-4166-82f7-788f58f03d3c tempest-CreateVolumesFromSnapshotTest-1444870577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-37a6008a-c0c6-4bfd-bb0f-eb3a0c64d4a5 1073741824" returned: 0 in 0.435s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:34 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-fa41a12a-7707-4166-82f7-788f58f03d3c tempest-CreateVolumesFromSnapshotTest-1444870577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-37a6008a-c0c6-4bfd-bb0f-eb3a0c64d4a5 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:34 devstack sudo[104892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-37a6008a-c0c6-4bfd-bb0f-eb3a0c64d4a5 Sep 17 22:11:34 devstack sudo[104892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:34 devstack sudo[104892]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:34 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-fa41a12a-7707-4166-82f7-788f58f03d3c tempest-CreateVolumesFromSnapshotTest-1444870577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-37a6008a-c0c6-4bfd-bb0f-eb3a0c64d4a5" returned: 0 in 0.245s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:34 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-fa41a12a-7707-4166-82f7-788f58f03d3c tempest-CreateVolumesFromSnapshotTest-1444870577 None] <== create_volume: return (722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 22:11:34 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-fa41a12a-7707-4166-82f7-788f58f03d3c tempest-CreateVolumesFromSnapshotTest-1444870577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.725s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:11:34 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-96b5b9de-49b4-4f6f-99b3-28850d814513 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.351s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:11:34 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-96b5b9de-49b4-4f6f-99b3-28850d814513 tempest-CreateVolumesFromSnapshotTest-1444870577 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:11:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1094504913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92eba308-3af6-4c0b-a79e-63550d2e58c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='378205ccfa9949c1a6bae07a5e05d296',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:11:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:11:30Z,use_quota=True,user_id='1f5b811e4141485e8a7aa317d71d1870',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 22:11:34 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-96b5b9de-49b4-4f6f-99b3-28850d814513 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Creating volume 92eba308-3af6-4c0b-a79e-63550d2e58c2 {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 22:11:34 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-96b5b9de-49b4-4f6f-99b3-28850d814513 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:11:34 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-96b5b9de-49b4-4f6f-99b3-28850d814513 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:11:34 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-96b5b9de-49b4-4f6f-99b3-28850d814513 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:11:34 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-96b5b9de-49b4-4f6f-99b3-28850d814513 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:11:34 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-96b5b9de-49b4-4f6f-99b3-28850d814513 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:11:34 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-96b5b9de-49b4-4f6f-99b3-28850d814513 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 22:11:34 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-96b5b9de-49b4-4f6f-99b3-28850d814513 tempest-CreateVolumesFromSnapshotTest-1444870577 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 22:11:34 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-96b5b9de-49b4-4f6f-99b3-28850d814513 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-92eba308-3af6-4c0b-a79e-63550d2e58c2 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:34 devstack sudo[104895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-92eba308-3af6-4c0b-a79e-63550d2e58c2 1073741824 Sep 17 22:11:34 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-fa41a12a-7707-4166-82f7-788f58f03d3c tempest-CreateVolumesFromSnapshotTest-1444870577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e59dc33e-24a9-4079-b5e1-61f3f1f21cbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37a6008a-c0c6-4bfd-bb0f-eb3a0c64d4a5', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:34 devstack sudo[104895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:34 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-fa41a12a-7707-4166-82f7-788f58f03d3c tempest-CreateVolumesFromSnapshotTest-1444870577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f1b4942-4499-434a-b0c0-92dbf06c938e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:34 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-fa41a12a-7707-4166-82f7-788f58f03d3c tempest-CreateVolumesFromSnapshotTest-1444870577 None] Volume volume-37a6008a-c0c6-4bfd-bb0f-eb3a0c64d4a5 (37a6008a-c0c6-4bfd-bb0f-eb3a0c64d4a5): created successfully Sep 17 22:11:34 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-fa41a12a-7707-4166-82f7-788f58f03d3c tempest-CreateVolumesFromSnapshotTest-1444870577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f1b4942-4499-434a-b0c0-92dbf06c938e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:34 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-fa41a12a-7707-4166-82f7-788f58f03d3c tempest-CreateVolumesFromSnapshotTest-1444870577 None] Flow 'volume_create_manager' (5837288c-8217-4622-ae3c-f6deee96a146) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:11:34 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-fa41a12a-7707-4166-82f7-788f58f03d3c tempest-CreateVolumesFromSnapshotTest-1444870577 None] Created volume successfully. Sep 17 22:11:35 devstack sudo[104895]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:35 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-96b5b9de-49b4-4f6f-99b3-28850d814513 tempest-CreateVolumesFromSnapshotTest-1444870577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-92eba308-3af6-4c0b-a79e-63550d2e58c2 1073741824" returned: 0 in 0.402s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:35 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-96b5b9de-49b4-4f6f-99b3-28850d814513 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-92eba308-3af6-4c0b-a79e-63550d2e58c2 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:35 devstack sudo[104901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-92eba308-3af6-4c0b-a79e-63550d2e58c2 Sep 17 22:11:35 devstack sudo[104901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:35 devstack sudo[104901]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:35 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-96b5b9de-49b4-4f6f-99b3-28850d814513 tempest-CreateVolumesFromSnapshotTest-1444870577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-92eba308-3af6-4c0b-a79e-63550d2e58c2" returned: 0 in 0.251s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:35 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-96b5b9de-49b4-4f6f-99b3-28850d814513 tempest-CreateVolumesFromSnapshotTest-1444870577 None] <== create_volume: return (696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 22:11:35 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-96b5b9de-49b4-4f6f-99b3-28850d814513 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.699s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:11:35 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-28bef49a-562a-4897-9755-d34626cfceee tempest-ProjectMemberTests-1966135882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.804s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:11:35 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-96b5b9de-49b4-4f6f-99b3-28850d814513 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45090ad3-284c-4d73-b7b0-3850026fe934) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92eba308-3af6-4c0b-a79e-63550d2e58c2', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:35 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-96b5b9de-49b4-4f6f-99b3-28850d814513 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3db46517-fdc5-481f-93c0-e20d7a0c283b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:35 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-28bef49a-562a-4897-9755-d34626cfceee tempest-ProjectMemberTests-1966135882 None] Creating offline snapshot b4733ed5-7e35-4743-9c2a-77234109a921 of volume 67b2590f-6b10-4780-a42c-e4c537b68286 {{(pid=85458) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 22:11:35 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-96b5b9de-49b4-4f6f-99b3-28850d814513 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Volume volume-92eba308-3af6-4c0b-a79e-63550d2e58c2 (92eba308-3af6-4c0b-a79e-63550d2e58c2): created successfully Sep 17 22:11:35 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-96b5b9de-49b4-4f6f-99b3-28850d814513 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3db46517-fdc5-481f-93c0-e20d7a0c283b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:35 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-96b5b9de-49b4-4f6f-99b3-28850d814513 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Flow 'volume_create_manager' (03f3d83a-36b5-4e37-b218-58afb73ceae6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:11:35 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[39d0ff48-3d3e-4f16-b4c6-9f38e6b98be2]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:11:35 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-28bef49a-562a-4897-9755-d34626cfceee tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-67b2590f-6b10-4780-a42c-e4c537b68286 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:35 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-96b5b9de-49b4-4f6f-99b3-28850d814513 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Created volume successfully. Sep 17 22:11:35 devstack sudo[104904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-67b2590f-6b10-4780-a42c-e4c537b68286 Sep 17 22:11:35 devstack sudo[104904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:35 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-85e364ea-ed72-4e71-813a-42f736dbc4b4 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Acquiring lock "cinder-92eba308-3af6-4c0b-a79e-63550d2e58c2-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:11:35 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-85e364ea-ed72-4e71-813a-42f736dbc4b4 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Lock "cinder-92eba308-3af6-4c0b-a79e-63550d2e58c2-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:11:35 devstack sudo[104904]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:35 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-85e364ea-ed72-4e71-813a-42f736dbc4b4 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Acquiring lock "cinder-quobyte-92eba308-3af6-4c0b-a79e-63550d2e58c2" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:11:35 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-28bef49a-562a-4897-9755-d34626cfceee tempest-ProjectMemberTests-1966135882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-67b2590f-6b10-4780-a42c-e4c537b68286" returned: 0 in 0.385s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:35 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-28bef49a-562a-4897-9755-d34626cfceee tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-67b2590f-6b10-4780-a42c-e4c537b68286,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-67b2590f-6b10-4780-a42c-e4c537b68286.b4733ed5-7e35-4743-9c2a-77234109a921 1G {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:35 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-85e364ea-ed72-4e71-813a-42f736dbc4b4 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Lock "cinder-quobyte-92eba308-3af6-4c0b-a79e-63550d2e58c2" acquired by "delete_volume" :: waited 0.024s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:11:35 devstack sudo[104910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-67b2590f-6b10-4780-a42c-e4c537b68286,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-67b2590f-6b10-4780-a42c-e4c537b68286.b4733ed5-7e35-4743-9c2a-77234109a921 1G Sep 17 22:11:35 devstack sudo[104910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:35 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7d98957-9e3f-495d-8854-f39605a7d597]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:11:35 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-85e364ea-ed72-4e71-813a-42f736dbc4b4 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-92eba308-3af6-4c0b-a79e-63550d2e58c2 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:36 devstack sudo[104912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-92eba308-3af6-4c0b-a79e-63550d2e58c2 Sep 17 22:11:36 devstack sudo[104912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:36 devstack sudo[104910]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:36 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-28bef49a-562a-4897-9755-d34626cfceee tempest-ProjectMemberTests-1966135882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-67b2590f-6b10-4780-a42c-e4c537b68286,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-67b2590f-6b10-4780-a42c-e4c537b68286.b4733ed5-7e35-4743-9c2a-77234109a921 1G" returned: 0 in 0.431s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:36 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-28bef49a-562a-4897-9755-d34626cfceee tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67b2590f-6b10-4780-a42c-e4c537b68286 -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-67b2590f-6b10-4780-a42c-e4c537b68286.b4733ed5-7e35-4743-9c2a-77234109a921 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:36 devstack sudo[104912]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:36 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-85e364ea-ed72-4e71-813a-42f736dbc4b4 tempest-CreateVolumesFromSnapshotTest-1444870577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-92eba308-3af6-4c0b-a79e-63550d2e58c2" returned: 0 in 0.410s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:36 devstack sudo[104923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67b2590f-6b10-4780-a42c-e4c537b68286 -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-67b2590f-6b10-4780-a42c-e4c537b68286.b4733ed5-7e35-4743-9c2a-77234109a921 Sep 17 22:11:36 devstack sudo[104923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:36 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-85e364ea-ed72-4e71-813a-42f736dbc4b4 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-92eba308-3af6-4c0b-a79e-63550d2e58c2 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:36 devstack sudo[104925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-92eba308-3af6-4c0b-a79e-63550d2e58c2 Sep 17 22:11:36 devstack sudo[104925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:36 devstack sudo[104925]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:36 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-85e364ea-ed72-4e71-813a-42f736dbc4b4 tempest-CreateVolumesFromSnapshotTest-1444870577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-92eba308-3af6-4c0b-a79e-63550d2e58c2" returned: 0 in 0.247s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:36 devstack sudo[104923]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:36 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-28bef49a-562a-4897-9755-d34626cfceee tempest-ProjectMemberTests-1966135882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67b2590f-6b10-4780-a42c-e4c537b68286 -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-67b2590f-6b10-4780-a42c-e4c537b68286.b4733ed5-7e35-4743-9c2a-77234109a921" returned: 0 in 0.298s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:36 devstack cinder-volume[85458]: WARNING cinder.volume.drivers.remotefs [None req-28bef49a-562a-4897-9755-d34626cfceee tempest-ProjectMemberTests-1966135882 None] /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-67b2590f-6b10-4780-a42c-e4c537b68286.b4733ed5-7e35-4743-9c2a-77234109a921 is being set with open permissions: ugo+rw Sep 17 22:11:36 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-28bef49a-562a-4897-9755-d34626cfceee tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-67b2590f-6b10-4780-a42c-e4c537b68286.b4733ed5-7e35-4743-9c2a-77234109a921 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:36 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-85e364ea-ed72-4e71-813a-42f736dbc4b4 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Lock "cinder-quobyte-92eba308-3af6-4c0b-a79e-63550d2e58c2" released by "delete_volume" :: held 0.723s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:11:36 devstack sudo[104931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-67b2590f-6b10-4780-a42c-e4c537b68286.b4733ed5-7e35-4743-9c2a-77234109a921 Sep 17 22:11:36 devstack sudo[104931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:36 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-85e364ea-ed72-4e71-813a-42f736dbc4b4 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Created reservations ['b75c33a4-dcfe-4b34-b0a8-5f05d963de0d', '53e04946-3d6f-4cb7-900d-32823b7a20f3', '2a087e33-9ef4-46fa-b593-202b47c38ad0', 'eefd7a51-a5bd-45ed-8bb5-4073993f7b22'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:11:36 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-85e364ea-ed72-4e71-813a-42f736dbc4b4 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:11:36 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-85e364ea-ed72-4e71-813a-42f736dbc4b4 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:11:36 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-85e364ea-ed72-4e71-813a-42f736dbc4b4 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:11:36 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-85e364ea-ed72-4e71-813a-42f736dbc4b4 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:11:36 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-85e364ea-ed72-4e71-813a-42f736dbc4b4 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:11:36 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-85e364ea-ed72-4e71-813a-42f736dbc4b4 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:36 devstack sudo[104933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:11:36 devstack sudo[104933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:36 devstack sudo[104931]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:36 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-28bef49a-562a-4897-9755-d34626cfceee tempest-ProjectMemberTests-1966135882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-67b2590f-6b10-4780-a42c-e4c537b68286.b4733ed5-7e35-4743-9c2a-77234109a921" returned: 0 in 0.261s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:36 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-28bef49a-562a-4897-9755-d34626cfceee tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-67b2590f-6b10-4780-a42c-e4c537b68286.info {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:36 devstack sudo[104936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-67b2590f-6b10-4780-a42c-e4c537b68286.info Sep 17 22:11:36 devstack sudo[104936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:36 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-ba64b6ae-166d-48f7-95db-3bd0cbc95452 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Acquiring lock "cinder-37a6008a-c0c6-4bfd-bb0f-eb3a0c64d4a5-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:11:36 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-ba64b6ae-166d-48f7-95db-3bd0cbc95452 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Lock "cinder-37a6008a-c0c6-4bfd-bb0f-eb3a0c64d4a5-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:11:37 devstack sudo[104933]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:37 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-85e364ea-ed72-4e71-813a-42f736dbc4b4 tempest-CreateVolumesFromSnapshotTest-1444870577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.284s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:37 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-85e364ea-ed72-4e71-813a-42f736dbc4b4 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:11:37 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-85e364ea-ed72-4e71-813a-42f736dbc4b4 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Deleted volume successfully. Sep 17 22:11:37 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-85e364ea-ed72-4e71-813a-42f736dbc4b4 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Lock "cinder-92eba308-3af6-4c0b-a79e-63550d2e58c2-delete_volume" released by "delete_volume" :: held 1.239s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:11:37 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-ba64b6ae-166d-48f7-95db-3bd0cbc95452 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Acquiring lock "cinder-quobyte-37a6008a-c0c6-4bfd-bb0f-eb3a0c64d4a5" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:11:37 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-ba64b6ae-166d-48f7-95db-3bd0cbc95452 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Lock "cinder-quobyte-37a6008a-c0c6-4bfd-bb0f-eb3a0c64d4a5" acquired by "delete_volume" :: waited 0.016s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:11:37 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ed11017-2c66-47eb-a60c-fc50b5931d08]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:11:37 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-ba64b6ae-166d-48f7-95db-3bd0cbc95452 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-37a6008a-c0c6-4bfd-bb0f-eb3a0c64d4a5 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:37 devstack sudo[104936]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:37 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-28bef49a-562a-4897-9755-d34626cfceee tempest-ProjectMemberTests-1966135882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-67b2590f-6b10-4780-a42c-e4c537b68286.info" returned: 0 in 0.282s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:37 devstack cinder-volume[85458]: WARNING cinder.volume.drivers.remotefs [None req-28bef49a-562a-4897-9755-d34626cfceee tempest-ProjectMemberTests-1966135882 None] /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-67b2590f-6b10-4780-a42c-e4c537b68286.info is being set with open permissions: ugo+rw Sep 17 22:11:37 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-28bef49a-562a-4897-9755-d34626cfceee tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-67b2590f-6b10-4780-a42c-e4c537b68286.info {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:37 devstack sudo[104941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-67b2590f-6b10-4780-a42c-e4c537b68286.info Sep 17 22:11:37 devstack sudo[104941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:37 devstack sudo[104940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-37a6008a-c0c6-4bfd-bb0f-eb3a0c64d4a5 Sep 17 22:11:37 devstack sudo[104940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:37 devstack sudo[104941]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:37 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-28bef49a-562a-4897-9755-d34626cfceee tempest-ProjectMemberTests-1966135882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-67b2590f-6b10-4780-a42c-e4c537b68286.info" returned: 0 in 0.256s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:37 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-28bef49a-562a-4897-9755-d34626cfceee tempest-ProjectMemberTests-1966135882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.020s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:11:37 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-2b558e8f-149b-4612-85e8-802b1a1f385a tempest-ProjectReaderTests-1676955223 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.237s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:11:37 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-2b558e8f-149b-4612-85e8-802b1a1f385a tempest-ProjectReaderTests-1676955223 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:11:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2333777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74f1819f-1676-43ba-91bf-1656df943b55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e4464b587ad40759679fd10b5eda168',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:11:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:11:32Z,use_quota=True,user_id='dcf31a786e3845bab1a502363d0f3482',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 22:11:37 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-2b558e8f-149b-4612-85e8-802b1a1f385a tempest-ProjectReaderTests-1676955223 None] Creating volume 74f1819f-1676-43ba-91bf-1656df943b55 {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 22:11:37 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-2b558e8f-149b-4612-85e8-802b1a1f385a tempest-ProjectReaderTests-1676955223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:11:37 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-2b558e8f-149b-4612-85e8-802b1a1f385a tempest-ProjectReaderTests-1676955223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:11:37 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-2b558e8f-149b-4612-85e8-802b1a1f385a tempest-ProjectReaderTests-1676955223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:11:37 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-2b558e8f-149b-4612-85e8-802b1a1f385a tempest-ProjectReaderTests-1676955223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:11:37 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-2b558e8f-149b-4612-85e8-802b1a1f385a tempest-ProjectReaderTests-1676955223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:11:37 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-2b558e8f-149b-4612-85e8-802b1a1f385a tempest-ProjectReaderTests-1676955223 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 22:11:37 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-2b558e8f-149b-4612-85e8-802b1a1f385a tempest-ProjectReaderTests-1676955223 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 22:11:37 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-2b558e8f-149b-4612-85e8-802b1a1f385a tempest-ProjectReaderTests-1676955223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-74f1819f-1676-43ba-91bf-1656df943b55 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:37 devstack sudo[104948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-74f1819f-1676-43ba-91bf-1656df943b55 1073741824 Sep 17 22:11:37 devstack sudo[104948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:37 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-28bef49a-562a-4897-9755-d34626cfceee tempest-ProjectMemberTests-1966135882 None] Create snapshot completed successfully Sep 17 22:11:37 devstack sudo[104940]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:37 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-ba64b6ae-166d-48f7-95db-3bd0cbc95452 tempest-CreateVolumesFromSnapshotTest-1444870577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-37a6008a-c0c6-4bfd-bb0f-eb3a0c64d4a5" returned: 0 in 0.392s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:37 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-ba64b6ae-166d-48f7-95db-3bd0cbc95452 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-37a6008a-c0c6-4bfd-bb0f-eb3a0c64d4a5 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:37 devstack sudo[104950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-37a6008a-c0c6-4bfd-bb0f-eb3a0c64d4a5 Sep 17 22:11:37 devstack sudo[104950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:37 devstack sudo[104950]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:37 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-ba64b6ae-166d-48f7-95db-3bd0cbc95452 tempest-CreateVolumesFromSnapshotTest-1444870577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-37a6008a-c0c6-4bfd-bb0f-eb3a0c64d4a5" returned: 0 in 0.272s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:37 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-ba64b6ae-166d-48f7-95db-3bd0cbc95452 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Lock "cinder-quobyte-37a6008a-c0c6-4bfd-bb0f-eb3a0c64d4a5" released by "delete_volume" :: held 0.705s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:11:37 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-c254a3c2-08fd-4328-ac87-acf74ded1b33 tempest-ProjectMemberTests-1966135882 None] Acquiring lock "cinder-b4733ed5-7e35-4743-9c2a-77234109a921-delete_snapshot" by "delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:11:37 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-c254a3c2-08fd-4328-ac87-acf74ded1b33 tempest-ProjectMemberTests-1966135882 None] Lock "cinder-b4733ed5-7e35-4743-9c2a-77234109a921-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:11:37 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-c254a3c2-08fd-4328-ac87-acf74ded1b33 tempest-ProjectMemberTests-1966135882 None] Acquiring lock "cinder-quobyte-67b2590f-6b10-4780-a42c-e4c537b68286" by "delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:11:37 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-ba64b6ae-166d-48f7-95db-3bd0cbc95452 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Created reservations ['842911bd-2631-49bf-9de5-3b9f32a4df23', '32bff8be-fc40-4987-9eca-ae0b339acc25', '8ca0a46f-d4c4-4691-b7f5-09dbc9c3e224', 'ba98e969-d42a-4a60-916f-055cd1ee7cca'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:11:37 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-c254a3c2-08fd-4328-ac87-acf74ded1b33 tempest-ProjectMemberTests-1966135882 None] Lock "cinder-quobyte-67b2590f-6b10-4780-a42c-e4c537b68286" acquired by "delete_snapshot" :: waited 0.029s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:11:37 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-c254a3c2-08fd-4328-ac87-acf74ded1b33 tempest-ProjectMemberTests-1966135882 None] Acquiring lock "cinder-quobyte-b4733ed5-7e35-4743-9c2a-77234109a921" by "_delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:11:37 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-c254a3c2-08fd-4328-ac87-acf74ded1b33 tempest-ProjectMemberTests-1966135882 None] Lock "cinder-quobyte-b4733ed5-7e35-4743-9c2a-77234109a921" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:11:37 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-c254a3c2-08fd-4328-ac87-acf74ded1b33 tempest-ProjectMemberTests-1966135882 None] Deleting offline snapshot b4733ed5-7e35-4743-9c2a-77234109a921 of volume 67b2590f-6b10-4780-a42c-e4c537b68286 {{(pid=85458) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 22:11:37 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-c254a3c2-08fd-4328-ac87-acf74ded1b33 tempest-ProjectMemberTests-1966135882 None] snapshot_file for this snap is: volume-67b2590f-6b10-4780-a42c-e4c537b68286.b4733ed5-7e35-4743-9c2a-77234109a921 {{(pid=85458) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 22:11:37 devstack sudo[104948]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:37 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[21708a85-8e63-4fc5-b4f7-bbc579155f2f]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:11:37 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-c254a3c2-08fd-4328-ac87-acf74ded1b33 tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-67b2590f-6b10-4780-a42c-e4c537b68286.b4733ed5-7e35-4743-9c2a-77234109a921 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:37 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-2b558e8f-149b-4612-85e8-802b1a1f385a tempest-ProjectReaderTests-1676955223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-74f1819f-1676-43ba-91bf-1656df943b55 1073741824" returned: 0 in 0.521s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:38 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-ba64b6ae-166d-48f7-95db-3bd0cbc95452 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:11:38 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-ba64b6ae-166d-48f7-95db-3bd0cbc95452 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:11:38 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-ba64b6ae-166d-48f7-95db-3bd0cbc95452 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:11:38 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-ba64b6ae-166d-48f7-95db-3bd0cbc95452 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:11:38 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-ba64b6ae-166d-48f7-95db-3bd0cbc95452 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:11:38 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-ba64b6ae-166d-48f7-95db-3bd0cbc95452 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:38 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-2b558e8f-149b-4612-85e8-802b1a1f385a tempest-ProjectReaderTests-1676955223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-74f1819f-1676-43ba-91bf-1656df943b55 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:38 devstack sudo[104959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:11:38 devstack sudo[104959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:38 devstack sudo[104960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-74f1819f-1676-43ba-91bf-1656df943b55 Sep 17 22:11:38 devstack sudo[104960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:38 devstack sudo[104958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-67b2590f-6b10-4780-a42c-e4c537b68286.b4733ed5-7e35-4743-9c2a-77234109a921 Sep 17 22:11:38 devstack sudo[104958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:38 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-e33acd04-f8a3-4cd1-8a50-a8572fe29dce tempest-CreateVolumesFromSnapshotTest-1444870577 None] Acquiring lock "cinder-d9010853-de9b-4b58-83a9-2b64ec8c8130-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:11:38 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-e33acd04-f8a3-4cd1-8a50-a8572fe29dce tempest-CreateVolumesFromSnapshotTest-1444870577 None] Lock "cinder-d9010853-de9b-4b58-83a9-2b64ec8c8130-delete_volume" acquired by "delete_volume" :: waited 0.126s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:11:38 devstack sudo[104959]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:38 devstack sudo[104960]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:38 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-ba64b6ae-166d-48f7-95db-3bd0cbc95452 tempest-CreateVolumesFromSnapshotTest-1444870577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.335s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:38 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-ba64b6ae-166d-48f7-95db-3bd0cbc95452 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:11:38 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-2b558e8f-149b-4612-85e8-802b1a1f385a tempest-ProjectReaderTests-1676955223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-74f1819f-1676-43ba-91bf-1656df943b55" returned: 0 in 0.333s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:38 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-2b558e8f-149b-4612-85e8-802b1a1f385a tempest-ProjectReaderTests-1676955223 None] <== create_volume: return (926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 22:11:38 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-2b558e8f-149b-4612-85e8-802b1a1f385a tempest-ProjectReaderTests-1676955223 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.929s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:11:38 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-ba64b6ae-166d-48f7-95db-3bd0cbc95452 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Deleted volume successfully. Sep 17 22:11:38 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-3c066446-f41e-41e0-9dcb-32e2de36551d tempest-VolumeDependencyTests-1793337236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 4.915s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:11:38 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-3c066446-f41e-41e0-9dcb-32e2de36551d tempest-VolumeDependencyTests-1793337236 None] Acquiring lock "cinder-quobyte-cf711ded-39fa-4af0-be22-b89e14cfbc4a-c587dbcf-9e7d-43db-a9ce-738bbb31d59b" by "_create_volume_from_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:11:38 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-e33acd04-f8a3-4cd1-8a50-a8572fe29dce tempest-CreateVolumesFromSnapshotTest-1444870577 None] Acquiring lock "cinder-quobyte-d9010853-de9b-4b58-83a9-2b64ec8c8130" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:11:38 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-2b558e8f-149b-4612-85e8-802b1a1f385a tempest-ProjectReaderTests-1676955223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e8f97f6-1f95-4851-b060-626ef66f20f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74f1819f-1676-43ba-91bf-1656df943b55', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:38 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-2b558e8f-149b-4612-85e8-802b1a1f385a tempest-ProjectReaderTests-1676955223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f3a7281-a768-46b5-9289-4039cfd8b785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:38 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-3c066446-f41e-41e0-9dcb-32e2de36551d tempest-VolumeDependencyTests-1793337236 None] Lock "cinder-quobyte-cf711ded-39fa-4af0-be22-b89e14cfbc4a-c587dbcf-9e7d-43db-a9ce-738bbb31d59b" acquired by "_create_volume_from_snapshot" :: waited 0.064s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:11:38 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-3c066446-f41e-41e0-9dcb-32e2de36551d tempest-VolumeDependencyTests-1793337236 None] Creating volume c587dbcf-9e7d-43db-a9ce-738bbb31d59b from snapshot cf711ded-39fa-4af0-be22-b89e14cfbc4a {{(pid=85458) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 17 22:11:38 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-3c066446-f41e-41e0-9dcb-32e2de36551d tempest-VolumeDependencyTests-1793337236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:11:38 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-3c066446-f41e-41e0-9dcb-32e2de36551d tempest-VolumeDependencyTests-1793337236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:11:38 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-3c066446-f41e-41e0-9dcb-32e2de36551d tempest-VolumeDependencyTests-1793337236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:11:38 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-3c066446-f41e-41e0-9dcb-32e2de36551d tempest-VolumeDependencyTests-1793337236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:11:38 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-3c066446-f41e-41e0-9dcb-32e2de36551d tempest-VolumeDependencyTests-1793337236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:11:38 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-3c066446-f41e-41e0-9dcb-32e2de36551d tempest-VolumeDependencyTests-1793337236 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 22:11:38 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-3c066446-f41e-41e0-9dcb-32e2de36551d tempest-VolumeDependencyTests-1793337236 None] Acquiring lock "cinder-quobyte-c587dbcf-9e7d-43db-a9ce-738bbb31d59b" by "_copy_volume_from_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:11:38 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-e33acd04-f8a3-4cd1-8a50-a8572fe29dce tempest-CreateVolumesFromSnapshotTest-1444870577 None] Lock "cinder-quobyte-d9010853-de9b-4b58-83a9-2b64ec8c8130" acquired by "delete_volume" :: waited 0.073s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:11:38 devstack sudo[104958]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:38 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-2b558e8f-149b-4612-85e8-802b1a1f385a tempest-ProjectReaderTests-1676955223 None] Volume volume-74f1819f-1676-43ba-91bf-1656df943b55 (74f1819f-1676-43ba-91bf-1656df943b55): created successfully Sep 17 22:11:38 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-2b558e8f-149b-4612-85e8-802b1a1f385a tempest-ProjectReaderTests-1676955223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f3a7281-a768-46b5-9289-4039cfd8b785) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:38 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-2b558e8f-149b-4612-85e8-802b1a1f385a tempest-ProjectReaderTests-1676955223 None] Flow 'volume_create_manager' (bfef9281-e7c6-4b19-9c50-05bea5fc0ee4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:11:38 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fce811f-71f6-4e87-b9e9-691d96b33342]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:11:38 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e33acd04-f8a3-4cd1-8a50-a8572fe29dce tempest-CreateVolumesFromSnapshotTest-1444870577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-d9010853-de9b-4b58-83a9-2b64ec8c8130 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:38 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-ba64b6ae-166d-48f7-95db-3bd0cbc95452 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Lock "cinder-37a6008a-c0c6-4bfd-bb0f-eb3a0c64d4a5-delete_volume" released by "delete_volume" :: held 1.505s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:11:38 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-c254a3c2-08fd-4328-ac87-acf74ded1b33 tempest-ProjectMemberTests-1966135882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-67b2590f-6b10-4780-a42c-e4c537b68286.b4733ed5-7e35-4743-9c2a-77234109a921" returned: 0 in 0.556s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:38 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-c254a3c2-08fd-4328-ac87-acf74ded1b33 tempest-ProjectMemberTests-1966135882 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-67b2590f-6b10-4780-a42c-e4c537b68286(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85458) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 22:11:38 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-3c066446-f41e-41e0-9dcb-32e2de36551d tempest-VolumeDependencyTests-1793337236 None] Lock "cinder-quobyte-c587dbcf-9e7d-43db-a9ce-738bbb31d59b" acquired by "_copy_volume_from_snapshot" :: waited 0.085s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:11:38 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-3c066446-f41e-41e0-9dcb-32e2de36551d tempest-VolumeDependencyTests-1793337236 None] snapshot: cf711ded-39fa-4af0-be22-b89e14cfbc4a, volume: c587dbcf-9e7d-43db-a9ce-738bbb31d59b, {{(pid=85458) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 17 22:11:38 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-2b558e8f-149b-4612-85e8-802b1a1f385a tempest-ProjectReaderTests-1676955223 None] Created volume successfully. Sep 17 22:11:38 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8056dc4-1e4e-4c11-8e47-101965a40436]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:11:38 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-c254a3c2-08fd-4328-ac87-acf74ded1b33 tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-67b2590f-6b10-4780-a42c-e4c537b68286 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:38 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-3c066446-f41e-41e0-9dcb-32e2de36551d tempest-VolumeDependencyTests-1793337236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:11:38 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-3c066446-f41e-41e0-9dcb-32e2de36551d tempest-VolumeDependencyTests-1793337236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:11:38 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-3c066446-f41e-41e0-9dcb-32e2de36551d tempest-VolumeDependencyTests-1793337236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:11:38 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-3c066446-f41e-41e0-9dcb-32e2de36551d tempest-VolumeDependencyTests-1793337236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:11:38 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-3c066446-f41e-41e0-9dcb-32e2de36551d tempest-VolumeDependencyTests-1793337236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:11:38 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[8558e9d3-c7cd-4733-8f82-1855dade202e]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:11:38 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-3c066446-f41e-41e0-9dcb-32e2de36551d tempest-VolumeDependencyTests-1793337236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb27067a-148e-4e64-8962-3ac16bc80cf8.cf711ded-39fa-4af0-be22-b89e14cfbc4a {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:38 devstack sudo[104969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-d9010853-de9b-4b58-83a9-2b64ec8c8130 Sep 17 22:11:38 devstack sudo[104969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:38 devstack sudo[104970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-67b2590f-6b10-4780-a42c-e4c537b68286 Sep 17 22:11:38 devstack sudo[104970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:38 devstack sudo[104972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb27067a-148e-4e64-8962-3ac16bc80cf8.cf711ded-39fa-4af0-be22-b89e14cfbc4a Sep 17 22:11:38 devstack sudo[104972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:38 devstack sudo[104969]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:38 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e33acd04-f8a3-4cd1-8a50-a8572fe29dce tempest-CreateVolumesFromSnapshotTest-1444870577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-d9010853-de9b-4b58-83a9-2b64ec8c8130" returned: 0 in 0.387s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:38 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e33acd04-f8a3-4cd1-8a50-a8572fe29dce tempest-CreateVolumesFromSnapshotTest-1444870577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-d9010853-de9b-4b58-83a9-2b64ec8c8130 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:38 devstack sudo[104980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-d9010853-de9b-4b58-83a9-2b64ec8c8130 Sep 17 22:11:38 devstack sudo[104980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:38 devstack sudo[104970]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:38 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-c254a3c2-08fd-4328-ac87-acf74ded1b33 tempest-ProjectMemberTests-1966135882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-67b2590f-6b10-4780-a42c-e4c537b68286" returned: 0 in 0.427s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:38 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-c254a3c2-08fd-4328-ac87-acf74ded1b33 tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-67b2590f-6b10-4780-a42c-e4c537b68286.b4733ed5-7e35-4743-9c2a-77234109a921 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:39 devstack sudo[104972]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:39 devstack sudo[104986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-67b2590f-6b10-4780-a42c-e4c537b68286.b4733ed5-7e35-4743-9c2a-77234109a921 Sep 17 22:11:39 devstack sudo[104986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:39 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-3c066446-f41e-41e0-9dcb-32e2de36551d tempest-VolumeDependencyTests-1793337236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb27067a-148e-4e64-8962-3ac16bc80cf8.cf711ded-39fa-4af0-be22-b89e14cfbc4a" returned: 0 in 0.389s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:39 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-3c066446-f41e-41e0-9dcb-32e2de36551d tempest-VolumeDependencyTests-1793337236 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb27067a-148e-4e64-8962-3ac16bc80cf8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85458) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 22:11:39 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4c529a7-5c11-4177-b3f2-00d5a5a9d77e]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:11:39 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-3c066446-f41e-41e0-9dcb-32e2de36551d tempest-VolumeDependencyTests-1793337236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb27067a-148e-4e64-8962-3ac16bc80cf8 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:39 devstack sudo[104988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb27067a-148e-4e64-8962-3ac16bc80cf8 Sep 17 22:11:39 devstack sudo[104988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:39 devstack sudo[104980]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:39 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e33acd04-f8a3-4cd1-8a50-a8572fe29dce tempest-CreateVolumesFromSnapshotTest-1444870577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-d9010853-de9b-4b58-83a9-2b64ec8c8130" returned: 0 in 0.289s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:39 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-e33acd04-f8a3-4cd1-8a50-a8572fe29dce tempest-CreateVolumesFromSnapshotTest-1444870577 None] Lock "cinder-quobyte-d9010853-de9b-4b58-83a9-2b64ec8c8130" released by "delete_volume" :: held 0.736s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:11:39 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-e33acd04-f8a3-4cd1-8a50-a8572fe29dce tempest-CreateVolumesFromSnapshotTest-1444870577 None] Created reservations ['d6ef5d3a-7e71-44d6-a815-2b06cb92da71', '3caaeefc-a428-43b6-b9c7-f746824c365b', 'dc638535-2a9e-40c7-9572-66bbcb8ae644', 'b6a7ad06-5d54-4c64-96d0-6b754ff39ce1'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:11:39 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e33acd04-f8a3-4cd1-8a50-a8572fe29dce tempest-CreateVolumesFromSnapshotTest-1444870577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:11:39 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e33acd04-f8a3-4cd1-8a50-a8572fe29dce tempest-CreateVolumesFromSnapshotTest-1444870577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:11:39 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-e33acd04-f8a3-4cd1-8a50-a8572fe29dce tempest-CreateVolumesFromSnapshotTest-1444870577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:11:39 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-e33acd04-f8a3-4cd1-8a50-a8572fe29dce tempest-CreateVolumesFromSnapshotTest-1444870577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:11:39 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e33acd04-f8a3-4cd1-8a50-a8572fe29dce tempest-CreateVolumesFromSnapshotTest-1444870577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:11:39 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e33acd04-f8a3-4cd1-8a50-a8572fe29dce tempest-CreateVolumesFromSnapshotTest-1444870577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:39 devstack sudo[104994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:11:39 devstack sudo[104994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:39 devstack sudo[104986]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:39 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-c254a3c2-08fd-4328-ac87-acf74ded1b33 tempest-ProjectMemberTests-1966135882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-67b2590f-6b10-4780-a42c-e4c537b68286.b4733ed5-7e35-4743-9c2a-77234109a921" returned: 0 in 0.406s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:39 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-c254a3c2-08fd-4328-ac87-acf74ded1b33 tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-67b2590f-6b10-4780-a42c-e4c537b68286.b4733ed5-7e35-4743-9c2a-77234109a921 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:39 devstack sudo[104999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-67b2590f-6b10-4780-a42c-e4c537b68286.b4733ed5-7e35-4743-9c2a-77234109a921 Sep 17 22:11:39 devstack sudo[104999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:39 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-08fc3fb1-4954-4fa8-8b8d-0d3969031ded tempest-CreateVolumesFromSnapshotTest-1444870577 None] Acquiring lock "cinder-449d06b1-6efd-4c73-910f-134797feab9d-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:11:39 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-08fc3fb1-4954-4fa8-8b8d-0d3969031ded tempest-CreateVolumesFromSnapshotTest-1444870577 None] Lock "cinder-449d06b1-6efd-4c73-910f-134797feab9d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:11:39 devstack sudo[104988]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:39 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-3c066446-f41e-41e0-9dcb-32e2de36551d tempest-VolumeDependencyTests-1793337236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb27067a-148e-4e64-8962-3ac16bc80cf8" returned: 0 in 0.432s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:39 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-3c066446-f41e-41e0-9dcb-32e2de36551d tempest-VolumeDependencyTests-1793337236 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb27067a-148e-4e64-8962-3ac16bc80cf8 {{(pid=85458) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 17 22:11:39 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-3c066446-f41e-41e0-9dcb-32e2de36551d tempest-VolumeDependencyTests-1793337236 None] Creating direct copy from snapshot {{(pid=85458) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 17 22:11:39 devstack cinder-volume[85458]: DEBUG cinder.utils [None req-3c066446-f41e-41e0-9dcb-32e2de36551d tempest-VolumeDependencyTests-1793337236 None] Path /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c587dbcf-9e7d-43db-a9ce-738bbb31d59b not found in is_blk_device check {{(pid=85458) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 17 22:11:39 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-3c066446-f41e-41e0-9dcb-32e2de36551d tempest-VolumeDependencyTests-1793337236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb27067a-148e-4e64-8962-3ac16bc80cf8 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c587dbcf-9e7d-43db-a9ce-738bbb31d59b {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:39 devstack sudo[105001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb27067a-148e-4e64-8962-3ac16bc80cf8 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c587dbcf-9e7d-43db-a9ce-738bbb31d59b Sep 17 22:11:39 devstack sudo[105001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:39 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-08fc3fb1-4954-4fa8-8b8d-0d3969031ded tempest-CreateVolumesFromSnapshotTest-1444870577 None] Acquiring lock "cinder-quobyte-449d06b1-6efd-4c73-910f-134797feab9d" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:11:39 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-08fc3fb1-4954-4fa8-8b8d-0d3969031ded tempest-CreateVolumesFromSnapshotTest-1444870577 None] Lock "cinder-quobyte-449d06b1-6efd-4c73-910f-134797feab9d" acquired by "delete_volume" :: waited 0.037s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:11:39 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[128d1086-3826-4443-9533-479dc00b862e]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:11:39 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-08fc3fb1-4954-4fa8-8b8d-0d3969031ded tempest-CreateVolumesFromSnapshotTest-1444870577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-449d06b1-6efd-4c73-910f-134797feab9d {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:39 devstack sudo[104994]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:39 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e33acd04-f8a3-4cd1-8a50-a8572fe29dce tempest-CreateVolumesFromSnapshotTest-1444870577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.391s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:39 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-e33acd04-f8a3-4cd1-8a50-a8572fe29dce tempest-CreateVolumesFromSnapshotTest-1444870577 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:11:39 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-e33acd04-f8a3-4cd1-8a50-a8572fe29dce tempest-CreateVolumesFromSnapshotTest-1444870577 None] Deleted volume successfully. Sep 17 22:11:39 devstack sudo[104999]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:39 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-c254a3c2-08fd-4328-ac87-acf74ded1b33 tempest-ProjectMemberTests-1966135882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-67b2590f-6b10-4780-a42c-e4c537b68286.b4733ed5-7e35-4743-9c2a-77234109a921" returned: 0 in 0.396s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:39 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-e33acd04-f8a3-4cd1-8a50-a8572fe29dce tempest-CreateVolumesFromSnapshotTest-1444870577 None] Lock "cinder-d9010853-de9b-4b58-83a9-2b64ec8c8130-delete_volume" released by "delete_volume" :: held 1.466s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:11:39 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-c254a3c2-08fd-4328-ac87-acf74ded1b33 tempest-ProjectMemberTests-1966135882 None] Lock "cinder-quobyte-b4733ed5-7e35-4743-9c2a-77234109a921" released by "_delete_snapshot" :: held 1.925s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:11:39 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-c254a3c2-08fd-4328-ac87-acf74ded1b33 tempest-ProjectMemberTests-1966135882 None] Lock "cinder-quobyte-67b2590f-6b10-4780-a42c-e4c537b68286" released by "delete_snapshot" :: held 1.953s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:11:39 devstack sudo[105005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-449d06b1-6efd-4c73-910f-134797feab9d Sep 17 22:11:39 devstack sudo[105005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:39 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-c254a3c2-08fd-4328-ac87-acf74ded1b33 tempest-ProjectMemberTests-1966135882 None] Created reservations ['ca25fae3-b7a0-4d33-8254-e1dd41c14882', '4c1222d6-5d9f-4947-b14a-24b551bce0c6', '512f5750-38dc-4694-9324-345b7773c1eb', 'e2cf812e-cced-419b-bdba-8b1d73812fd2'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:11:40 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-68d3bb2a-af9b-4550-aac1-1b2bae5fbe10 tempest-ProjectReaderTests-1676955223 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:11:40 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-c254a3c2-08fd-4328-ac87-acf74ded1b33 tempest-ProjectMemberTests-1966135882 None] Delete snapshot completed successfully. Sep 17 22:11:40 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-c254a3c2-08fd-4328-ac87-acf74ded1b33 tempest-ProjectMemberTests-1966135882 None] Lock "cinder-b4733ed5-7e35-4743-9c2a-77234109a921-delete_snapshot" released by "delete_snapshot" :: held 2.178s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:11:40 devstack sudo[105005]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:40 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-08fc3fb1-4954-4fa8-8b8d-0d3969031ded tempest-CreateVolumesFromSnapshotTest-1444870577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-449d06b1-6efd-4c73-910f-134797feab9d" returned: 0 in 0.492s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:40 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-08fc3fb1-4954-4fa8-8b8d-0d3969031ded tempest-CreateVolumesFromSnapshotTest-1444870577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-449d06b1-6efd-4c73-910f-134797feab9d {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:40 devstack sudo[105022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-449d06b1-6efd-4c73-910f-134797feab9d Sep 17 22:11:40 devstack sudo[105022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:40 devstack sudo[105022]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:40 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-08fc3fb1-4954-4fa8-8b8d-0d3969031ded tempest-CreateVolumesFromSnapshotTest-1444870577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-449d06b1-6efd-4c73-910f-134797feab9d" returned: 0 in 0.309s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:40 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-08fc3fb1-4954-4fa8-8b8d-0d3969031ded tempest-CreateVolumesFromSnapshotTest-1444870577 None] Lock "cinder-quobyte-449d06b1-6efd-4c73-910f-134797feab9d" released by "delete_volume" :: held 0.890s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:11:40 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-08fc3fb1-4954-4fa8-8b8d-0d3969031ded tempest-CreateVolumesFromSnapshotTest-1444870577 None] Created reservations ['7e5f28c6-15fc-4241-bd32-d26a6a47edce', 'ac3c8bbb-1393-4ac2-a9ad-8fa48a181854', 'de979862-735c-4961-8d29-31581dac1779', '2077eb09-b81e-47d0-b9c7-6e8f4b76bb91'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:11:40 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-08fc3fb1-4954-4fa8-8b8d-0d3969031ded tempest-CreateVolumesFromSnapshotTest-1444870577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:11:40 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-08fc3fb1-4954-4fa8-8b8d-0d3969031ded tempest-CreateVolumesFromSnapshotTest-1444870577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:11:40 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-08fc3fb1-4954-4fa8-8b8d-0d3969031ded tempest-CreateVolumesFromSnapshotTest-1444870577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:11:40 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-08fc3fb1-4954-4fa8-8b8d-0d3969031ded tempest-CreateVolumesFromSnapshotTest-1444870577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:11:40 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-08fc3fb1-4954-4fa8-8b8d-0d3969031ded tempest-CreateVolumesFromSnapshotTest-1444870577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:11:40 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-08fc3fb1-4954-4fa8-8b8d-0d3969031ded tempest-CreateVolumesFromSnapshotTest-1444870577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:40 devstack sudo[105026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:11:40 devstack sudo[105026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:41 devstack sudo[105026]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:41 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-08fc3fb1-4954-4fa8-8b8d-0d3969031ded tempest-CreateVolumesFromSnapshotTest-1444870577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.375s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:41 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-08fc3fb1-4954-4fa8-8b8d-0d3969031ded tempest-CreateVolumesFromSnapshotTest-1444870577 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:11:41 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-08fc3fb1-4954-4fa8-8b8d-0d3969031ded tempest-CreateVolumesFromSnapshotTest-1444870577 None] Deleted volume successfully. Sep 17 22:11:41 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-08fc3fb1-4954-4fa8-8b8d-0d3969031ded tempest-CreateVolumesFromSnapshotTest-1444870577 None] Lock "cinder-449d06b1-6efd-4c73-910f-134797feab9d-delete_volume" released by "delete_volume" :: held 1.743s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:11:41 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-87c086bf-f6c8-46c0-8e42-3c63532eb51e tempest-ProjectMemberTests-1966135882 None] Acquiring lock "cinder-67b2590f-6b10-4780-a42c-e4c537b68286-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:11:41 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-87c086bf-f6c8-46c0-8e42-3c63532eb51e tempest-ProjectMemberTests-1966135882 None] Lock "cinder-67b2590f-6b10-4780-a42c-e4c537b68286-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:11:41 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-87c086bf-f6c8-46c0-8e42-3c63532eb51e tempest-ProjectMemberTests-1966135882 None] Acquiring lock "cinder-quobyte-67b2590f-6b10-4780-a42c-e4c537b68286" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:11:41 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-87c086bf-f6c8-46c0-8e42-3c63532eb51e tempest-ProjectMemberTests-1966135882 None] Lock "cinder-quobyte-67b2590f-6b10-4780-a42c-e4c537b68286" acquired by "delete_volume" :: waited 0.025s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:11:41 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[905fd56b-93ef-4345-8438-889aad953abf]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:11:41 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-87c086bf-f6c8-46c0-8e42-3c63532eb51e tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-67b2590f-6b10-4780-a42c-e4c537b68286 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:41 devstack sudo[105029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-67b2590f-6b10-4780-a42c-e4c537b68286 Sep 17 22:11:41 devstack sudo[105029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:41 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-69c98a70-cda7-4c52-87cc-198a06cf0347 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Acquiring lock "cinder-7ae18736-0263-4b13-893d-34ff1a9cc7f9-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:11:41 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-69c98a70-cda7-4c52-87cc-198a06cf0347 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Lock "cinder-7ae18736-0263-4b13-893d-34ff1a9cc7f9-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:11:41 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-69c98a70-cda7-4c52-87cc-198a06cf0347 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Acquiring lock "cinder-quobyte-7ae18736-0263-4b13-893d-34ff1a9cc7f9" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:11:41 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-69c98a70-cda7-4c52-87cc-198a06cf0347 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Lock "cinder-quobyte-7ae18736-0263-4b13-893d-34ff1a9cc7f9" acquired by "delete_volume" :: waited 0.021s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:11:42 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4a4f100-133b-4fdd-bc4a-88825d52fd26]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:11:42 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-69c98a70-cda7-4c52-87cc-198a06cf0347 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7ae18736-0263-4b13-893d-34ff1a9cc7f9 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:42 devstack sudo[105029]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:42 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-87c086bf-f6c8-46c0-8e42-3c63532eb51e tempest-ProjectMemberTests-1966135882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-67b2590f-6b10-4780-a42c-e4c537b68286" returned: 0 in 0.629s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:42 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-87c086bf-f6c8-46c0-8e42-3c63532eb51e tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-67b2590f-6b10-4780-a42c-e4c537b68286 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:42 devstack sudo[105036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-67b2590f-6b10-4780-a42c-e4c537b68286 Sep 17 22:11:42 devstack sudo[105036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:42 devstack sudo[105035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7ae18736-0263-4b13-893d-34ff1a9cc7f9 Sep 17 22:11:42 devstack sudo[105035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:42 devstack sudo[105036]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:42 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-87c086bf-f6c8-46c0-8e42-3c63532eb51e tempest-ProjectMemberTests-1966135882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-67b2590f-6b10-4780-a42c-e4c537b68286" returned: 0 in 0.485s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:42 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-87c086bf-f6c8-46c0-8e42-3c63532eb51e tempest-ProjectMemberTests-1966135882 None] Lock "cinder-quobyte-67b2590f-6b10-4780-a42c-e4c537b68286" released by "delete_volume" :: held 1.238s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:11:42 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-87c086bf-f6c8-46c0-8e42-3c63532eb51e tempest-ProjectMemberTests-1966135882 None] Created reservations ['5eacf573-102e-4674-a1db-5feb16c13356', '6cc19f1c-dc47-45eb-8484-977704eddec9', 'ce1df6ea-a9b0-47e1-8a2a-b34e8f2d0bc6', 'acb94811-989b-4308-bea8-18e7ba27f0a9'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:11:42 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-87c086bf-f6c8-46c0-8e42-3c63532eb51e tempest-ProjectMemberTests-1966135882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:11:42 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-87c086bf-f6c8-46c0-8e42-3c63532eb51e tempest-ProjectMemberTests-1966135882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:11:42 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-87c086bf-f6c8-46c0-8e42-3c63532eb51e tempest-ProjectMemberTests-1966135882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:11:42 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-87c086bf-f6c8-46c0-8e42-3c63532eb51e tempest-ProjectMemberTests-1966135882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:11:42 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-87c086bf-f6c8-46c0-8e42-3c63532eb51e tempest-ProjectMemberTests-1966135882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:11:42 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-87c086bf-f6c8-46c0-8e42-3c63532eb51e tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:42 devstack sudo[105043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:11:42 devstack sudo[105043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:42 devstack sudo[105035]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:42 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-69c98a70-cda7-4c52-87cc-198a06cf0347 tempest-CreateVolumesFromSnapshotTest-1444870577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7ae18736-0263-4b13-893d-34ff1a9cc7f9" returned: 0 in 0.899s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:42 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-69c98a70-cda7-4c52-87cc-198a06cf0347 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7ae18736-0263-4b13-893d-34ff1a9cc7f9 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:43 devstack sudo[105045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7ae18736-0263-4b13-893d-34ff1a9cc7f9 Sep 17 22:11:43 devstack sudo[105045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:43 devstack sudo[105043]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:43 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-87c086bf-f6c8-46c0-8e42-3c63532eb51e tempest-ProjectMemberTests-1966135882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.403s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:43 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-87c086bf-f6c8-46c0-8e42-3c63532eb51e tempest-ProjectMemberTests-1966135882 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:11:43 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-87c086bf-f6c8-46c0-8e42-3c63532eb51e tempest-ProjectMemberTests-1966135882 None] Deleted volume successfully. Sep 17 22:11:43 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-87c086bf-f6c8-46c0-8e42-3c63532eb51e tempest-ProjectMemberTests-1966135882 None] Lock "cinder-67b2590f-6b10-4780-a42c-e4c537b68286-delete_volume" released by "delete_volume" :: held 1.977s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:11:43 devstack sudo[105045]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:43 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-69c98a70-cda7-4c52-87cc-198a06cf0347 tempest-CreateVolumesFromSnapshotTest-1444870577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7ae18736-0263-4b13-893d-34ff1a9cc7f9" returned: 0 in 0.491s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:43 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-69c98a70-cda7-4c52-87cc-198a06cf0347 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Lock "cinder-quobyte-7ae18736-0263-4b13-893d-34ff1a9cc7f9" released by "delete_volume" :: held 1.472s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:11:43 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-69c98a70-cda7-4c52-87cc-198a06cf0347 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Created reservations ['d95018e9-1dff-45a0-92ba-0d1aa1606eb1', '322ff097-8533-4bc3-819a-071e47eaca85', '14e604c5-fd5e-4a18-b5d2-912e92a9348a', 'f6016b55-0504-4b7e-b579-791ec34226a6'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:11:43 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-69c98a70-cda7-4c52-87cc-198a06cf0347 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:11:43 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-69c98a70-cda7-4c52-87cc-198a06cf0347 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:11:43 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-69c98a70-cda7-4c52-87cc-198a06cf0347 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:11:43 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-69c98a70-cda7-4c52-87cc-198a06cf0347 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:11:43 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-69c98a70-cda7-4c52-87cc-198a06cf0347 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:11:43 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-69c98a70-cda7-4c52-87cc-198a06cf0347 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:43 devstack sudo[105050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:11:43 devstack sudo[105050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:44 devstack sudo[105050]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:44 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-69c98a70-cda7-4c52-87cc-198a06cf0347 tempest-CreateVolumesFromSnapshotTest-1444870577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.462s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:44 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-69c98a70-cda7-4c52-87cc-198a06cf0347 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:11:44 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-69c98a70-cda7-4c52-87cc-198a06cf0347 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Deleted volume successfully. Sep 17 22:11:44 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-69c98a70-cda7-4c52-87cc-198a06cf0347 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Lock "cinder-7ae18736-0263-4b13-893d-34ff1a9cc7f9-delete_volume" released by "delete_volume" :: held 2.391s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:11:44 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-17cac3d0-10af-4510-b40c-d372a9061c71 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Acquiring lock "cinder-6c62fdad-4460-499f-b0c1-cc4bfa84999d-delete_snapshot" by "delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:11:44 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-17cac3d0-10af-4510-b40c-d372a9061c71 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Lock "cinder-6c62fdad-4460-499f-b0c1-cc4bfa84999d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.049s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:11:44 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-17cac3d0-10af-4510-b40c-d372a9061c71 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Acquiring lock "cinder-quobyte-9e6b5232-9223-4d7c-b5a1-fab05761fadc" by "delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:11:44 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-17cac3d0-10af-4510-b40c-d372a9061c71 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Lock "cinder-quobyte-9e6b5232-9223-4d7c-b5a1-fab05761fadc" acquired by "delete_snapshot" :: waited 0.032s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:11:44 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-17cac3d0-10af-4510-b40c-d372a9061c71 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Acquiring lock "cinder-quobyte-6c62fdad-4460-499f-b0c1-cc4bfa84999d" by "_delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:11:44 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-17cac3d0-10af-4510-b40c-d372a9061c71 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Lock "cinder-quobyte-6c62fdad-4460-499f-b0c1-cc4bfa84999d" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:11:44 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-17cac3d0-10af-4510-b40c-d372a9061c71 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Deleting offline snapshot 6c62fdad-4460-499f-b0c1-cc4bfa84999d of volume 9e6b5232-9223-4d7c-b5a1-fab05761fadc {{(pid=85458) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 22:11:44 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-17cac3d0-10af-4510-b40c-d372a9061c71 tempest-CreateVolumesFromSnapshotTest-1444870577 None] snapshot_file for this snap is: volume-9e6b5232-9223-4d7c-b5a1-fab05761fadc.6c62fdad-4460-499f-b0c1-cc4bfa84999d {{(pid=85458) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 22:11:44 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[62d128a0-cb18-47b3-9fee-d2553af40274]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:11:44 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-17cac3d0-10af-4510-b40c-d372a9061c71 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-9e6b5232-9223-4d7c-b5a1-fab05761fadc.6c62fdad-4460-499f-b0c1-cc4bfa84999d {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:44 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2c76b9c-89a2-4cbb-ad17-aad9c2657644 tempest-ProjectMemberTests-1966135882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 22:11:44 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b2c76b9c-89a2-4cbb-ad17-aad9c2657644 tempest-ProjectMemberTests-1966135882 None] Flow 'volume_create_manager' (a2ecffa8-21d2-4e8b-a7be-dd2d65b0d67c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:11:44 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b2c76b9c-89a2-4cbb-ad17-aad9c2657644 tempest-ProjectMemberTests-1966135882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96e961f8-330f-4e2b-9042-25e6b2d1ee41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:44 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b2c76b9c-89a2-4cbb-ad17-aad9c2657644 tempest-ProjectMemberTests-1966135882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96e961f8-330f-4e2b-9042-25e6b2d1ee41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:11:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-484143699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb1fd62b-dd46-451b-9590-cfcf0c5b9878,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f277f501a340474ca5d0daea12e88955',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:11:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:11:45Z,use_quota=True,user_id='e584775bfb3c440aa7aac369d15efa55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:44 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b2c76b9c-89a2-4cbb-ad17-aad9c2657644 tempest-ProjectMemberTests-1966135882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcc55023-c3d1-4d59-b3fa-6b43e1d49460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:44 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b2c76b9c-89a2-4cbb-ad17-aad9c2657644 tempest-ProjectMemberTests-1966135882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcc55023-c3d1-4d59-b3fa-6b43e1d49460) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:44 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b2c76b9c-89a2-4cbb-ad17-aad9c2657644 tempest-ProjectMemberTests-1966135882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdc60c34-8b8d-40b9-871e-349f2abea272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:44 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b2c76b9c-89a2-4cbb-ad17-aad9c2657644 tempest-ProjectMemberTests-1966135882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdc60c34-8b8d-40b9-871e-349f2abea272) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb1fd62b-dd46-451b-9590-cfcf0c5b9878', 'volume_name': 'volume-cb1fd62b-dd46-451b-9590-cfcf0c5b9878', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:44 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b2c76b9c-89a2-4cbb-ad17-aad9c2657644 tempest-ProjectMemberTests-1966135882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5561ee46-dab7-4289-8268-12ca59a0906f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:44 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b2c76b9c-89a2-4cbb-ad17-aad9c2657644 tempest-ProjectMemberTests-1966135882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5561ee46-dab7-4289-8268-12ca59a0906f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:44 devstack sudo[105053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-9e6b5232-9223-4d7c-b5a1-fab05761fadc.6c62fdad-4460-499f-b0c1-cc4bfa84999d Sep 17 22:11:44 devstack sudo[105053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:44 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b2c76b9c-89a2-4cbb-ad17-aad9c2657644 tempest-ProjectMemberTests-1966135882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (822577fd-8c2e-4306-9170-b85f6260646c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:44 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-b2c76b9c-89a2-4cbb-ad17-aad9c2657644 tempest-ProjectMemberTests-1966135882 None] Volume cb1fd62b-dd46-451b-9590-cfcf0c5b9878: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb1fd62b-dd46-451b-9590-cfcf0c5b9878', 'volume_size': 1} Sep 17 22:11:44 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-b2c76b9c-89a2-4cbb-ad17-aad9c2657644 tempest-ProjectMemberTests-1966135882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:11:45 devstack sudo[105053]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:45 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-17cac3d0-10af-4510-b40c-d372a9061c71 tempest-CreateVolumesFromSnapshotTest-1444870577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-9e6b5232-9223-4d7c-b5a1-fab05761fadc.6c62fdad-4460-499f-b0c1-cc4bfa84999d" returned: 0 in 0.567s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:45 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-17cac3d0-10af-4510-b40c-d372a9061c71 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e6b5232-9223-4d7c-b5a1-fab05761fadc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85458) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 22:11:45 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[54a8fabd-2639-42dd-b3fb-99705d0477e1]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:11:45 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-17cac3d0-10af-4510-b40c-d372a9061c71 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-9e6b5232-9223-4d7c-b5a1-fab05761fadc {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:45 devstack sudo[105058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-9e6b5232-9223-4d7c-b5a1-fab05761fadc Sep 17 22:11:45 devstack sudo[105058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:45 devstack sudo[105058]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:45 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-17cac3d0-10af-4510-b40c-d372a9061c71 tempest-CreateVolumesFromSnapshotTest-1444870577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-9e6b5232-9223-4d7c-b5a1-fab05761fadc" returned: 0 in 0.524s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:45 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-17cac3d0-10af-4510-b40c-d372a9061c71 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-9e6b5232-9223-4d7c-b5a1-fab05761fadc.6c62fdad-4460-499f-b0c1-cc4bfa84999d {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:45 devstack sudo[105064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-9e6b5232-9223-4d7c-b5a1-fab05761fadc.6c62fdad-4460-499f-b0c1-cc4bfa84999d Sep 17 22:11:45 devstack sudo[105064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:46 devstack sudo[105064]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:46 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-17cac3d0-10af-4510-b40c-d372a9061c71 tempest-CreateVolumesFromSnapshotTest-1444870577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-9e6b5232-9223-4d7c-b5a1-fab05761fadc.6c62fdad-4460-499f-b0c1-cc4bfa84999d" returned: 0 in 0.548s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:46 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-17cac3d0-10af-4510-b40c-d372a9061c71 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-9e6b5232-9223-4d7c-b5a1-fab05761fadc.6c62fdad-4460-499f-b0c1-cc4bfa84999d {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:46 devstack sudo[105069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-9e6b5232-9223-4d7c-b5a1-fab05761fadc.6c62fdad-4460-499f-b0c1-cc4bfa84999d Sep 17 22:11:46 devstack sudo[105069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:46 devstack sudo[105069]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:46 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-17cac3d0-10af-4510-b40c-d372a9061c71 tempest-CreateVolumesFromSnapshotTest-1444870577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-9e6b5232-9223-4d7c-b5a1-fab05761fadc.6c62fdad-4460-499f-b0c1-cc4bfa84999d" returned: 0 in 0.373s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:46 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-17cac3d0-10af-4510-b40c-d372a9061c71 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Lock "cinder-quobyte-6c62fdad-4460-499f-b0c1-cc4bfa84999d" released by "_delete_snapshot" :: held 2.284s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:11:46 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-17cac3d0-10af-4510-b40c-d372a9061c71 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Lock "cinder-quobyte-9e6b5232-9223-4d7c-b5a1-fab05761fadc" released by "delete_snapshot" :: held 2.324s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:11:46 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-17cac3d0-10af-4510-b40c-d372a9061c71 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Created reservations ['749e5642-e373-4e44-ba4b-40dc8eb00c7b', 'dafb182c-1f55-4754-9e90-6829da5f6aac', '8bcd6fef-9ca3-4128-92b5-9c4c7cf11f3b', 'f022615d-7ca2-43d5-b3c0-e66f5eecdcd6'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:11:46 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-17cac3d0-10af-4510-b40c-d372a9061c71 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Delete snapshot completed successfully. Sep 17 22:11:46 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-17cac3d0-10af-4510-b40c-d372a9061c71 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Lock "cinder-6c62fdad-4460-499f-b0c1-cc4bfa84999d-delete_snapshot" released by "delete_snapshot" :: held 2.542s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:11:47 devstack sudo[105001]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:47 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-3c066446-f41e-41e0-9dcb-32e2de36551d tempest-VolumeDependencyTests-1793337236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb27067a-148e-4e64-8962-3ac16bc80cf8 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c587dbcf-9e7d-43db-a9ce-738bbb31d59b" returned: 0 in 7.785s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:47 devstack cinder-volume[85458]: DEBUG cinder.image.image_utils [None req-3c066446-f41e-41e0-9dcb-32e2de36551d tempest-VolumeDependencyTests-1793337236 None] Image conversion details: src /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb27067a-148e-4e64-8962-3ac16bc80cf8, size 1024.00 MB, duration 7.79 sec, destination /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c587dbcf-9e7d-43db-a9ce-738bbb31d59b {{(pid=85458) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 17 22:11:47 devstack cinder-volume[85458]: INFO cinder.image.image_utils [None req-3c066446-f41e-41e0-9dcb-32e2de36551d tempest-VolumeDependencyTests-1793337236 None] Converted 1024.00 MB image at 131.49 MB/s Sep 17 22:11:47 devstack cinder-volume[85458]: WARNING cinder.volume.drivers.remotefs [None req-3c066446-f41e-41e0-9dcb-32e2de36551d tempest-VolumeDependencyTests-1793337236 None] /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c587dbcf-9e7d-43db-a9ce-738bbb31d59b is being set with open permissions: ugo+rw Sep 17 22:11:47 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-3c066446-f41e-41e0-9dcb-32e2de36551d tempest-VolumeDependencyTests-1793337236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c587dbcf-9e7d-43db-a9ce-738bbb31d59b {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:47 devstack sudo[105072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c587dbcf-9e7d-43db-a9ce-738bbb31d59b Sep 17 22:11:47 devstack sudo[105072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:47 devstack sudo[105072]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:47 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-3c066446-f41e-41e0-9dcb-32e2de36551d tempest-VolumeDependencyTests-1793337236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c587dbcf-9e7d-43db-a9ce-738bbb31d59b" returned: 0 in 0.249s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:47 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-3c066446-f41e-41e0-9dcb-32e2de36551d tempest-VolumeDependencyTests-1793337236 None] Lock "cinder-quobyte-c587dbcf-9e7d-43db-a9ce-738bbb31d59b" released by "_copy_volume_from_snapshot" :: held 8.994s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:11:47 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-3c066446-f41e-41e0-9dcb-32e2de36551d tempest-VolumeDependencyTests-1793337236 None] Lock "cinder-quobyte-cf711ded-39fa-4af0-be22-b89e14cfbc4a-c587dbcf-9e7d-43db-a9ce-738bbb31d59b" released by "_create_volume_from_snapshot" :: held 9.129s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:11:47 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-3c066446-f41e-41e0-9dcb-32e2de36551d tempest-VolumeDependencyTests-1793337236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.195s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:11:47 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-68d3bb2a-af9b-4550-aac1-1b2bae5fbe10 tempest-ProjectReaderTests-1676955223 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.558s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:11:47 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-68d3bb2a-af9b-4550-aac1-1b2bae5fbe10 tempest-ProjectReaderTests-1676955223 None] Creating offline snapshot f1e6a68a-8c97-4911-9a7c-b3f2fcdcf359 of volume 74f1819f-1676-43ba-91bf-1656df943b55 {{(pid=85458) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 22:11:47 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-3c066446-f41e-41e0-9dcb-32e2de36551d tempest-VolumeDependencyTests-1793337236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0e686c6-9911-4cc2-a8a8-b63125b220b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c587dbcf-9e7d-43db-a9ce-738bbb31d59b', 'volume_size': 1, 'snapshot_id': 'cf711ded-39fa-4af0-be22-b89e14cfbc4a'}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:47 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-3c066446-f41e-41e0-9dcb-32e2de36551d tempest-VolumeDependencyTests-1793337236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40216c42-fbe8-40cf-8f75-b447305e06ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:47 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c000b7a-b26e-4028-8584-cbbd12c0bab3]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:11:47 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-68d3bb2a-af9b-4550-aac1-1b2bae5fbe10 tempest-ProjectReaderTests-1676955223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-74f1819f-1676-43ba-91bf-1656df943b55 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:47 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-24e9d72f-bf66-4d2a-aff9-0125b7f9c096 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Acquiring lock "cinder-9e6b5232-9223-4d7c-b5a1-fab05761fadc-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:11:47 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-3c066446-f41e-41e0-9dcb-32e2de36551d tempest-VolumeDependencyTests-1793337236 None] Volume volume-c587dbcf-9e7d-43db-a9ce-738bbb31d59b (c587dbcf-9e7d-43db-a9ce-738bbb31d59b): created successfully Sep 17 22:11:47 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-3c066446-f41e-41e0-9dcb-32e2de36551d tempest-VolumeDependencyTests-1793337236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40216c42-fbe8-40cf-8f75-b447305e06ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:47 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-3c066446-f41e-41e0-9dcb-32e2de36551d tempest-VolumeDependencyTests-1793337236 None] Flow 'volume_create_manager' (42ea582d-8015-4025-a1f0-66b440f32471) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:11:47 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-24e9d72f-bf66-4d2a-aff9-0125b7f9c096 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Lock "cinder-9e6b5232-9223-4d7c-b5a1-fab05761fadc-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:11:47 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-3c066446-f41e-41e0-9dcb-32e2de36551d tempest-VolumeDependencyTests-1793337236 None] Created volume successfully. Sep 17 22:11:47 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-24e9d72f-bf66-4d2a-aff9-0125b7f9c096 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Acquiring lock "cinder-quobyte-9e6b5232-9223-4d7c-b5a1-fab05761fadc" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:11:47 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-24e9d72f-bf66-4d2a-aff9-0125b7f9c096 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Lock "cinder-quobyte-9e6b5232-9223-4d7c-b5a1-fab05761fadc" acquired by "delete_volume" :: waited 0.015s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:11:47 devstack sudo[105075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-74f1819f-1676-43ba-91bf-1656df943b55 Sep 17 22:11:47 devstack sudo[105075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:47 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4c69f08-53a3-4470-a33d-40e8c594ac13]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:11:47 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-24e9d72f-bf66-4d2a-aff9-0125b7f9c096 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-9e6b5232-9223-4d7c-b5a1-fab05761fadc {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:47 devstack sudo[105077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-9e6b5232-9223-4d7c-b5a1-fab05761fadc Sep 17 22:11:47 devstack sudo[105077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:48 devstack sudo[105075]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:48 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-68d3bb2a-af9b-4550-aac1-1b2bae5fbe10 tempest-ProjectReaderTests-1676955223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-74f1819f-1676-43ba-91bf-1656df943b55" returned: 0 in 0.405s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:48 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-68d3bb2a-af9b-4550-aac1-1b2bae5fbe10 tempest-ProjectReaderTests-1676955223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-74f1819f-1676-43ba-91bf-1656df943b55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-74f1819f-1676-43ba-91bf-1656df943b55.f1e6a68a-8c97-4911-9a7c-b3f2fcdcf359 1G {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:48 devstack sudo[105082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-74f1819f-1676-43ba-91bf-1656df943b55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-74f1819f-1676-43ba-91bf-1656df943b55.f1e6a68a-8c97-4911-9a7c-b3f2fcdcf359 1G Sep 17 22:11:48 devstack sudo[105082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:48 devstack sudo[105077]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:48 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-24e9d72f-bf66-4d2a-aff9-0125b7f9c096 tempest-CreateVolumesFromSnapshotTest-1444870577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-9e6b5232-9223-4d7c-b5a1-fab05761fadc" returned: 0 in 0.378s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:48 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-24e9d72f-bf66-4d2a-aff9-0125b7f9c096 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-9e6b5232-9223-4d7c-b5a1-fab05761fadc {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:48 devstack sudo[105087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-9e6b5232-9223-4d7c-b5a1-fab05761fadc Sep 17 22:11:48 devstack sudo[105087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:48 devstack sudo[105087]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:48 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-24e9d72f-bf66-4d2a-aff9-0125b7f9c096 tempest-CreateVolumesFromSnapshotTest-1444870577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-9e6b5232-9223-4d7c-b5a1-fab05761fadc" returned: 0 in 0.263s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:48 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-24e9d72f-bf66-4d2a-aff9-0125b7f9c096 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Lock "cinder-quobyte-9e6b5232-9223-4d7c-b5a1-fab05761fadc" released by "delete_volume" :: held 0.709s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:11:48 devstack sudo[105082]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:48 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-68d3bb2a-af9b-4550-aac1-1b2bae5fbe10 tempest-ProjectReaderTests-1676955223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-74f1819f-1676-43ba-91bf-1656df943b55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-74f1819f-1676-43ba-91bf-1656df943b55.f1e6a68a-8c97-4911-9a7c-b3f2fcdcf359 1G" returned: 0 in 0.428s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:48 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-68d3bb2a-af9b-4550-aac1-1b2bae5fbe10 tempest-ProjectReaderTests-1676955223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74f1819f-1676-43ba-91bf-1656df943b55 -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-74f1819f-1676-43ba-91bf-1656df943b55.f1e6a68a-8c97-4911-9a7c-b3f2fcdcf359 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:48 devstack sudo[105095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74f1819f-1676-43ba-91bf-1656df943b55 -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-74f1819f-1676-43ba-91bf-1656df943b55.f1e6a68a-8c97-4911-9a7c-b3f2fcdcf359 Sep 17 22:11:48 devstack sudo[105095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:48 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-24e9d72f-bf66-4d2a-aff9-0125b7f9c096 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Created reservations ['2326924c-c3b3-4ed3-9081-d5eb7fc75825', '7d6ee44c-46e4-4961-b76e-2baf9ef59252', '3ac49695-9e7b-4ea1-bbab-ee7a18ad7264', 'b521f83b-1266-432d-97f0-dd08fb743aaa'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:11:48 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-f5238fb1-94fa-4161-904f-d72a1d597d35 tempest-VolumeDependencyTests-1793337236 None] Acquiring lock "cinder-cf711ded-39fa-4af0-be22-b89e14cfbc4a-delete_snapshot" by "delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:11:48 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-f5238fb1-94fa-4161-904f-d72a1d597d35 tempest-VolumeDependencyTests-1793337236 None] Lock "cinder-cf711ded-39fa-4af0-be22-b89e14cfbc4a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:11:48 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-f5238fb1-94fa-4161-904f-d72a1d597d35 tempest-VolumeDependencyTests-1793337236 None] Acquiring lock "cinder-quobyte-cb27067a-148e-4e64-8962-3ac16bc80cf8" by "delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:11:48 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-f5238fb1-94fa-4161-904f-d72a1d597d35 tempest-VolumeDependencyTests-1793337236 None] Lock "cinder-quobyte-cb27067a-148e-4e64-8962-3ac16bc80cf8" acquired by "delete_snapshot" :: waited 0.027s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:11:48 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-f5238fb1-94fa-4161-904f-d72a1d597d35 tempest-VolumeDependencyTests-1793337236 None] Acquiring lock "cinder-quobyte-cf711ded-39fa-4af0-be22-b89e14cfbc4a" by "_delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:11:48 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-24e9d72f-bf66-4d2a-aff9-0125b7f9c096 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:11:48 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-24e9d72f-bf66-4d2a-aff9-0125b7f9c096 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:11:48 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-24e9d72f-bf66-4d2a-aff9-0125b7f9c096 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:11:48 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-24e9d72f-bf66-4d2a-aff9-0125b7f9c096 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:11:48 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-24e9d72f-bf66-4d2a-aff9-0125b7f9c096 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:11:48 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-24e9d72f-bf66-4d2a-aff9-0125b7f9c096 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:48 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-f5238fb1-94fa-4161-904f-d72a1d597d35 tempest-VolumeDependencyTests-1793337236 None] Lock "cinder-quobyte-cf711ded-39fa-4af0-be22-b89e14cfbc4a" acquired by "_delete_snapshot" :: waited 0.046s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:11:48 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-f5238fb1-94fa-4161-904f-d72a1d597d35 tempest-VolumeDependencyTests-1793337236 None] Deleting offline snapshot cf711ded-39fa-4af0-be22-b89e14cfbc4a of volume cb27067a-148e-4e64-8962-3ac16bc80cf8 {{(pid=85458) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 22:11:48 devstack sudo[105097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:11:48 devstack sudo[105097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:48 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-f5238fb1-94fa-4161-904f-d72a1d597d35 tempest-VolumeDependencyTests-1793337236 None] snapshot_file for this snap is: volume-cb27067a-148e-4e64-8962-3ac16bc80cf8.cf711ded-39fa-4af0-be22-b89e14cfbc4a {{(pid=85458) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 22:11:48 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ae06d5c-cafe-4c35-8a18-d667bec5df5e]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:11:48 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-f5238fb1-94fa-4161-904f-d72a1d597d35 tempest-VolumeDependencyTests-1793337236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb27067a-148e-4e64-8962-3ac16bc80cf8.cf711ded-39fa-4af0-be22-b89e14cfbc4a {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:48 devstack sudo[105095]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:48 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-68d3bb2a-af9b-4550-aac1-1b2bae5fbe10 tempest-ProjectReaderTests-1676955223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74f1819f-1676-43ba-91bf-1656df943b55 -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-74f1819f-1676-43ba-91bf-1656df943b55.f1e6a68a-8c97-4911-9a7c-b3f2fcdcf359" returned: 0 in 0.345s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:48 devstack cinder-volume[85458]: WARNING cinder.volume.drivers.remotefs [None req-68d3bb2a-af9b-4550-aac1-1b2bae5fbe10 tempest-ProjectReaderTests-1676955223 None] /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-74f1819f-1676-43ba-91bf-1656df943b55.f1e6a68a-8c97-4911-9a7c-b3f2fcdcf359 is being set with open permissions: ugo+rw Sep 17 22:11:48 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-68d3bb2a-af9b-4550-aac1-1b2bae5fbe10 tempest-ProjectReaderTests-1676955223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-74f1819f-1676-43ba-91bf-1656df943b55.f1e6a68a-8c97-4911-9a7c-b3f2fcdcf359 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:48 devstack sudo[105103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-74f1819f-1676-43ba-91bf-1656df943b55.f1e6a68a-8c97-4911-9a7c-b3f2fcdcf359 Sep 17 22:11:48 devstack sudo[105103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:48 devstack sudo[105102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb27067a-148e-4e64-8962-3ac16bc80cf8.cf711ded-39fa-4af0-be22-b89e14cfbc4a Sep 17 22:11:48 devstack sudo[105102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:48 devstack sudo[105097]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:48 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-24e9d72f-bf66-4d2a-aff9-0125b7f9c096 tempest-CreateVolumesFromSnapshotTest-1444870577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.264s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:48 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-24e9d72f-bf66-4d2a-aff9-0125b7f9c096 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:11:48 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-24e9d72f-bf66-4d2a-aff9-0125b7f9c096 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Deleted volume successfully. Sep 17 22:11:48 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-24e9d72f-bf66-4d2a-aff9-0125b7f9c096 tempest-CreateVolumesFromSnapshotTest-1444870577 None] Lock "cinder-9e6b5232-9223-4d7c-b5a1-fab05761fadc-delete_volume" released by "delete_volume" :: held 1.260s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:11:49 devstack sudo[105103]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:49 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-68d3bb2a-af9b-4550-aac1-1b2bae5fbe10 tempest-ProjectReaderTests-1676955223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-74f1819f-1676-43ba-91bf-1656df943b55.f1e6a68a-8c97-4911-9a7c-b3f2fcdcf359" returned: 0 in 0.279s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:49 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-68d3bb2a-af9b-4550-aac1-1b2bae5fbe10 tempest-ProjectReaderTests-1676955223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-74f1819f-1676-43ba-91bf-1656df943b55.info {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:49 devstack sudo[105112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-74f1819f-1676-43ba-91bf-1656df943b55.info Sep 17 22:11:49 devstack sudo[105102]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:49 devstack sudo[105112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:49 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-f5238fb1-94fa-4161-904f-d72a1d597d35 tempest-VolumeDependencyTests-1793337236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb27067a-148e-4e64-8962-3ac16bc80cf8.cf711ded-39fa-4af0-be22-b89e14cfbc4a" returned: 0 in 0.437s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:49 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-f5238fb1-94fa-4161-904f-d72a1d597d35 tempest-VolumeDependencyTests-1793337236 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb27067a-148e-4e64-8962-3ac16bc80cf8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85458) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 22:11:49 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0a40813-8051-4557-9525-b1b799d9b509]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:11:49 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-f5238fb1-94fa-4161-904f-d72a1d597d35 tempest-VolumeDependencyTests-1793337236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb27067a-148e-4e64-8962-3ac16bc80cf8 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:49 devstack sudo[105114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb27067a-148e-4e64-8962-3ac16bc80cf8 Sep 17 22:11:49 devstack sudo[105114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:49 devstack sudo[105112]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:49 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-68d3bb2a-af9b-4550-aac1-1b2bae5fbe10 tempest-ProjectReaderTests-1676955223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-74f1819f-1676-43ba-91bf-1656df943b55.info" returned: 0 in 0.280s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:49 devstack cinder-volume[85458]: WARNING cinder.volume.drivers.remotefs [None req-68d3bb2a-af9b-4550-aac1-1b2bae5fbe10 tempest-ProjectReaderTests-1676955223 None] /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-74f1819f-1676-43ba-91bf-1656df943b55.info is being set with open permissions: ugo+rw Sep 17 22:11:49 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-68d3bb2a-af9b-4550-aac1-1b2bae5fbe10 tempest-ProjectReaderTests-1676955223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-74f1819f-1676-43ba-91bf-1656df943b55.info {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:49 devstack sudo[105117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-74f1819f-1676-43ba-91bf-1656df943b55.info Sep 17 22:11:49 devstack sudo[105117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:49 devstack sudo[105117]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:49 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-68d3bb2a-af9b-4550-aac1-1b2bae5fbe10 tempest-ProjectReaderTests-1676955223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-74f1819f-1676-43ba-91bf-1656df943b55.info" returned: 0 in 0.276s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:49 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-68d3bb2a-af9b-4550-aac1-1b2bae5fbe10 tempest-ProjectReaderTests-1676955223 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.121s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:11:49 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-b2c76b9c-89a2-4cbb-ad17-aad9c2657644 tempest-ProjectMemberTests-1966135882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.903s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:11:49 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-b2c76b9c-89a2-4cbb-ad17-aad9c2657644 tempest-ProjectMemberTests-1966135882 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:11:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-484143699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb1fd62b-dd46-451b-9590-cfcf0c5b9878,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f277f501a340474ca5d0daea12e88955',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:11:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:11:45Z,use_quota=True,user_id='e584775bfb3c440aa7aac369d15efa55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 22:11:49 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-b2c76b9c-89a2-4cbb-ad17-aad9c2657644 tempest-ProjectMemberTests-1966135882 None] Creating volume cb1fd62b-dd46-451b-9590-cfcf0c5b9878 {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 22:11:49 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-b2c76b9c-89a2-4cbb-ad17-aad9c2657644 tempest-ProjectMemberTests-1966135882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:11:49 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-b2c76b9c-89a2-4cbb-ad17-aad9c2657644 tempest-ProjectMemberTests-1966135882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:11:49 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-b2c76b9c-89a2-4cbb-ad17-aad9c2657644 tempest-ProjectMemberTests-1966135882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:11:49 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-b2c76b9c-89a2-4cbb-ad17-aad9c2657644 tempest-ProjectMemberTests-1966135882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:11:49 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-b2c76b9c-89a2-4cbb-ad17-aad9c2657644 tempest-ProjectMemberTests-1966135882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:11:49 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-b2c76b9c-89a2-4cbb-ad17-aad9c2657644 tempest-ProjectMemberTests-1966135882 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 22:11:49 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-b2c76b9c-89a2-4cbb-ad17-aad9c2657644 tempest-ProjectMemberTests-1966135882 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 22:11:49 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-b2c76b9c-89a2-4cbb-ad17-aad9c2657644 tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb1fd62b-dd46-451b-9590-cfcf0c5b9878 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:49 devstack sudo[105123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb1fd62b-dd46-451b-9590-cfcf0c5b9878 1073741824 Sep 17 22:11:49 devstack sudo[105123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:49 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-68d3bb2a-af9b-4550-aac1-1b2bae5fbe10 tempest-ProjectReaderTests-1676955223 None] Create snapshot completed successfully Sep 17 22:11:49 devstack sudo[105114]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:49 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-f5238fb1-94fa-4161-904f-d72a1d597d35 tempest-VolumeDependencyTests-1793337236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb27067a-148e-4e64-8962-3ac16bc80cf8" returned: 0 in 0.658s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:49 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-f5238fb1-94fa-4161-904f-d72a1d597d35 tempest-VolumeDependencyTests-1793337236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb27067a-148e-4e64-8962-3ac16bc80cf8.cf711ded-39fa-4af0-be22-b89e14cfbc4a {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:49 devstack sudo[105127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb27067a-148e-4e64-8962-3ac16bc80cf8.cf711ded-39fa-4af0-be22-b89e14cfbc4a Sep 17 22:11:49 devstack sudo[105127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:50 devstack sudo[105127]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:50 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-f5238fb1-94fa-4161-904f-d72a1d597d35 tempest-VolumeDependencyTests-1793337236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb27067a-148e-4e64-8962-3ac16bc80cf8.cf711ded-39fa-4af0-be22-b89e14cfbc4a" returned: 0 in 0.399s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:50 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-f5238fb1-94fa-4161-904f-d72a1d597d35 tempest-VolumeDependencyTests-1793337236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb27067a-148e-4e64-8962-3ac16bc80cf8.cf711ded-39fa-4af0-be22-b89e14cfbc4a {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:50 devstack sudo[105123]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:50 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-b2c76b9c-89a2-4cbb-ad17-aad9c2657644 tempest-ProjectMemberTests-1966135882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb1fd62b-dd46-451b-9590-cfcf0c5b9878 1073741824" returned: 0 in 0.540s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:50 devstack sudo[105136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb27067a-148e-4e64-8962-3ac16bc80cf8.cf711ded-39fa-4af0-be22-b89e14cfbc4a Sep 17 22:11:50 devstack sudo[105136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:50 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-b2c76b9c-89a2-4cbb-ad17-aad9c2657644 tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb1fd62b-dd46-451b-9590-cfcf0c5b9878 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:50 devstack sudo[105138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb1fd62b-dd46-451b-9590-cfcf0c5b9878 Sep 17 22:11:50 devstack sudo[105138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:50 devstack sudo[105136]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:50 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-f5238fb1-94fa-4161-904f-d72a1d597d35 tempest-VolumeDependencyTests-1793337236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb27067a-148e-4e64-8962-3ac16bc80cf8.cf711ded-39fa-4af0-be22-b89e14cfbc4a" returned: 0 in 0.270s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:50 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-f5238fb1-94fa-4161-904f-d72a1d597d35 tempest-VolumeDependencyTests-1793337236 None] Lock "cinder-quobyte-cf711ded-39fa-4af0-be22-b89e14cfbc4a" released by "_delete_snapshot" :: held 1.906s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:11:50 devstack sudo[105138]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:50 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-b2c76b9c-89a2-4cbb-ad17-aad9c2657644 tempest-ProjectMemberTests-1966135882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb1fd62b-dd46-451b-9590-cfcf0c5b9878" returned: 0 in 0.271s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:50 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-b2c76b9c-89a2-4cbb-ad17-aad9c2657644 tempest-ProjectMemberTests-1966135882 None] <== create_volume: return (869ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 22:11:50 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-b2c76b9c-89a2-4cbb-ad17-aad9c2657644 tempest-ProjectMemberTests-1966135882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.873s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:11:50 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-f5238fb1-94fa-4161-904f-d72a1d597d35 tempest-VolumeDependencyTests-1793337236 None] Lock "cinder-quobyte-cb27067a-148e-4e64-8962-3ac16bc80cf8" released by "delete_snapshot" :: held 1.966s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:11:50 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b2c76b9c-89a2-4cbb-ad17-aad9c2657644 tempest-ProjectMemberTests-1966135882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (822577fd-8c2e-4306-9170-b85f6260646c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb1fd62b-dd46-451b-9590-cfcf0c5b9878', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:50 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b2c76b9c-89a2-4cbb-ad17-aad9c2657644 tempest-ProjectMemberTests-1966135882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d46862a-f0bc-4392-bf2b-0e3241bbab45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:50 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-b2c76b9c-89a2-4cbb-ad17-aad9c2657644 tempest-ProjectMemberTests-1966135882 None] Volume volume-cb1fd62b-dd46-451b-9590-cfcf0c5b9878 (cb1fd62b-dd46-451b-9590-cfcf0c5b9878): created successfully Sep 17 22:11:50 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b2c76b9c-89a2-4cbb-ad17-aad9c2657644 tempest-ProjectMemberTests-1966135882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d46862a-f0bc-4392-bf2b-0e3241bbab45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:50 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b2c76b9c-89a2-4cbb-ad17-aad9c2657644 tempest-ProjectMemberTests-1966135882 None] Flow 'volume_create_manager' (a2ecffa8-21d2-4e8b-a7be-dd2d65b0d67c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:11:50 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-b2c76b9c-89a2-4cbb-ad17-aad9c2657644 tempest-ProjectMemberTests-1966135882 None] Created volume successfully. Sep 17 22:11:50 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-f5238fb1-94fa-4161-904f-d72a1d597d35 tempest-VolumeDependencyTests-1793337236 None] Created reservations ['0a911552-b611-43f1-a007-13f5dbd3fe62', '9d545cd9-3e13-408b-8ac4-0dee16352c46', 'b1d7f39d-fef2-4916-ae5c-464ec53c4b08', '36221261-5a75-4066-b310-5a5a7e1a6392'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:11:50 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-f5238fb1-94fa-4161-904f-d72a1d597d35 tempest-VolumeDependencyTests-1793337236 None] Delete snapshot completed successfully. Sep 17 22:11:50 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-f5238fb1-94fa-4161-904f-d72a1d597d35 tempest-VolumeDependencyTests-1793337236 None] Lock "cinder-cf711ded-39fa-4af0-be22-b89e14cfbc4a-delete_snapshot" released by "delete_snapshot" :: held 2.183s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:11:50 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-54b01088-da5b-4354-a8e8-3d57563c6cea tempest-ProjectReaderTests-1676955223 None] Acquiring lock "cinder-f1e6a68a-8c97-4911-9a7c-b3f2fcdcf359-delete_snapshot" by "delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:11:50 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-54b01088-da5b-4354-a8e8-3d57563c6cea tempest-ProjectReaderTests-1676955223 None] Lock "cinder-f1e6a68a-8c97-4911-9a7c-b3f2fcdcf359-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:11:50 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-54b01088-da5b-4354-a8e8-3d57563c6cea tempest-ProjectReaderTests-1676955223 None] Acquiring lock "cinder-quobyte-74f1819f-1676-43ba-91bf-1656df943b55" by "delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:11:50 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-54b01088-da5b-4354-a8e8-3d57563c6cea tempest-ProjectReaderTests-1676955223 None] Lock "cinder-quobyte-74f1819f-1676-43ba-91bf-1656df943b55" acquired by "delete_snapshot" :: waited 0.028s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:11:50 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-54b01088-da5b-4354-a8e8-3d57563c6cea tempest-ProjectReaderTests-1676955223 None] Acquiring lock "cinder-quobyte-f1e6a68a-8c97-4911-9a7c-b3f2fcdcf359" by "_delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:11:50 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-54b01088-da5b-4354-a8e8-3d57563c6cea tempest-ProjectReaderTests-1676955223 None] Lock "cinder-quobyte-f1e6a68a-8c97-4911-9a7c-b3f2fcdcf359" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:11:50 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-54b01088-da5b-4354-a8e8-3d57563c6cea tempest-ProjectReaderTests-1676955223 None] Deleting offline snapshot f1e6a68a-8c97-4911-9a7c-b3f2fcdcf359 of volume 74f1819f-1676-43ba-91bf-1656df943b55 {{(pid=85458) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 22:11:51 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-54b01088-da5b-4354-a8e8-3d57563c6cea tempest-ProjectReaderTests-1676955223 None] snapshot_file for this snap is: volume-74f1819f-1676-43ba-91bf-1656df943b55.f1e6a68a-8c97-4911-9a7c-b3f2fcdcf359 {{(pid=85458) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 22:11:51 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[e48951b6-3afa-4a80-8b7c-12bc8bf730d4]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:11:51 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-54b01088-da5b-4354-a8e8-3d57563c6cea tempest-ProjectReaderTests-1676955223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-74f1819f-1676-43ba-91bf-1656df943b55.f1e6a68a-8c97-4911-9a7c-b3f2fcdcf359 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:51 devstack sudo[105142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-74f1819f-1676-43ba-91bf-1656df943b55.f1e6a68a-8c97-4911-9a7c-b3f2fcdcf359 Sep 17 22:11:51 devstack sudo[105142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:51 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-29dea790-e98c-4743-b46a-fb3f2a93cbc3 tempest-ProjectMemberTests-1966135882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:11:51 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-29dea790-e98c-4743-b46a-fb3f2a93cbc3 tempest-ProjectMemberTests-1966135882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.006s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:11:51 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-29dea790-e98c-4743-b46a-fb3f2a93cbc3 tempest-ProjectMemberTests-1966135882 None] Creating offline snapshot 25d61735-384d-46a9-805a-6b902819c5e2 of volume cb1fd62b-dd46-451b-9590-cfcf0c5b9878 {{(pid=85458) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 22:11:51 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6b71ac6-4b3a-4576-9e33-7b3d6aee5d54]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:11:51 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-29dea790-e98c-4743-b46a-fb3f2a93cbc3 tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb1fd62b-dd46-451b-9590-cfcf0c5b9878 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:51 devstack sudo[105145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb1fd62b-dd46-451b-9590-cfcf0c5b9878 Sep 17 22:11:51 devstack sudo[105145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:51 devstack sudo[105142]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:51 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-54b01088-da5b-4354-a8e8-3d57563c6cea tempest-ProjectReaderTests-1676955223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-74f1819f-1676-43ba-91bf-1656df943b55.f1e6a68a-8c97-4911-9a7c-b3f2fcdcf359" returned: 0 in 0.575s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:51 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-54b01088-da5b-4354-a8e8-3d57563c6cea tempest-ProjectReaderTests-1676955223 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-74f1819f-1676-43ba-91bf-1656df943b55(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85458) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 22:11:51 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[1012bcab-4bcc-4d35-9f5f-d968efc1b965]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:11:51 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-54b01088-da5b-4354-a8e8-3d57563c6cea tempest-ProjectReaderTests-1676955223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-74f1819f-1676-43ba-91bf-1656df943b55 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:51 devstack sudo[105145]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:51 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-29dea790-e98c-4743-b46a-fb3f2a93cbc3 tempest-ProjectMemberTests-1966135882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb1fd62b-dd46-451b-9590-cfcf0c5b9878" returned: 0 in 0.437s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:51 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-29dea790-e98c-4743-b46a-fb3f2a93cbc3 tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb1fd62b-dd46-451b-9590-cfcf0c5b9878,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb1fd62b-dd46-451b-9590-cfcf0c5b9878.25d61735-384d-46a9-805a-6b902819c5e2 1G {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:51 devstack sudo[105151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-74f1819f-1676-43ba-91bf-1656df943b55 Sep 17 22:11:51 devstack sudo[105151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:51 devstack sudo[105155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb1fd62b-dd46-451b-9590-cfcf0c5b9878,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb1fd62b-dd46-451b-9590-cfcf0c5b9878.25d61735-384d-46a9-805a-6b902819c5e2 1G Sep 17 22:11:51 devstack sudo[105155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:51 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-275b7791-78c0-4ef1-890f-a58f42d8ab35 tempest-VolumeDependencyTests-1793337236 None] Acquiring lock "cinder-cb27067a-148e-4e64-8962-3ac16bc80cf8-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:11:51 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-275b7791-78c0-4ef1-890f-a58f42d8ab35 tempest-VolumeDependencyTests-1793337236 None] Lock "cinder-cb27067a-148e-4e64-8962-3ac16bc80cf8-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:11:51 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-275b7791-78c0-4ef1-890f-a58f42d8ab35 tempest-VolumeDependencyTests-1793337236 None] Acquiring lock "cinder-quobyte-cb27067a-148e-4e64-8962-3ac16bc80cf8" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:11:51 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-275b7791-78c0-4ef1-890f-a58f42d8ab35 tempest-VolumeDependencyTests-1793337236 None] Lock "cinder-quobyte-cb27067a-148e-4e64-8962-3ac16bc80cf8" acquired by "delete_volume" :: waited 0.019s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:11:51 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f23be6b-5081-4477-8eeb-974ff44f296a]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:11:51 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-275b7791-78c0-4ef1-890f-a58f42d8ab35 tempest-VolumeDependencyTests-1793337236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb27067a-148e-4e64-8962-3ac16bc80cf8 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:52 devstack sudo[105151]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:52 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-54b01088-da5b-4354-a8e8-3d57563c6cea tempest-ProjectReaderTests-1676955223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-74f1819f-1676-43ba-91bf-1656df943b55" returned: 0 in 0.478s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:52 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-54b01088-da5b-4354-a8e8-3d57563c6cea tempest-ProjectReaderTests-1676955223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-74f1819f-1676-43ba-91bf-1656df943b55.f1e6a68a-8c97-4911-9a7c-b3f2fcdcf359 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:52 devstack sudo[105158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb27067a-148e-4e64-8962-3ac16bc80cf8 Sep 17 22:11:52 devstack sudo[105158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:52 devstack sudo[105165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-74f1819f-1676-43ba-91bf-1656df943b55.f1e6a68a-8c97-4911-9a7c-b3f2fcdcf359 Sep 17 22:11:52 devstack sudo[105165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:52 devstack sudo[105155]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:52 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-29dea790-e98c-4743-b46a-fb3f2a93cbc3 tempest-ProjectMemberTests-1966135882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb1fd62b-dd46-451b-9590-cfcf0c5b9878,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb1fd62b-dd46-451b-9590-cfcf0c5b9878.25d61735-384d-46a9-805a-6b902819c5e2 1G" returned: 0 in 0.533s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:52 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-29dea790-e98c-4743-b46a-fb3f2a93cbc3 tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb1fd62b-dd46-451b-9590-cfcf0c5b9878 -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb1fd62b-dd46-451b-9590-cfcf0c5b9878.25d61735-384d-46a9-805a-6b902819c5e2 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:52 devstack sudo[105169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb1fd62b-dd46-451b-9590-cfcf0c5b9878 -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb1fd62b-dd46-451b-9590-cfcf0c5b9878.25d61735-384d-46a9-805a-6b902819c5e2 Sep 17 22:11:52 devstack sudo[105169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:52 devstack sudo[105158]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:52 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-275b7791-78c0-4ef1-890f-a58f42d8ab35 tempest-VolumeDependencyTests-1793337236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb27067a-148e-4e64-8962-3ac16bc80cf8" returned: 0 in 0.464s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:52 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-275b7791-78c0-4ef1-890f-a58f42d8ab35 tempest-VolumeDependencyTests-1793337236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb27067a-148e-4e64-8962-3ac16bc80cf8 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:52 devstack sudo[105178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb27067a-148e-4e64-8962-3ac16bc80cf8 Sep 17 22:11:52 devstack sudo[105178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:52 devstack sudo[105165]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:52 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-54b01088-da5b-4354-a8e8-3d57563c6cea tempest-ProjectReaderTests-1676955223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-74f1819f-1676-43ba-91bf-1656df943b55.f1e6a68a-8c97-4911-9a7c-b3f2fcdcf359" returned: 0 in 0.459s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:52 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-54b01088-da5b-4354-a8e8-3d57563c6cea tempest-ProjectReaderTests-1676955223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-74f1819f-1676-43ba-91bf-1656df943b55.f1e6a68a-8c97-4911-9a7c-b3f2fcdcf359 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:52 devstack sudo[105183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-74f1819f-1676-43ba-91bf-1656df943b55.f1e6a68a-8c97-4911-9a7c-b3f2fcdcf359 Sep 17 22:11:52 devstack sudo[105183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:52 devstack sudo[105169]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:52 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-29dea790-e98c-4743-b46a-fb3f2a93cbc3 tempest-ProjectMemberTests-1966135882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb1fd62b-dd46-451b-9590-cfcf0c5b9878 -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb1fd62b-dd46-451b-9590-cfcf0c5b9878.25d61735-384d-46a9-805a-6b902819c5e2" returned: 0 in 0.335s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:52 devstack cinder-volume[85458]: WARNING cinder.volume.drivers.remotefs [None req-29dea790-e98c-4743-b46a-fb3f2a93cbc3 tempest-ProjectMemberTests-1966135882 None] /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb1fd62b-dd46-451b-9590-cfcf0c5b9878.25d61735-384d-46a9-805a-6b902819c5e2 is being set with open permissions: ugo+rw Sep 17 22:11:52 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-29dea790-e98c-4743-b46a-fb3f2a93cbc3 tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb1fd62b-dd46-451b-9590-cfcf0c5b9878.25d61735-384d-46a9-805a-6b902819c5e2 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:52 devstack sudo[105185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb1fd62b-dd46-451b-9590-cfcf0c5b9878.25d61735-384d-46a9-805a-6b902819c5e2 Sep 17 22:11:52 devstack sudo[105185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:52 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-ee7eda19-04b8-4023-a990-7ce049bf570d tempest-ProjectAdminTests-903838793 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.759220123291, 'free_capacity_gb': 1775.759220123291, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=85458) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 17 22:11:52 devstack sudo[105178]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:52 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-275b7791-78c0-4ef1-890f-a58f42d8ab35 tempest-VolumeDependencyTests-1793337236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb27067a-148e-4e64-8962-3ac16bc80cf8" returned: 0 in 0.311s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:52 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-275b7791-78c0-4ef1-890f-a58f42d8ab35 tempest-VolumeDependencyTests-1793337236 None] Lock "cinder-quobyte-cb27067a-148e-4e64-8962-3ac16bc80cf8" released by "delete_volume" :: held 0.880s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:11:52 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-275b7791-78c0-4ef1-890f-a58f42d8ab35 tempest-VolumeDependencyTests-1793337236 None] Created reservations ['b30f74eb-7d02-493f-9eb6-4d0c21d548e6', '8a63bc23-a9c2-406e-867b-9806c4bceb2e', '3458f30b-99a8-4e72-a554-d631d454f5e0', 'e9c291e2-0889-43f5-bdd2-b582be69da66'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:11:52 devstack sudo[105183]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:52 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-54b01088-da5b-4354-a8e8-3d57563c6cea tempest-ProjectReaderTests-1676955223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-74f1819f-1676-43ba-91bf-1656df943b55.f1e6a68a-8c97-4911-9a7c-b3f2fcdcf359" returned: 0 in 0.307s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:52 devstack sudo[105185]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:52 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-29dea790-e98c-4743-b46a-fb3f2a93cbc3 tempest-ProjectMemberTests-1966135882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb1fd62b-dd46-451b-9590-cfcf0c5b9878.25d61735-384d-46a9-805a-6b902819c5e2" returned: 0 in 0.301s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:52 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-54b01088-da5b-4354-a8e8-3d57563c6cea tempest-ProjectReaderTests-1676955223 None] Lock "cinder-quobyte-f1e6a68a-8c97-4911-9a7c-b3f2fcdcf359" released by "_delete_snapshot" :: held 1.977s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:11:52 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-54b01088-da5b-4354-a8e8-3d57563c6cea tempest-ProjectReaderTests-1676955223 None] Lock "cinder-quobyte-74f1819f-1676-43ba-91bf-1656df943b55" released by "delete_snapshot" :: held 2.012s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:11:52 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-29dea790-e98c-4743-b46a-fb3f2a93cbc3 tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb1fd62b-dd46-451b-9590-cfcf0c5b9878.info {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:53 devstack sudo[105190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb1fd62b-dd46-451b-9590-cfcf0c5b9878.info Sep 17 22:11:53 devstack sudo[105190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:53 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-275b7791-78c0-4ef1-890f-a58f42d8ab35 tempest-VolumeDependencyTests-1793337236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:11:53 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-275b7791-78c0-4ef1-890f-a58f42d8ab35 tempest-VolumeDependencyTests-1793337236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:11:53 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-275b7791-78c0-4ef1-890f-a58f42d8ab35 tempest-VolumeDependencyTests-1793337236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:11:53 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-275b7791-78c0-4ef1-890f-a58f42d8ab35 tempest-VolumeDependencyTests-1793337236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:11:53 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-275b7791-78c0-4ef1-890f-a58f42d8ab35 tempest-VolumeDependencyTests-1793337236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:11:53 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-275b7791-78c0-4ef1-890f-a58f42d8ab35 tempest-VolumeDependencyTests-1793337236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:53 devstack sudo[105192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:11:53 devstack sudo[105192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:53 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-54b01088-da5b-4354-a8e8-3d57563c6cea tempest-ProjectReaderTests-1676955223 None] Created reservations ['2d08e906-8a54-40df-a042-767f826df05f', 'bfaa2203-757b-46e4-80d2-ad0654df34e4', '93eaffb4-bded-4fa6-8524-bd56353a9990', '18f6ea4e-beff-425c-ae66-58dd7ba322d8'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:11:53 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-54b01088-da5b-4354-a8e8-3d57563c6cea tempest-ProjectReaderTests-1676955223 None] Delete snapshot completed successfully. Sep 17 22:11:53 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-54b01088-da5b-4354-a8e8-3d57563c6cea tempest-ProjectReaderTests-1676955223 None] Lock "cinder-f1e6a68a-8c97-4911-9a7c-b3f2fcdcf359-delete_snapshot" released by "delete_snapshot" :: held 2.271s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:11:53 devstack sudo[105190]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:53 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-29dea790-e98c-4743-b46a-fb3f2a93cbc3 tempest-ProjectMemberTests-1966135882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb1fd62b-dd46-451b-9590-cfcf0c5b9878.info" returned: 0 in 0.281s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:53 devstack cinder-volume[85458]: WARNING cinder.volume.drivers.remotefs [None req-29dea790-e98c-4743-b46a-fb3f2a93cbc3 tempest-ProjectMemberTests-1966135882 None] /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb1fd62b-dd46-451b-9590-cfcf0c5b9878.info is being set with open permissions: ugo+rw Sep 17 22:11:53 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-29dea790-e98c-4743-b46a-fb3f2a93cbc3 tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb1fd62b-dd46-451b-9590-cfcf0c5b9878.info {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:53 devstack sudo[105195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb1fd62b-dd46-451b-9590-cfcf0c5b9878.info Sep 17 22:11:53 devstack sudo[105195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:53 devstack sudo[105192]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:53 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-275b7791-78c0-4ef1-890f-a58f42d8ab35 tempest-VolumeDependencyTests-1793337236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.299s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:53 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-275b7791-78c0-4ef1-890f-a58f42d8ab35 tempest-VolumeDependencyTests-1793337236 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:11:53 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-275b7791-78c0-4ef1-890f-a58f42d8ab35 tempest-VolumeDependencyTests-1793337236 None] Deleted volume successfully. Sep 17 22:11:53 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-275b7791-78c0-4ef1-890f-a58f42d8ab35 tempest-VolumeDependencyTests-1793337236 None] Lock "cinder-cb27067a-148e-4e64-8962-3ac16bc80cf8-delete_volume" released by "delete_volume" :: held 1.559s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:11:53 devstack sudo[105195]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:53 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-29dea790-e98c-4743-b46a-fb3f2a93cbc3 tempest-ProjectMemberTests-1966135882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb1fd62b-dd46-451b-9590-cfcf0c5b9878.info" returned: 0 in 0.275s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:53 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-29dea790-e98c-4743-b46a-fb3f2a93cbc3 tempest-ProjectMemberTests-1966135882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.296s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:11:53 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-29dea790-e98c-4743-b46a-fb3f2a93cbc3 tempest-ProjectMemberTests-1966135882 None] Create snapshot completed successfully Sep 17 22:11:54 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-0329b39a-8039-4ec5-988a-c1331ed0ae89 tempest-VolumeDependencyTests-1793337236 None] Acquiring lock "cinder-c587dbcf-9e7d-43db-a9ce-738bbb31d59b-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:11:54 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-0329b39a-8039-4ec5-988a-c1331ed0ae89 tempest-VolumeDependencyTests-1793337236 None] Lock "cinder-c587dbcf-9e7d-43db-a9ce-738bbb31d59b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:11:54 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-d5e6398e-f0b5-4a3a-94bb-ec1621af461b tempest-ProjectReaderTests-1676955223 None] Acquiring lock "cinder-74f1819f-1676-43ba-91bf-1656df943b55-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:11:54 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-d5e6398e-f0b5-4a3a-94bb-ec1621af461b tempest-ProjectReaderTests-1676955223 None] Lock "cinder-74f1819f-1676-43ba-91bf-1656df943b55-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:11:54 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-0329b39a-8039-4ec5-988a-c1331ed0ae89 tempest-VolumeDependencyTests-1793337236 None] Acquiring lock "cinder-quobyte-c587dbcf-9e7d-43db-a9ce-738bbb31d59b" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:11:54 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-0329b39a-8039-4ec5-988a-c1331ed0ae89 tempest-VolumeDependencyTests-1793337236 None] Lock "cinder-quobyte-c587dbcf-9e7d-43db-a9ce-738bbb31d59b" acquired by "delete_volume" :: waited 0.021s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:11:54 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-d5e6398e-f0b5-4a3a-94bb-ec1621af461b tempest-ProjectReaderTests-1676955223 None] Acquiring lock "cinder-quobyte-74f1819f-1676-43ba-91bf-1656df943b55" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:11:54 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bece393-1cb7-4730-a38f-e3325888938a]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:11:54 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-d5e6398e-f0b5-4a3a-94bb-ec1621af461b tempest-ProjectReaderTests-1676955223 None] Lock "cinder-quobyte-74f1819f-1676-43ba-91bf-1656df943b55" acquired by "delete_volume" :: waited 0.022s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:11:54 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-0329b39a-8039-4ec5-988a-c1331ed0ae89 tempest-VolumeDependencyTests-1793337236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c587dbcf-9e7d-43db-a9ce-738bbb31d59b {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:54 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6500c51-e441-4f09-bab1-412cd72b4de6]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:11:54 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-d5e6398e-f0b5-4a3a-94bb-ec1621af461b tempest-ProjectReaderTests-1676955223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-74f1819f-1676-43ba-91bf-1656df943b55 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:54 devstack sudo[105199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c587dbcf-9e7d-43db-a9ce-738bbb31d59b Sep 17 22:11:54 devstack sudo[105199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:54 devstack sudo[105200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-74f1819f-1676-43ba-91bf-1656df943b55 Sep 17 22:11:54 devstack sudo[105200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:54 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-9bc33908-2e9b-4463-b87f-5c86ca9211d9 tempest-ProjectMemberTests-1966135882 None] Acquiring lock "cinder-25d61735-384d-46a9-805a-6b902819c5e2-delete_snapshot" by "delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:11:54 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-9bc33908-2e9b-4463-b87f-5c86ca9211d9 tempest-ProjectMemberTests-1966135882 None] Lock "cinder-25d61735-384d-46a9-805a-6b902819c5e2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:11:54 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-9bc33908-2e9b-4463-b87f-5c86ca9211d9 tempest-ProjectMemberTests-1966135882 None] Acquiring lock "cinder-quobyte-cb1fd62b-dd46-451b-9590-cfcf0c5b9878" by "delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:11:54 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-9bc33908-2e9b-4463-b87f-5c86ca9211d9 tempest-ProjectMemberTests-1966135882 None] Lock "cinder-quobyte-cb1fd62b-dd46-451b-9590-cfcf0c5b9878" acquired by "delete_snapshot" :: waited 0.020s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:11:54 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-9bc33908-2e9b-4463-b87f-5c86ca9211d9 tempest-ProjectMemberTests-1966135882 None] Acquiring lock "cinder-quobyte-25d61735-384d-46a9-805a-6b902819c5e2" by "_delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:11:54 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-9bc33908-2e9b-4463-b87f-5c86ca9211d9 tempest-ProjectMemberTests-1966135882 None] Lock "cinder-quobyte-25d61735-384d-46a9-805a-6b902819c5e2" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:11:54 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-9bc33908-2e9b-4463-b87f-5c86ca9211d9 tempest-ProjectMemberTests-1966135882 None] Deleting offline snapshot 25d61735-384d-46a9-805a-6b902819c5e2 of volume cb1fd62b-dd46-451b-9590-cfcf0c5b9878 {{(pid=85458) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 22:11:54 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-9bc33908-2e9b-4463-b87f-5c86ca9211d9 tempest-ProjectMemberTests-1966135882 None] snapshot_file for this snap is: volume-cb1fd62b-dd46-451b-9590-cfcf0c5b9878.25d61735-384d-46a9-805a-6b902819c5e2 {{(pid=85458) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 22:11:54 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[057629bd-9967-4ca1-ac3b-193c9ca2736e]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:11:54 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-9bc33908-2e9b-4463-b87f-5c86ca9211d9 tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb1fd62b-dd46-451b-9590-cfcf0c5b9878.25d61735-384d-46a9-805a-6b902819c5e2 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:54 devstack sudo[105203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb1fd62b-dd46-451b-9590-cfcf0c5b9878.25d61735-384d-46a9-805a-6b902819c5e2 Sep 17 22:11:54 devstack sudo[105203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:54 devstack sudo[105199]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:54 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-0329b39a-8039-4ec5-988a-c1331ed0ae89 tempest-VolumeDependencyTests-1793337236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c587dbcf-9e7d-43db-a9ce-738bbb31d59b" returned: 0 in 0.468s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:54 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-0329b39a-8039-4ec5-988a-c1331ed0ae89 tempest-VolumeDependencyTests-1793337236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c587dbcf-9e7d-43db-a9ce-738bbb31d59b {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:54 devstack sudo[105200]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:54 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-d5e6398e-f0b5-4a3a-94bb-ec1621af461b tempest-ProjectReaderTests-1676955223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-74f1819f-1676-43ba-91bf-1656df943b55" returned: 0 in 0.470s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:54 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-d5e6398e-f0b5-4a3a-94bb-ec1621af461b tempest-ProjectReaderTests-1676955223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-74f1819f-1676-43ba-91bf-1656df943b55 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:54 devstack sudo[105211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c587dbcf-9e7d-43db-a9ce-738bbb31d59b Sep 17 22:11:54 devstack sudo[105211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:54 devstack sudo[105212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-74f1819f-1676-43ba-91bf-1656df943b55 Sep 17 22:11:54 devstack sudo[105212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:55 devstack sudo[105203]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:55 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-9bc33908-2e9b-4463-b87f-5c86ca9211d9 tempest-ProjectMemberTests-1966135882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb1fd62b-dd46-451b-9590-cfcf0c5b9878.25d61735-384d-46a9-805a-6b902819c5e2" returned: 0 in 0.442s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:55 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-9bc33908-2e9b-4463-b87f-5c86ca9211d9 tempest-ProjectMemberTests-1966135882 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb1fd62b-dd46-451b-9590-cfcf0c5b9878(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85458) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 22:11:55 devstack sudo[105211]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:55 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-0329b39a-8039-4ec5-988a-c1331ed0ae89 tempest-VolumeDependencyTests-1793337236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c587dbcf-9e7d-43db-a9ce-738bbb31d59b" returned: 0 in 0.302s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:55 devstack sudo[105212]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:55 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-d5e6398e-f0b5-4a3a-94bb-ec1621af461b tempest-ProjectReaderTests-1676955223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-74f1819f-1676-43ba-91bf-1656df943b55" returned: 0 in 0.290s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:55 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[449c55c9-d745-413e-8522-a83857ba06de]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:11:55 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-0329b39a-8039-4ec5-988a-c1331ed0ae89 tempest-VolumeDependencyTests-1793337236 None] Lock "cinder-quobyte-c587dbcf-9e7d-43db-a9ce-738bbb31d59b" released by "delete_volume" :: held 0.900s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:11:55 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-9bc33908-2e9b-4463-b87f-5c86ca9211d9 tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb1fd62b-dd46-451b-9590-cfcf0c5b9878 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:55 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-d5e6398e-f0b5-4a3a-94bb-ec1621af461b tempest-ProjectReaderTests-1676955223 None] Lock "cinder-quobyte-74f1819f-1676-43ba-91bf-1656df943b55" released by "delete_volume" :: held 0.867s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:11:55 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-0329b39a-8039-4ec5-988a-c1331ed0ae89 tempest-VolumeDependencyTests-1793337236 None] Created reservations ['02dd9703-5b3b-4646-8776-54b7ee52ff9c', '00519f9d-ed3a-49f6-a5da-b44fab360919', '77c1922d-404b-4571-a885-b00641599296', 'e73dc70b-42f4-474e-999f-e31643f09a04'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:11:55 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-d5e6398e-f0b5-4a3a-94bb-ec1621af461b tempest-ProjectReaderTests-1676955223 None] Created reservations ['50718873-7a8a-497d-9c1d-c59bc8af8234', '674bd08c-f0ba-4867-bbec-7defc97e2a42', '4b40661f-326c-4638-b349-f0e2d85a9446', 'e8d9804b-cb0b-4296-9c72-844c3fbd7ffb'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:11:55 devstack sudo[105220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb1fd62b-dd46-451b-9590-cfcf0c5b9878 Sep 17 22:11:55 devstack sudo[105220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:55 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-0329b39a-8039-4ec5-988a-c1331ed0ae89 tempest-VolumeDependencyTests-1793337236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:11:55 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-0329b39a-8039-4ec5-988a-c1331ed0ae89 tempest-VolumeDependencyTests-1793337236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:11:55 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-0329b39a-8039-4ec5-988a-c1331ed0ae89 tempest-VolumeDependencyTests-1793337236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:11:55 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-0329b39a-8039-4ec5-988a-c1331ed0ae89 tempest-VolumeDependencyTests-1793337236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:11:55 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-0329b39a-8039-4ec5-988a-c1331ed0ae89 tempest-VolumeDependencyTests-1793337236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:11:55 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-0329b39a-8039-4ec5-988a-c1331ed0ae89 tempest-VolumeDependencyTests-1793337236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:55 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-d5e6398e-f0b5-4a3a-94bb-ec1621af461b tempest-ProjectReaderTests-1676955223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:11:55 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-d5e6398e-f0b5-4a3a-94bb-ec1621af461b tempest-ProjectReaderTests-1676955223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:11:55 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-d5e6398e-f0b5-4a3a-94bb-ec1621af461b tempest-ProjectReaderTests-1676955223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:11:55 devstack sudo[105222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:11:55 devstack sudo[105222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:55 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-d5e6398e-f0b5-4a3a-94bb-ec1621af461b tempest-ProjectReaderTests-1676955223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:11:55 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-d5e6398e-f0b5-4a3a-94bb-ec1621af461b tempest-ProjectReaderTests-1676955223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:11:55 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-d5e6398e-f0b5-4a3a-94bb-ec1621af461b tempest-ProjectReaderTests-1676955223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:55 devstack sudo[105224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:11:55 devstack sudo[105224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:55 devstack sudo[105220]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:55 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-9bc33908-2e9b-4463-b87f-5c86ca9211d9 tempest-ProjectMemberTests-1966135882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb1fd62b-dd46-451b-9590-cfcf0c5b9878" returned: 0 in 0.549s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:55 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-9bc33908-2e9b-4463-b87f-5c86ca9211d9 tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb1fd62b-dd46-451b-9590-cfcf0c5b9878.25d61735-384d-46a9-805a-6b902819c5e2 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:55 devstack sudo[105222]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:55 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-0329b39a-8039-4ec5-988a-c1331ed0ae89 tempest-VolumeDependencyTests-1793337236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.324s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:55 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-0329b39a-8039-4ec5-988a-c1331ed0ae89 tempest-VolumeDependencyTests-1793337236 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:11:55 devstack sudo[105231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb1fd62b-dd46-451b-9590-cfcf0c5b9878.25d61735-384d-46a9-805a-6b902819c5e2 Sep 17 22:11:55 devstack sudo[105231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:55 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-0329b39a-8039-4ec5-988a-c1331ed0ae89 tempest-VolumeDependencyTests-1793337236 None] Deleted volume successfully. Sep 17 22:11:55 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-0329b39a-8039-4ec5-988a-c1331ed0ae89 tempest-VolumeDependencyTests-1793337236 None] Lock "cinder-c587dbcf-9e7d-43db-a9ce-738bbb31d59b-delete_volume" released by "delete_volume" :: held 1.629s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:11:55 devstack sudo[105224]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:55 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-d5e6398e-f0b5-4a3a-94bb-ec1621af461b tempest-ProjectReaderTests-1676955223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.395s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:55 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-d5e6398e-f0b5-4a3a-94bb-ec1621af461b tempest-ProjectReaderTests-1676955223 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:11:55 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-d5e6398e-f0b5-4a3a-94bb-ec1621af461b tempest-ProjectReaderTests-1676955223 None] Deleted volume successfully. Sep 17 22:11:55 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-d5e6398e-f0b5-4a3a-94bb-ec1621af461b tempest-ProjectReaderTests-1676955223 None] Lock "cinder-74f1819f-1676-43ba-91bf-1656df943b55-delete_volume" released by "delete_volume" :: held 1.708s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:11:56 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a5623db-3383-4def-9c87-8d60579d9fd4 tempest-ProjectReaderTests-1676955223 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 22:11:56 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-1a5623db-3383-4def-9c87-8d60579d9fd4 tempest-ProjectReaderTests-1676955223 None] Flow 'volume_create_manager' (1e892c47-ea89-492a-bfe0-b66a94650384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:11:56 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-1a5623db-3383-4def-9c87-8d60579d9fd4 tempest-ProjectReaderTests-1676955223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5f5a6e6-3b3f-4e2f-a6ad-549bd366bb07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:56 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-1a5623db-3383-4def-9c87-8d60579d9fd4 tempest-ProjectReaderTests-1676955223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5f5a6e6-3b3f-4e2f-a6ad-549bd366bb07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:11:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-733311069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=119db0b8-777b-4938-84af-6cb67b91aa1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e4464b587ad40759679fd10b5eda168',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:11:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:11:56Z,use_quota=True,user_id='dcf31a786e3845bab1a502363d0f3482',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:56 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-1a5623db-3383-4def-9c87-8d60579d9fd4 tempest-ProjectReaderTests-1676955223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48a9153f-236e-4792-aa7b-4595cc594d4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:56 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-1a5623db-3383-4def-9c87-8d60579d9fd4 tempest-ProjectReaderTests-1676955223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48a9153f-236e-4792-aa7b-4595cc594d4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:56 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-1a5623db-3383-4def-9c87-8d60579d9fd4 tempest-ProjectReaderTests-1676955223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99d92451-c405-42ea-8062-aec38ae3e2d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:56 devstack sudo[105231]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:56 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-1a5623db-3383-4def-9c87-8d60579d9fd4 tempest-ProjectReaderTests-1676955223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99d92451-c405-42ea-8062-aec38ae3e2d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '119db0b8-777b-4938-84af-6cb67b91aa1b', 'volume_name': 'volume-119db0b8-777b-4938-84af-6cb67b91aa1b', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:56 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-1a5623db-3383-4def-9c87-8d60579d9fd4 tempest-ProjectReaderTests-1676955223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7c7345f-337f-47fb-b8a8-accf81d031fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:56 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-1a5623db-3383-4def-9c87-8d60579d9fd4 tempest-ProjectReaderTests-1676955223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7c7345f-337f-47fb-b8a8-accf81d031fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:56 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-1a5623db-3383-4def-9c87-8d60579d9fd4 tempest-ProjectReaderTests-1676955223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (347e4074-b2f0-4c2d-af46-769f5b79a787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:56 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-1a5623db-3383-4def-9c87-8d60579d9fd4 tempest-ProjectReaderTests-1676955223 None] Volume 119db0b8-777b-4938-84af-6cb67b91aa1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-119db0b8-777b-4938-84af-6cb67b91aa1b', 'volume_size': 1} Sep 17 22:11:56 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-1a5623db-3383-4def-9c87-8d60579d9fd4 tempest-ProjectReaderTests-1676955223 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:11:56 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-1a5623db-3383-4def-9c87-8d60579d9fd4 tempest-ProjectReaderTests-1676955223 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:11:56 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-1a5623db-3383-4def-9c87-8d60579d9fd4 tempest-ProjectReaderTests-1676955223 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:11:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-733311069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=119db0b8-777b-4938-84af-6cb67b91aa1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e4464b587ad40759679fd10b5eda168',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:11:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:11:56Z,use_quota=True,user_id='dcf31a786e3845bab1a502363d0f3482',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 22:11:56 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-1a5623db-3383-4def-9c87-8d60579d9fd4 tempest-ProjectReaderTests-1676955223 None] Creating volume 119db0b8-777b-4938-84af-6cb67b91aa1b {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 22:11:56 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-1a5623db-3383-4def-9c87-8d60579d9fd4 tempest-ProjectReaderTests-1676955223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:11:56 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-1a5623db-3383-4def-9c87-8d60579d9fd4 tempest-ProjectReaderTests-1676955223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:11:56 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-1a5623db-3383-4def-9c87-8d60579d9fd4 tempest-ProjectReaderTests-1676955223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:11:56 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-1a5623db-3383-4def-9c87-8d60579d9fd4 tempest-ProjectReaderTests-1676955223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:11:56 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-1a5623db-3383-4def-9c87-8d60579d9fd4 tempest-ProjectReaderTests-1676955223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:11:56 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-1a5623db-3383-4def-9c87-8d60579d9fd4 tempest-ProjectReaderTests-1676955223 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 22:11:56 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-1a5623db-3383-4def-9c87-8d60579d9fd4 tempest-ProjectReaderTests-1676955223 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 22:11:56 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-1a5623db-3383-4def-9c87-8d60579d9fd4 tempest-ProjectReaderTests-1676955223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-119db0b8-777b-4938-84af-6cb67b91aa1b 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:56 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-9bc33908-2e9b-4463-b87f-5c86ca9211d9 tempest-ProjectMemberTests-1966135882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb1fd62b-dd46-451b-9590-cfcf0c5b9878.25d61735-384d-46a9-805a-6b902819c5e2" returned: 0 in 0.457s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:56 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-9bc33908-2e9b-4463-b87f-5c86ca9211d9 tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb1fd62b-dd46-451b-9590-cfcf0c5b9878.25d61735-384d-46a9-805a-6b902819c5e2 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:56 devstack sudo[105237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-119db0b8-777b-4938-84af-6cb67b91aa1b 1073741824 Sep 17 22:11:56 devstack sudo[105237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:56 devstack sudo[105238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb1fd62b-dd46-451b-9590-cfcf0c5b9878.25d61735-384d-46a9-805a-6b902819c5e2 Sep 17 22:11:56 devstack sudo[105238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:56 devstack sudo[105238]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:56 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-9bc33908-2e9b-4463-b87f-5c86ca9211d9 tempest-ProjectMemberTests-1966135882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb1fd62b-dd46-451b-9590-cfcf0c5b9878.25d61735-384d-46a9-805a-6b902819c5e2" returned: 0 in 0.365s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:56 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-9bc33908-2e9b-4463-b87f-5c86ca9211d9 tempest-ProjectMemberTests-1966135882 None] Lock "cinder-quobyte-25d61735-384d-46a9-805a-6b902819c5e2" released by "_delete_snapshot" :: held 1.964s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:11:56 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-9bc33908-2e9b-4463-b87f-5c86ca9211d9 tempest-ProjectMemberTests-1966135882 None] Lock "cinder-quobyte-cb1fd62b-dd46-451b-9590-cfcf0c5b9878" released by "delete_snapshot" :: held 1.998s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:11:56 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-9bc33908-2e9b-4463-b87f-5c86ca9211d9 tempest-ProjectMemberTests-1966135882 None] Created reservations ['a059c2b6-9897-4d81-b0d4-5e4f946d92cd', '2a5018dc-f188-4742-853a-d2cd23ba8d47', '5e67148e-34cc-40dc-b9fb-e5724c0622d8', 'eedd46c6-0b96-43d9-991b-6cea9be27c0f'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:11:56 devstack sudo[105237]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:56 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-1a5623db-3383-4def-9c87-8d60579d9fd4 tempest-ProjectReaderTests-1676955223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-119db0b8-777b-4938-84af-6cb67b91aa1b 1073741824" returned: 0 in 0.534s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:56 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-1a5623db-3383-4def-9c87-8d60579d9fd4 tempest-ProjectReaderTests-1676955223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-119db0b8-777b-4938-84af-6cb67b91aa1b {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:56 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-9bc33908-2e9b-4463-b87f-5c86ca9211d9 tempest-ProjectMemberTests-1966135882 None] Delete snapshot completed successfully. Sep 17 22:11:56 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-9bc33908-2e9b-4463-b87f-5c86ca9211d9 tempest-ProjectMemberTests-1966135882 None] Lock "cinder-25d61735-384d-46a9-805a-6b902819c5e2-delete_snapshot" released by "delete_snapshot" :: held 2.210s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:11:56 devstack sudo[105246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-119db0b8-777b-4938-84af-6cb67b91aa1b Sep 17 22:11:56 devstack sudo[105246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:56 devstack sudo[105246]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:57 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-1a5623db-3383-4def-9c87-8d60579d9fd4 tempest-ProjectReaderTests-1676955223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-119db0b8-777b-4938-84af-6cb67b91aa1b" returned: 0 in 0.316s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:57 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-1a5623db-3383-4def-9c87-8d60579d9fd4 tempest-ProjectReaderTests-1676955223 None] <== create_volume: return (903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 22:11:57 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-1a5623db-3383-4def-9c87-8d60579d9fd4 tempest-ProjectReaderTests-1676955223 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.906s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:11:57 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-1a5623db-3383-4def-9c87-8d60579d9fd4 tempest-ProjectReaderTests-1676955223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (347e4074-b2f0-4c2d-af46-769f5b79a787) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-119db0b8-777b-4938-84af-6cb67b91aa1b', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:57 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-1a5623db-3383-4def-9c87-8d60579d9fd4 tempest-ProjectReaderTests-1676955223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae98501a-1b56-42fe-91ec-66124d42dd58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:57 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-1a5623db-3383-4def-9c87-8d60579d9fd4 tempest-ProjectReaderTests-1676955223 None] Volume volume-119db0b8-777b-4938-84af-6cb67b91aa1b (119db0b8-777b-4938-84af-6cb67b91aa1b): created successfully Sep 17 22:11:57 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-1a5623db-3383-4def-9c87-8d60579d9fd4 tempest-ProjectReaderTests-1676955223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae98501a-1b56-42fe-91ec-66124d42dd58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:57 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-1a5623db-3383-4def-9c87-8d60579d9fd4 tempest-ProjectReaderTests-1676955223 None] Flow 'volume_create_manager' (1e892c47-ea89-492a-bfe0-b66a94650384) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:11:57 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-1a5623db-3383-4def-9c87-8d60579d9fd4 tempest-ProjectReaderTests-1676955223 None] Created volume successfully. Sep 17 22:11:57 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-9ce09a41-4e70-4394-9a17-8d91ac7415e0 tempest-ProjectMemberTests-1966135882 None] Acquiring lock "cinder-cb1fd62b-dd46-451b-9590-cfcf0c5b9878-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:11:57 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-9ce09a41-4e70-4394-9a17-8d91ac7415e0 tempest-ProjectMemberTests-1966135882 None] Lock "cinder-cb1fd62b-dd46-451b-9590-cfcf0c5b9878-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:11:57 devstack cinder-volume[85458]: DEBUG dbcounter [-] [85458] Writing DB stats cinder:SELECT=223,cinder:UPDATE=333,cinder:DELETE=28,cinder:INSERT=92 {{(pid=85458) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 22:11:57 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-9ce09a41-4e70-4394-9a17-8d91ac7415e0 tempest-ProjectMemberTests-1966135882 None] Acquiring lock "cinder-quobyte-cb1fd62b-dd46-451b-9590-cfcf0c5b9878" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:11:57 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-9ce09a41-4e70-4394-9a17-8d91ac7415e0 tempest-ProjectMemberTests-1966135882 None] Lock "cinder-quobyte-cb1fd62b-dd46-451b-9590-cfcf0c5b9878" acquired by "delete_volume" :: waited 0.025s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:11:57 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6e2be24-402c-41b3-94df-5eb80bcd0900]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:11:57 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-9ce09a41-4e70-4394-9a17-8d91ac7415e0 tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb1fd62b-dd46-451b-9590-cfcf0c5b9878 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:58 devstack sudo[105249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb1fd62b-dd46-451b-9590-cfcf0c5b9878 Sep 17 22:11:58 devstack sudo[105249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:58 devstack cinder-volume[85458]: DEBUG dbcounter [-] [85458] Writing DB stats cinder:UPDATE=331,cinder:SELECT=269,cinder:INSERT=80,cinder:DELETE=31 {{(pid=85458) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 22:11:58 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-8db3fd5d-ed4c-45d4-8408-aa48ddde21c3 tempest-ProjectReaderTests-1676955223 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:11:58 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-8db3fd5d-ed4c-45d4-8408-aa48ddde21c3 tempest-ProjectReaderTests-1676955223 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:11:58 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-8db3fd5d-ed4c-45d4-8408-aa48ddde21c3 tempest-ProjectReaderTests-1676955223 None] Creating offline snapshot e9d804db-bdde-49cf-8f5c-ed2fb3861bcb of volume 119db0b8-777b-4938-84af-6cb67b91aa1b {{(pid=85458) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 22:11:58 devstack sudo[105249]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:58 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-9ce09a41-4e70-4394-9a17-8d91ac7415e0 tempest-ProjectMemberTests-1966135882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb1fd62b-dd46-451b-9590-cfcf0c5b9878" returned: 0 in 0.533s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:58 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-9ce09a41-4e70-4394-9a17-8d91ac7415e0 tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb1fd62b-dd46-451b-9590-cfcf0c5b9878 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:58 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[f085e446-debd-4e5f-97cf-47bff14d0473]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:11:58 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-8db3fd5d-ed4c-45d4-8408-aa48ddde21c3 tempest-ProjectReaderTests-1676955223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-119db0b8-777b-4938-84af-6cb67b91aa1b {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:58 devstack sudo[105254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb1fd62b-dd46-451b-9590-cfcf0c5b9878 Sep 17 22:11:58 devstack sudo[105254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:58 devstack sudo[105256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-119db0b8-777b-4938-84af-6cb67b91aa1b Sep 17 22:11:58 devstack sudo[105256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:58 devstack sudo[105254]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:58 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-9ce09a41-4e70-4394-9a17-8d91ac7415e0 tempest-ProjectMemberTests-1966135882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-cb1fd62b-dd46-451b-9590-cfcf0c5b9878" returned: 0 in 0.291s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:58 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-9ce09a41-4e70-4394-9a17-8d91ac7415e0 tempest-ProjectMemberTests-1966135882 None] Lock "cinder-quobyte-cb1fd62b-dd46-451b-9590-cfcf0c5b9878" released by "delete_volume" :: held 0.905s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:11:58 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-9ce09a41-4e70-4394-9a17-8d91ac7415e0 tempest-ProjectMemberTests-1966135882 None] Created reservations ['2b09519e-9f3f-4777-a500-cd6e836b499d', 'e7682551-baed-471d-b8e1-1b0250bf32ef', 'd3dacd97-cafb-4ba1-8ab8-d02a99a6090b', '313f482f-4e5b-41bc-9787-0c6029fc6346'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:11:58 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-9ce09a41-4e70-4394-9a17-8d91ac7415e0 tempest-ProjectMemberTests-1966135882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:11:58 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-9ce09a41-4e70-4394-9a17-8d91ac7415e0 tempest-ProjectMemberTests-1966135882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:11:58 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-9ce09a41-4e70-4394-9a17-8d91ac7415e0 tempest-ProjectMemberTests-1966135882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:11:58 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-9ce09a41-4e70-4394-9a17-8d91ac7415e0 tempest-ProjectMemberTests-1966135882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:11:58 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-9ce09a41-4e70-4394-9a17-8d91ac7415e0 tempest-ProjectMemberTests-1966135882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:11:58 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-9ce09a41-4e70-4394-9a17-8d91ac7415e0 tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:58 devstack sudo[105256]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:58 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-8db3fd5d-ed4c-45d4-8408-aa48ddde21c3 tempest-ProjectReaderTests-1676955223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-119db0b8-777b-4938-84af-6cb67b91aa1b" returned: 0 in 0.479s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:58 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-8db3fd5d-ed4c-45d4-8408-aa48ddde21c3 tempest-ProjectReaderTests-1676955223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-119db0b8-777b-4938-84af-6cb67b91aa1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-119db0b8-777b-4938-84af-6cb67b91aa1b.e9d804db-bdde-49cf-8f5c-ed2fb3861bcb 1G {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:58 devstack sudo[105262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:11:58 devstack sudo[105262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:58 devstack sudo[105263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-119db0b8-777b-4938-84af-6cb67b91aa1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-119db0b8-777b-4938-84af-6cb67b91aa1b.e9d804db-bdde-49cf-8f5c-ed2fb3861bcb 1G Sep 17 22:11:58 devstack sudo[105263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:59 devstack sudo[105262]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:59 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-9ce09a41-4e70-4394-9a17-8d91ac7415e0 tempest-ProjectMemberTests-1966135882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.405s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:59 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-9ce09a41-4e70-4394-9a17-8d91ac7415e0 tempest-ProjectMemberTests-1966135882 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:11:59 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-9ce09a41-4e70-4394-9a17-8d91ac7415e0 tempest-ProjectMemberTests-1966135882 None] Deleted volume successfully. Sep 17 22:11:59 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-9ce09a41-4e70-4394-9a17-8d91ac7415e0 tempest-ProjectMemberTests-1966135882 None] Lock "cinder-cb1fd62b-dd46-451b-9590-cfcf0c5b9878-delete_volume" released by "delete_volume" :: held 1.607s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:11:59 devstack sudo[105263]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:59 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-8db3fd5d-ed4c-45d4-8408-aa48ddde21c3 tempest-ProjectReaderTests-1676955223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-119db0b8-777b-4938-84af-6cb67b91aa1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-119db0b8-777b-4938-84af-6cb67b91aa1b.e9d804db-bdde-49cf-8f5c-ed2fb3861bcb 1G" returned: 0 in 0.671s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:59 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-8db3fd5d-ed4c-45d4-8408-aa48ddde21c3 tempest-ProjectReaderTests-1676955223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-119db0b8-777b-4938-84af-6cb67b91aa1b -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-119db0b8-777b-4938-84af-6cb67b91aa1b.e9d804db-bdde-49cf-8f5c-ed2fb3861bcb {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:11:59 devstack sudo[105271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-119db0b8-777b-4938-84af-6cb67b91aa1b -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-119db0b8-777b-4938-84af-6cb67b91aa1b.e9d804db-bdde-49cf-8f5c-ed2fb3861bcb Sep 17 22:11:59 devstack sudo[105271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:11:59 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-19adcaf2-7d89-4c51-a0f0-3f4ee25c9612 tempest-ProjectMemberTests-1966135882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 22:11:59 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-19adcaf2-7d89-4c51-a0f0-3f4ee25c9612 tempest-ProjectMemberTests-1966135882 None] Flow 'volume_create_manager' (39926896-f57f-40bc-bfc7-aabbd9247f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:11:59 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-19adcaf2-7d89-4c51-a0f0-3f4ee25c9612 tempest-ProjectMemberTests-1966135882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e646bce1-4979-4706-8834-17ec9760a469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:59 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-19adcaf2-7d89-4c51-a0f0-3f4ee25c9612 tempest-ProjectMemberTests-1966135882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e646bce1-4979-4706-8834-17ec9760a469) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:11:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2104521565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45b81ae0-4eee-482c-9db2-20b856cdb2a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f277f501a340474ca5d0daea12e88955',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:12:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:12:00Z,use_quota=True,user_id='e584775bfb3c440aa7aac369d15efa55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:59 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-19adcaf2-7d89-4c51-a0f0-3f4ee25c9612 tempest-ProjectMemberTests-1966135882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (773c3853-0ada-4f4d-a10b-17081673dcc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:59 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-19adcaf2-7d89-4c51-a0f0-3f4ee25c9612 tempest-ProjectMemberTests-1966135882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (773c3853-0ada-4f4d-a10b-17081673dcc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:59 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-19adcaf2-7d89-4c51-a0f0-3f4ee25c9612 tempest-ProjectMemberTests-1966135882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ec40e1d-1592-4a6f-b19f-7ef7877bf698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:59 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-19adcaf2-7d89-4c51-a0f0-3f4ee25c9612 tempest-ProjectMemberTests-1966135882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ec40e1d-1592-4a6f-b19f-7ef7877bf698) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45b81ae0-4eee-482c-9db2-20b856cdb2a7', 'volume_name': 'volume-45b81ae0-4eee-482c-9db2-20b856cdb2a7', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:59 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-19adcaf2-7d89-4c51-a0f0-3f4ee25c9612 tempest-ProjectMemberTests-1966135882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de9319c7-9a81-4dbe-9aa9-94b976159b41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:59 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-19adcaf2-7d89-4c51-a0f0-3f4ee25c9612 tempest-ProjectMemberTests-1966135882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de9319c7-9a81-4dbe-9aa9-94b976159b41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:11:59 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-19adcaf2-7d89-4c51-a0f0-3f4ee25c9612 tempest-ProjectMemberTests-1966135882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c67eb1f-22fb-4477-b9af-8be0ab80ada3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:11:59 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-19adcaf2-7d89-4c51-a0f0-3f4ee25c9612 tempest-ProjectMemberTests-1966135882 None] Volume 45b81ae0-4eee-482c-9db2-20b856cdb2a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45b81ae0-4eee-482c-9db2-20b856cdb2a7', 'volume_size': 1} Sep 17 22:11:59 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-19adcaf2-7d89-4c51-a0f0-3f4ee25c9612 tempest-ProjectMemberTests-1966135882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:11:59 devstack sudo[105271]: pam_unix(sudo:session): session closed for user root Sep 17 22:11:59 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-8db3fd5d-ed4c-45d4-8408-aa48ddde21c3 tempest-ProjectReaderTests-1676955223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-119db0b8-777b-4938-84af-6cb67b91aa1b -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-119db0b8-777b-4938-84af-6cb67b91aa1b.e9d804db-bdde-49cf-8f5c-ed2fb3861bcb" returned: 0 in 0.378s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:11:59 devstack cinder-volume[85458]: WARNING cinder.volume.drivers.remotefs [None req-8db3fd5d-ed4c-45d4-8408-aa48ddde21c3 tempest-ProjectReaderTests-1676955223 None] /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-119db0b8-777b-4938-84af-6cb67b91aa1b.e9d804db-bdde-49cf-8f5c-ed2fb3861bcb is being set with open permissions: ugo+rw Sep 17 22:11:59 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-8db3fd5d-ed4c-45d4-8408-aa48ddde21c3 tempest-ProjectReaderTests-1676955223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-119db0b8-777b-4938-84af-6cb67b91aa1b.e9d804db-bdde-49cf-8f5c-ed2fb3861bcb {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:00 devstack sudo[105276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-119db0b8-777b-4938-84af-6cb67b91aa1b.e9d804db-bdde-49cf-8f5c-ed2fb3861bcb Sep 17 22:12:00 devstack sudo[105276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:00 devstack sudo[105276]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:00 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-8db3fd5d-ed4c-45d4-8408-aa48ddde21c3 tempest-ProjectReaderTests-1676955223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-119db0b8-777b-4938-84af-6cb67b91aa1b.e9d804db-bdde-49cf-8f5c-ed2fb3861bcb" returned: 0 in 0.258s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:00 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-8db3fd5d-ed4c-45d4-8408-aa48ddde21c3 tempest-ProjectReaderTests-1676955223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-119db0b8-777b-4938-84af-6cb67b91aa1b.info {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:00 devstack sudo[105279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-119db0b8-777b-4938-84af-6cb67b91aa1b.info Sep 17 22:12:00 devstack sudo[105279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:00 devstack sudo[105279]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:00 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-8db3fd5d-ed4c-45d4-8408-aa48ddde21c3 tempest-ProjectReaderTests-1676955223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-119db0b8-777b-4938-84af-6cb67b91aa1b.info" returned: 0 in 0.272s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:00 devstack cinder-volume[85458]: WARNING cinder.volume.drivers.remotefs [None req-8db3fd5d-ed4c-45d4-8408-aa48ddde21c3 tempest-ProjectReaderTests-1676955223 None] /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-119db0b8-777b-4938-84af-6cb67b91aa1b.info is being set with open permissions: ugo+rw Sep 17 22:12:00 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-8db3fd5d-ed4c-45d4-8408-aa48ddde21c3 tempest-ProjectReaderTests-1676955223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-119db0b8-777b-4938-84af-6cb67b91aa1b.info {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:00 devstack sudo[105282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-119db0b8-777b-4938-84af-6cb67b91aa1b.info Sep 17 22:12:00 devstack sudo[105282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:00 devstack sudo[105282]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:00 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-8db3fd5d-ed4c-45d4-8408-aa48ddde21c3 tempest-ProjectReaderTests-1676955223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-119db0b8-777b-4938-84af-6cb67b91aa1b.info" returned: 0 in 0.260s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:00 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-8db3fd5d-ed4c-45d4-8408-aa48ddde21c3 tempest-ProjectReaderTests-1676955223 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.444s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:12:00 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-19adcaf2-7d89-4c51-a0f0-3f4ee25c9612 tempest-ProjectMemberTests-1966135882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.024s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:12:00 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-19adcaf2-7d89-4c51-a0f0-3f4ee25c9612 tempest-ProjectMemberTests-1966135882 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:11:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2104521565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45b81ae0-4eee-482c-9db2-20b856cdb2a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f277f501a340474ca5d0daea12e88955',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:12:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:12:00Z,use_quota=True,user_id='e584775bfb3c440aa7aac369d15efa55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 22:12:00 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-19adcaf2-7d89-4c51-a0f0-3f4ee25c9612 tempest-ProjectMemberTests-1966135882 None] Creating volume 45b81ae0-4eee-482c-9db2-20b856cdb2a7 {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 22:12:00 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-19adcaf2-7d89-4c51-a0f0-3f4ee25c9612 tempest-ProjectMemberTests-1966135882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:12:00 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-19adcaf2-7d89-4c51-a0f0-3f4ee25c9612 tempest-ProjectMemberTests-1966135882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:12:00 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-19adcaf2-7d89-4c51-a0f0-3f4ee25c9612 tempest-ProjectMemberTests-1966135882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:12:00 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-19adcaf2-7d89-4c51-a0f0-3f4ee25c9612 tempest-ProjectMemberTests-1966135882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:12:00 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-19adcaf2-7d89-4c51-a0f0-3f4ee25c9612 tempest-ProjectMemberTests-1966135882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:12:00 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-19adcaf2-7d89-4c51-a0f0-3f4ee25c9612 tempest-ProjectMemberTests-1966135882 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 22:12:00 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-19adcaf2-7d89-4c51-a0f0-3f4ee25c9612 tempest-ProjectMemberTests-1966135882 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 22:12:00 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-19adcaf2-7d89-4c51-a0f0-3f4ee25c9612 tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-45b81ae0-4eee-482c-9db2-20b856cdb2a7 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:00 devstack sudo[105285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-45b81ae0-4eee-482c-9db2-20b856cdb2a7 1073741824 Sep 17 22:12:00 devstack sudo[105285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:00 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-8db3fd5d-ed4c-45d4-8408-aa48ddde21c3 tempest-ProjectReaderTests-1676955223 None] Create snapshot completed successfully Sep 17 22:12:01 devstack sudo[105285]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:01 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-19adcaf2-7d89-4c51-a0f0-3f4ee25c9612 tempest-ProjectMemberTests-1966135882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-45b81ae0-4eee-482c-9db2-20b856cdb2a7 1073741824" returned: 0 in 0.469s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:01 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-19adcaf2-7d89-4c51-a0f0-3f4ee25c9612 tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-45b81ae0-4eee-482c-9db2-20b856cdb2a7 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:01 devstack sudo[105291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-45b81ae0-4eee-482c-9db2-20b856cdb2a7 Sep 17 22:12:01 devstack sudo[105291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:01 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-96b1caed-c492-4e8d-a28e-af8a8d344f51 tempest-ProjectReaderTests-1676955223 None] Acquiring lock "cinder-e9d804db-bdde-49cf-8f5c-ed2fb3861bcb-delete_snapshot" by "delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:12:01 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-96b1caed-c492-4e8d-a28e-af8a8d344f51 tempest-ProjectReaderTests-1676955223 None] Lock "cinder-e9d804db-bdde-49cf-8f5c-ed2fb3861bcb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:12:01 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-96b1caed-c492-4e8d-a28e-af8a8d344f51 tempest-ProjectReaderTests-1676955223 None] Acquiring lock "cinder-quobyte-119db0b8-777b-4938-84af-6cb67b91aa1b" by "delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:12:01 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-96b1caed-c492-4e8d-a28e-af8a8d344f51 tempest-ProjectReaderTests-1676955223 None] Lock "cinder-quobyte-119db0b8-777b-4938-84af-6cb67b91aa1b" acquired by "delete_snapshot" :: waited 0.033s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:12:01 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-96b1caed-c492-4e8d-a28e-af8a8d344f51 tempest-ProjectReaderTests-1676955223 None] Acquiring lock "cinder-quobyte-e9d804db-bdde-49cf-8f5c-ed2fb3861bcb" by "_delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:12:01 devstack sudo[105291]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:01 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-19adcaf2-7d89-4c51-a0f0-3f4ee25c9612 tempest-ProjectMemberTests-1966135882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-45b81ae0-4eee-482c-9db2-20b856cdb2a7" returned: 0 in 0.339s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:01 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-19adcaf2-7d89-4c51-a0f0-3f4ee25c9612 tempest-ProjectMemberTests-1966135882 None] <== create_volume: return (852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 22:12:01 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-19adcaf2-7d89-4c51-a0f0-3f4ee25c9612 tempest-ProjectMemberTests-1966135882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.857s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:12:01 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-96b1caed-c492-4e8d-a28e-af8a8d344f51 tempest-ProjectReaderTests-1676955223 None] Lock "cinder-quobyte-e9d804db-bdde-49cf-8f5c-ed2fb3861bcb" acquired by "_delete_snapshot" :: waited 0.049s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:12:01 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-96b1caed-c492-4e8d-a28e-af8a8d344f51 tempest-ProjectReaderTests-1676955223 None] Deleting offline snapshot e9d804db-bdde-49cf-8f5c-ed2fb3861bcb of volume 119db0b8-777b-4938-84af-6cb67b91aa1b {{(pid=85458) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 22:12:01 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-96b1caed-c492-4e8d-a28e-af8a8d344f51 tempest-ProjectReaderTests-1676955223 None] snapshot_file for this snap is: volume-119db0b8-777b-4938-84af-6cb67b91aa1b.e9d804db-bdde-49cf-8f5c-ed2fb3861bcb {{(pid=85458) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 22:12:01 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-19adcaf2-7d89-4c51-a0f0-3f4ee25c9612 tempest-ProjectMemberTests-1966135882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c67eb1f-22fb-4477-b9af-8be0ab80ada3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45b81ae0-4eee-482c-9db2-20b856cdb2a7', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:12:01 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-19adcaf2-7d89-4c51-a0f0-3f4ee25c9612 tempest-ProjectMemberTests-1966135882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c381cb44-1ebd-4354-a2e8-c28fd4aa47ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:12:01 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[e32a77d2-9869-46bf-b1fa-77bb428c13bf]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:12:01 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-96b1caed-c492-4e8d-a28e-af8a8d344f51 tempest-ProjectReaderTests-1676955223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-119db0b8-777b-4938-84af-6cb67b91aa1b.e9d804db-bdde-49cf-8f5c-ed2fb3861bcb {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:01 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-19adcaf2-7d89-4c51-a0f0-3f4ee25c9612 tempest-ProjectMemberTests-1966135882 None] Volume volume-45b81ae0-4eee-482c-9db2-20b856cdb2a7 (45b81ae0-4eee-482c-9db2-20b856cdb2a7): created successfully Sep 17 22:12:01 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-19adcaf2-7d89-4c51-a0f0-3f4ee25c9612 tempest-ProjectMemberTests-1966135882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c381cb44-1ebd-4354-a2e8-c28fd4aa47ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:12:01 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-19adcaf2-7d89-4c51-a0f0-3f4ee25c9612 tempest-ProjectMemberTests-1966135882 None] Flow 'volume_create_manager' (39926896-f57f-40bc-bfc7-aabbd9247f1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:12:01 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-19adcaf2-7d89-4c51-a0f0-3f4ee25c9612 tempest-ProjectMemberTests-1966135882 None] Created volume successfully. Sep 17 22:12:01 devstack sudo[105294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-119db0b8-777b-4938-84af-6cb67b91aa1b.e9d804db-bdde-49cf-8f5c-ed2fb3861bcb Sep 17 22:12:01 devstack sudo[105294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:02 devstack sudo[105294]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:02 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-96b1caed-c492-4e8d-a28e-af8a8d344f51 tempest-ProjectReaderTests-1676955223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-119db0b8-777b-4938-84af-6cb67b91aa1b.e9d804db-bdde-49cf-8f5c-ed2fb3861bcb" returned: 0 in 0.447s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:02 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-96b1caed-c492-4e8d-a28e-af8a8d344f51 tempest-ProjectReaderTests-1676955223 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-119db0b8-777b-4938-84af-6cb67b91aa1b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85458) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 22:12:02 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3085561-51d5-49bd-b9b5-5fa4ac083c2d]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:12:02 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-96b1caed-c492-4e8d-a28e-af8a8d344f51 tempest-ProjectReaderTests-1676955223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-119db0b8-777b-4938-84af-6cb67b91aa1b {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:02 devstack sudo[105299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-119db0b8-777b-4938-84af-6cb67b91aa1b Sep 17 22:12:02 devstack sudo[105299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:02 devstack sudo[105299]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:02 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-96b1caed-c492-4e8d-a28e-af8a8d344f51 tempest-ProjectReaderTests-1676955223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-119db0b8-777b-4938-84af-6cb67b91aa1b" returned: 0 in 0.379s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:02 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-96b1caed-c492-4e8d-a28e-af8a8d344f51 tempest-ProjectReaderTests-1676955223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-119db0b8-777b-4938-84af-6cb67b91aa1b.e9d804db-bdde-49cf-8f5c-ed2fb3861bcb {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:02 devstack sudo[105304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-119db0b8-777b-4938-84af-6cb67b91aa1b.e9d804db-bdde-49cf-8f5c-ed2fb3861bcb Sep 17 22:12:02 devstack sudo[105304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:03 devstack sudo[105304]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:03 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-96b1caed-c492-4e8d-a28e-af8a8d344f51 tempest-ProjectReaderTests-1676955223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-119db0b8-777b-4938-84af-6cb67b91aa1b.e9d804db-bdde-49cf-8f5c-ed2fb3861bcb" returned: 0 in 0.413s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:03 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-96b1caed-c492-4e8d-a28e-af8a8d344f51 tempest-ProjectReaderTests-1676955223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-119db0b8-777b-4938-84af-6cb67b91aa1b.e9d804db-bdde-49cf-8f5c-ed2fb3861bcb {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:03 devstack sudo[105310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-119db0b8-777b-4938-84af-6cb67b91aa1b.e9d804db-bdde-49cf-8f5c-ed2fb3861bcb Sep 17 22:12:03 devstack sudo[105310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:03 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-111b0aae-24ec-45d5-b09e-ae503e37afb0 tempest-ProjectMemberTests-1966135882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:12:03 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-111b0aae-24ec-45d5-b09e-ae503e37afb0 tempest-ProjectMemberTests-1966135882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:12:03 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7489ae6-c3a9-4112-a8dd-2ea98fe4c923 tempest-VolumeImageDependencyTests-1657937066 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 22:12:03 devstack sudo[105310]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:03 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-d7489ae6-c3a9-4112-a8dd-2ea98fe4c923 tempest-VolumeImageDependencyTests-1657937066 None] Flow 'volume_create_manager' (c6a7a808-4809-4304-914a-91913c83d1fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:12:03 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-d7489ae6-c3a9-4112-a8dd-2ea98fe4c923 tempest-VolumeImageDependencyTests-1657937066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b23824c7-585a-426a-9700-26d211de36f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:12:03 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-111b0aae-24ec-45d5-b09e-ae503e37afb0 tempest-ProjectMemberTests-1966135882 None] Creating offline snapshot 6e62f4a8-d778-4281-ac86-0e8c31823510 of volume 45b81ae0-4eee-482c-9db2-20b856cdb2a7 {{(pid=85458) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 22:12:03 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-96b1caed-c492-4e8d-a28e-af8a8d344f51 tempest-ProjectReaderTests-1676955223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-119db0b8-777b-4938-84af-6cb67b91aa1b.e9d804db-bdde-49cf-8f5c-ed2fb3861bcb" returned: 0 in 0.344s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:03 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[14d2dfb5-dcad-49e9-809e-95f6b0151cd5]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:12:03 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-111b0aae-24ec-45d5-b09e-ae503e37afb0 tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-45b81ae0-4eee-482c-9db2-20b856cdb2a7 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:03 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-d7489ae6-c3a9-4112-a8dd-2ea98fe4c923 tempest-VolumeImageDependencyTests-1657937066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b23824c7-585a-426a-9700-26d211de36f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:12:03Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e1e31d5-0763-4b4c-922d-d34af4dff4d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6dc5792a6f744fd91bbf3ffb448340b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:12:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:12:03Z,use_quota=True,user_id='3673505bc04a4b9c97c064e804269b41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:12:03 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-d7489ae6-c3a9-4112-a8dd-2ea98fe4c923 tempest-VolumeImageDependencyTests-1657937066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b4dcaa1-17bc-4086-91bf-1d5a4844d732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:12:03 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-d7489ae6-c3a9-4112-a8dd-2ea98fe4c923 tempest-VolumeImageDependencyTests-1657937066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b4dcaa1-17bc-4086-91bf-1d5a4844d732) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:12:03 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-d7489ae6-c3a9-4112-a8dd-2ea98fe4c923 tempest-VolumeImageDependencyTests-1657937066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7db49507-2358-4ff4-ba70-614a253bfccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:12:03 devstack cinder-volume[85458]: DEBUG cinder.image.glance [None req-d7489ae6-c3a9-4112-a8dd-2ea98fe4c923 tempest-VolumeImageDependencyTests-1657937066 None] Creating Keystone auth plugin from conf {{(pid=85458) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 17 22:12:03 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-96b1caed-c492-4e8d-a28e-af8a8d344f51 tempest-ProjectReaderTests-1676955223 None] Lock "cinder-quobyte-e9d804db-bdde-49cf-8f5c-ed2fb3861bcb" released by "_delete_snapshot" :: held 1.760s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:12:03 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-96b1caed-c492-4e8d-a28e-af8a8d344f51 tempest-ProjectReaderTests-1676955223 None] Lock "cinder-quobyte-119db0b8-777b-4938-84af-6cb67b91aa1b" released by "delete_snapshot" :: held 1.821s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:12:03 devstack sudo[105313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-45b81ae0-4eee-482c-9db2-20b856cdb2a7 Sep 17 22:12:03 devstack sudo[105313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:03 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-96b1caed-c492-4e8d-a28e-af8a8d344f51 tempest-ProjectReaderTests-1676955223 None] Created reservations ['a7329c29-1b81-45e4-bf6d-48c81d946232', '35020ec8-d3a8-41d7-aac9-117e04096fce', '7b1a3df4-ec0a-42ae-8662-2f968fd8b1c4', 'dfa6f538-0f95-43dc-9982-f306695f9e80'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:12:03 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-96b1caed-c492-4e8d-a28e-af8a8d344f51 tempest-ProjectReaderTests-1676955223 None] Delete snapshot completed successfully. Sep 17 22:12:03 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-96b1caed-c492-4e8d-a28e-af8a8d344f51 tempest-ProjectReaderTests-1676955223 None] Lock "cinder-e9d804db-bdde-49cf-8f5c-ed2fb3861bcb-delete_snapshot" released by "delete_snapshot" :: held 2.017s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:12:03 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-5a063cc1-1ba1-4386-922f-a91241bb0175 tempest-ProjectReaderTests-1676955223 None] Acquiring lock "cinder-119db0b8-777b-4938-84af-6cb67b91aa1b-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:12:03 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-5a063cc1-1ba1-4386-922f-a91241bb0175 tempest-ProjectReaderTests-1676955223 None] Lock "cinder-119db0b8-777b-4938-84af-6cb67b91aa1b-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:12:03 devstack sudo[105313]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:03 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-5a063cc1-1ba1-4386-922f-a91241bb0175 tempest-ProjectReaderTests-1676955223 None] Acquiring lock "cinder-quobyte-119db0b8-777b-4938-84af-6cb67b91aa1b" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:12:03 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-111b0aae-24ec-45d5-b09e-ae503e37afb0 tempest-ProjectMemberTests-1966135882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-45b81ae0-4eee-482c-9db2-20b856cdb2a7" returned: 0 in 0.506s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:03 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-111b0aae-24ec-45d5-b09e-ae503e37afb0 tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-45b81ae0-4eee-482c-9db2-20b856cdb2a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-45b81ae0-4eee-482c-9db2-20b856cdb2a7.6e62f4a8-d778-4281-ac86-0e8c31823510 1G {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:03 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-d7489ae6-c3a9-4112-a8dd-2ea98fe4c923 tempest-VolumeImageDependencyTests-1657937066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7db49507-2358-4ff4-ba70-614a253bfccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2e1e31d5-0763-4b4c-922d-d34af4dff4d1', 'volume_name': 'volume-2e1e31d5-0763-4b4c-922d-d34af4dff4d1', 'volume_size': 1, 'image_id': '5209f7d6-5a8b-47c6-a8fb-d67c67976ae9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5209f7d6-5a8b-47c6-a8fb-d67c67976ae9', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'aa559d46eaee01b0940282f5ca6d276d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd6dc5792a6f744fd91bbf3ffb448340b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'bf7a7a5da26114427e8ac15e39d11e3bdca8047eeeba12034739b80411d4222c79bdd6ed944353f1a7d8dff2126ad68945e1ee37d8bb49f64a3e78327601e25a', 'id': '5209f7d6-5a8b-47c6-a8fb-d67c67976ae9', 'created_at': datetime.datetime(2026, 9, 17, 20, 12, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 20, 12, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5209f7d6-5a8b-47c6-a8fb-d67c67976ae9/file', 'properties': {}}, 'image_service': }' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:12:03 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-d7489ae6-c3a9-4112-a8dd-2ea98fe4c923 tempest-VolumeImageDependencyTests-1657937066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (876a456e-8389-4d9a-b0be-d9005dff4dae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:12:03 devstack sudo[105320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-45b81ae0-4eee-482c-9db2-20b856cdb2a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-45b81ae0-4eee-482c-9db2-20b856cdb2a7.6e62f4a8-d778-4281-ac86-0e8c31823510 1G Sep 17 22:12:03 devstack sudo[105320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:03 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-d7489ae6-c3a9-4112-a8dd-2ea98fe4c923 tempest-VolumeImageDependencyTests-1657937066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (876a456e-8389-4d9a-b0be-d9005dff4dae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:12:03 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-d7489ae6-c3a9-4112-a8dd-2ea98fe4c923 tempest-VolumeImageDependencyTests-1657937066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63a78cc5-dcd2-479d-a64b-49098d3f4318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:12:03 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-d7489ae6-c3a9-4112-a8dd-2ea98fe4c923 tempest-VolumeImageDependencyTests-1657937066 None] Volume 2e1e31d5-0763-4b4c-922d-d34af4dff4d1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2e1e31d5-0763-4b4c-922d-d34af4dff4d1', 'volume_size': 1, 'image_id': '5209f7d6-5a8b-47c6-a8fb-d67c67976ae9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5209f7d6-5a8b-47c6-a8fb-d67c67976ae9', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'aa559d46eaee01b0940282f5ca6d276d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd6dc5792a6f744fd91bbf3ffb448340b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'bf7a7a5da26114427e8ac15e39d11e3bdca8047eeeba12034739b80411d4222c79bdd6ed944353f1a7d8dff2126ad68945e1ee37d8bb49f64a3e78327601e25a', 'id': '5209f7d6-5a8b-47c6-a8fb-d67c67976ae9', 'created_at': datetime.datetime(2026, 9, 17, 20, 12, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 20, 12, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5209f7d6-5a8b-47c6-a8fb-d67c67976ae9/file', 'properties': {}}, 'image_service': } Sep 17 22:12:03 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7489ae6-c3a9-4112-a8dd-2ea98fe4c923 tempest-VolumeImageDependencyTests-1657937066 None] Trying to clone 2e1e31d5-0763-4b4c-922d-d34af4dff4d1 from image 5209f7d6-5a8b-47c6-a8fb-d67c67976ae9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/5209f7d6-5a8b-47c6-a8fb-d67c67976ae9', 'metadata': {}}]). {{(pid=85458) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 17 22:12:04 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-5a063cc1-1ba1-4386-922f-a91241bb0175 tempest-ProjectReaderTests-1676955223 None] Lock "cinder-quobyte-119db0b8-777b-4938-84af-6cb67b91aa1b" acquired by "delete_volume" :: waited 0.064s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:12:04 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[110453dc-d0ef-4dff-a344-fce073d61cee]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:12:04 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-5a063cc1-1ba1-4386-922f-a91241bb0175 tempest-ProjectReaderTests-1676955223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-119db0b8-777b-4938-84af-6cb67b91aa1b {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:04 devstack cinder-volume[85458]: DEBUG cinder.image.image_utils [None req-d7489ae6-c3a9-4112-a8dd-2ea98fe4c923 tempest-VolumeImageDependencyTests-1657937066 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5209f7d6-5a8b-47c6-a8fb-d67c67976ae9_80jb7zi3devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=85458) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 17 22:12:04 devstack cinder-volume[85458]: INFO cinder.image.image_utils [None req-d7489ae6-c3a9-4112-a8dd-2ea98fe4c923 tempest-VolumeImageDependencyTests-1657937066 None] Image download 0.00 MB at 0.00 MB/s Sep 17 22:12:04 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[61bf255f-eaec-4960-bcd7-c740557b2328]: (4, 'raw') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:12:04 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-d7489ae6-c3a9-4112-a8dd-2ea98fe4c923 tempest-VolumeImageDependencyTests-1657937066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5209f7d6-5a8b-47c6-a8fb-d67c67976ae9_80jb7zi3devstack@QuobyteHD {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:04 devstack sudo[105322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-119db0b8-777b-4938-84af-6cb67b91aa1b Sep 17 22:12:04 devstack sudo[105322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:04 devstack sudo[105325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5209f7d6-5a8b-47c6-a8fb-d67c67976ae9_80jb7zi3devstack@QuobyteHD Sep 17 22:12:04 devstack sudo[105325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:04 devstack sudo[105320]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:04 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-111b0aae-24ec-45d5-b09e-ae503e37afb0 tempest-ProjectMemberTests-1966135882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-45b81ae0-4eee-482c-9db2-20b856cdb2a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-45b81ae0-4eee-482c-9db2-20b856cdb2a7.6e62f4a8-d778-4281-ac86-0e8c31823510 1G" returned: 0 in 0.444s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:04 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-111b0aae-24ec-45d5-b09e-ae503e37afb0 tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45b81ae0-4eee-482c-9db2-20b856cdb2a7 -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-45b81ae0-4eee-482c-9db2-20b856cdb2a7.6e62f4a8-d778-4281-ac86-0e8c31823510 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:04 devstack sudo[105330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45b81ae0-4eee-482c-9db2-20b856cdb2a7 -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-45b81ae0-4eee-482c-9db2-20b856cdb2a7.6e62f4a8-d778-4281-ac86-0e8c31823510 Sep 17 22:12:04 devstack sudo[105330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:04 devstack sudo[105322]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:04 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-5a063cc1-1ba1-4386-922f-a91241bb0175 tempest-ProjectReaderTests-1676955223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-119db0b8-777b-4938-84af-6cb67b91aa1b" returned: 0 in 0.416s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:04 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-5a063cc1-1ba1-4386-922f-a91241bb0175 tempest-ProjectReaderTests-1676955223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-119db0b8-777b-4938-84af-6cb67b91aa1b {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:04 devstack sudo[105335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-119db0b8-777b-4938-84af-6cb67b91aa1b Sep 17 22:12:04 devstack sudo[105335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:04 devstack sudo[105325]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:04 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-d7489ae6-c3a9-4112-a8dd-2ea98fe4c923 tempest-VolumeImageDependencyTests-1657937066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5209f7d6-5a8b-47c6-a8fb-d67c67976ae9_80jb7zi3devstack@QuobyteHD" returned: 0 in 0.379s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:04 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-d7489ae6-c3a9-4112-a8dd-2ea98fe4c923 tempest-VolumeImageDependencyTests-1657937066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5209f7d6-5a8b-47c6-a8fb-d67c67976ae9_80jb7zi3devstack@QuobyteHD {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:04 devstack sudo[105330]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:04 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-111b0aae-24ec-45d5-b09e-ae503e37afb0 tempest-ProjectMemberTests-1966135882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45b81ae0-4eee-482c-9db2-20b856cdb2a7 -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-45b81ae0-4eee-482c-9db2-20b856cdb2a7.6e62f4a8-d778-4281-ac86-0e8c31823510" returned: 0 in 0.301s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:04 devstack cinder-volume[85458]: WARNING cinder.volume.drivers.remotefs [None req-111b0aae-24ec-45d5-b09e-ae503e37afb0 tempest-ProjectMemberTests-1966135882 None] /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-45b81ae0-4eee-482c-9db2-20b856cdb2a7.6e62f4a8-d778-4281-ac86-0e8c31823510 is being set with open permissions: ugo+rw Sep 17 22:12:04 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-111b0aae-24ec-45d5-b09e-ae503e37afb0 tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-45b81ae0-4eee-482c-9db2-20b856cdb2a7.6e62f4a8-d778-4281-ac86-0e8c31823510 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:04 devstack sudo[105339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5209f7d6-5a8b-47c6-a8fb-d67c67976ae9_80jb7zi3devstack@QuobyteHD Sep 17 22:12:04 devstack sudo[105339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:04 devstack sudo[105343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-45b81ae0-4eee-482c-9db2-20b856cdb2a7.6e62f4a8-d778-4281-ac86-0e8c31823510 Sep 17 22:12:04 devstack sudo[105343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:04 devstack sudo[105335]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:04 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-5a063cc1-1ba1-4386-922f-a91241bb0175 tempest-ProjectReaderTests-1676955223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-119db0b8-777b-4938-84af-6cb67b91aa1b" returned: 0 in 0.271s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:04 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-5a063cc1-1ba1-4386-922f-a91241bb0175 tempest-ProjectReaderTests-1676955223 None] Lock "cinder-quobyte-119db0b8-777b-4938-84af-6cb67b91aa1b" released by "delete_volume" :: held 0.796s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:12:04 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-5a063cc1-1ba1-4386-922f-a91241bb0175 tempest-ProjectReaderTests-1676955223 None] Created reservations ['e2dc708a-4fac-44b4-ab9d-692d64a4724b', '466092e1-4173-4e0c-a99e-ca668fd0c3b3', 'baaac65e-03d0-41fb-a2cd-06c7fd6b5d06', 'ddf1a0cb-31a6-4490-957a-2df512884c51'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:12:04 devstack sudo[105339]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:04 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-d7489ae6-c3a9-4112-a8dd-2ea98fe4c923 tempest-VolumeImageDependencyTests-1657937066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5209f7d6-5a8b-47c6-a8fb-d67c67976ae9_80jb7zi3devstack@QuobyteHD" returned: 1 in 0.349s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:04 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-d7489ae6-c3a9-4112-a8dd-2ea98fe4c923 tempest-VolumeImageDependencyTests-1657937066 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5209f7d6-5a8b-47c6-a8fb-d67c67976ae9_80jb7zi3devstack@QuobyteHD' failed. Not Retrying. {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 22:12:04 devstack cinder-volume[85458]: DEBUG cinder.image.image_utils [None req-d7489ae6-c3a9-4112-a8dd-2ea98fe4c923 tempest-VolumeImageDependencyTests-1657937066 None] Temporary image 5209f7d6-5a8b-47c6-a8fb-d67c67976ae9 is fetched for user 3673505bc04a4b9c97c064e804269b41. {{(pid=85458) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 17 22:12:04 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-5a063cc1-1ba1-4386-922f-a91241bb0175 tempest-ProjectReaderTests-1676955223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:12:04 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-5a063cc1-1ba1-4386-922f-a91241bb0175 tempest-ProjectReaderTests-1676955223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:12:04 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-5a063cc1-1ba1-4386-922f-a91241bb0175 tempest-ProjectReaderTests-1676955223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:12:04 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-5a063cc1-1ba1-4386-922f-a91241bb0175 tempest-ProjectReaderTests-1676955223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:12:04 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-5a063cc1-1ba1-4386-922f-a91241bb0175 tempest-ProjectReaderTests-1676955223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:12:04 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-5a063cc1-1ba1-4386-922f-a91241bb0175 tempest-ProjectReaderTests-1676955223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:05 devstack sudo[105351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:12:05 devstack sudo[105351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:05 devstack sudo[105343]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:05 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-111b0aae-24ec-45d5-b09e-ae503e37afb0 tempest-ProjectMemberTests-1966135882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-45b81ae0-4eee-482c-9db2-20b856cdb2a7.6e62f4a8-d778-4281-ac86-0e8c31823510" returned: 0 in 0.322s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:05 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-111b0aae-24ec-45d5-b09e-ae503e37afb0 tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-45b81ae0-4eee-482c-9db2-20b856cdb2a7.info {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:05 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[20950e86-8ec1-43de-a29f-7f0562f638bd]: (4, 'raw') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:12:05 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-d7489ae6-c3a9-4112-a8dd-2ea98fe4c923 tempest-VolumeImageDependencyTests-1657937066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5209f7d6-5a8b-47c6-a8fb-d67c67976ae9_80jb7zi3devstack@QuobyteHD {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:05 devstack sudo[105353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-45b81ae0-4eee-482c-9db2-20b856cdb2a7.info Sep 17 22:12:05 devstack sudo[105353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:05 devstack sudo[105354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5209f7d6-5a8b-47c6-a8fb-d67c67976ae9_80jb7zi3devstack@QuobyteHD Sep 17 22:12:05 devstack sudo[105354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:05 devstack sudo[105351]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:05 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-5a063cc1-1ba1-4386-922f-a91241bb0175 tempest-ProjectReaderTests-1676955223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.464s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:05 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-5a063cc1-1ba1-4386-922f-a91241bb0175 tempest-ProjectReaderTests-1676955223 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:12:05 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-5a063cc1-1ba1-4386-922f-a91241bb0175 tempest-ProjectReaderTests-1676955223 None] Deleted volume successfully. Sep 17 22:12:05 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-5a063cc1-1ba1-4386-922f-a91241bb0175 tempest-ProjectReaderTests-1676955223 None] Lock "cinder-119db0b8-777b-4938-84af-6cb67b91aa1b-delete_volume" released by "delete_volume" :: held 1.661s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:12:05 devstack sudo[105354]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:05 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-d7489ae6-c3a9-4112-a8dd-2ea98fe4c923 tempest-VolumeImageDependencyTests-1657937066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5209f7d6-5a8b-47c6-a8fb-d67c67976ae9_80jb7zi3devstack@QuobyteHD" returned: 0 in 0.472s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:05 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-d7489ae6-c3a9-4112-a8dd-2ea98fe4c923 tempest-VolumeImageDependencyTests-1657937066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5209f7d6-5a8b-47c6-a8fb-d67c67976ae9_80jb7zi3devstack@QuobyteHD {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:05 devstack sudo[105353]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:05 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-111b0aae-24ec-45d5-b09e-ae503e37afb0 tempest-ProjectMemberTests-1966135882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-45b81ae0-4eee-482c-9db2-20b856cdb2a7.info" returned: 0 in 0.546s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:05 devstack cinder-volume[85458]: WARNING cinder.volume.drivers.remotefs [None req-111b0aae-24ec-45d5-b09e-ae503e37afb0 tempest-ProjectMemberTests-1966135882 None] /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-45b81ae0-4eee-482c-9db2-20b856cdb2a7.info is being set with open permissions: ugo+rw Sep 17 22:12:05 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-111b0aae-24ec-45d5-b09e-ae503e37afb0 tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-45b81ae0-4eee-482c-9db2-20b856cdb2a7.info {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:05 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-0401997e-9e26-4fb8-a839-6d9ebb677107 tempest-ProjectReaderTests-1676955223 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 22:12:05 devstack sudo[105362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-45b81ae0-4eee-482c-9db2-20b856cdb2a7.info Sep 17 22:12:05 devstack sudo[105362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:05 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-0401997e-9e26-4fb8-a839-6d9ebb677107 tempest-ProjectReaderTests-1676955223 None] Flow 'volume_create_manager' (91d06dc7-f96a-4a8f-8d82-67625a137003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:12:05 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-0401997e-9e26-4fb8-a839-6d9ebb677107 tempest-ProjectReaderTests-1676955223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85b1cdf0-a8b1-4707-a530-517f9f82a006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:12:05 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-0401997e-9e26-4fb8-a839-6d9ebb677107 tempest-ProjectReaderTests-1676955223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85b1cdf0-a8b1-4707-a530-517f9f82a006) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:12:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1420655134',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77feb279-2b95-4ce8-9262-47a34d0bea9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e4464b587ad40759679fd10b5eda168',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:12:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:12:06Z,use_quota=True,user_id='dcf31a786e3845bab1a502363d0f3482',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:12:05 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-0401997e-9e26-4fb8-a839-6d9ebb677107 tempest-ProjectReaderTests-1676955223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3af59c59-cfbb-48fa-a26d-7d6a639609b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:12:05 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-0401997e-9e26-4fb8-a839-6d9ebb677107 tempest-ProjectReaderTests-1676955223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3af59c59-cfbb-48fa-a26d-7d6a639609b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:12:05 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-0401997e-9e26-4fb8-a839-6d9ebb677107 tempest-ProjectReaderTests-1676955223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (902ac028-9e67-4ca7-9c66-55364514207a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:12:05 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-0401997e-9e26-4fb8-a839-6d9ebb677107 tempest-ProjectReaderTests-1676955223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (902ac028-9e67-4ca7-9c66-55364514207a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77feb279-2b95-4ce8-9262-47a34d0bea9b', 'volume_name': 'volume-77feb279-2b95-4ce8-9262-47a34d0bea9b', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:12:05 devstack sudo[105361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5209f7d6-5a8b-47c6-a8fb-d67c67976ae9_80jb7zi3devstack@QuobyteHD Sep 17 22:12:05 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-0401997e-9e26-4fb8-a839-6d9ebb677107 tempest-ProjectReaderTests-1676955223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08faccc6-5c2d-4795-97e8-5c666954cc3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:12:05 devstack sudo[105361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:05 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-0401997e-9e26-4fb8-a839-6d9ebb677107 tempest-ProjectReaderTests-1676955223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08faccc6-5c2d-4795-97e8-5c666954cc3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:12:05 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-0401997e-9e26-4fb8-a839-6d9ebb677107 tempest-ProjectReaderTests-1676955223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (913f2428-ed17-472d-8ae0-660e9c7bed0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:12:05 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-0401997e-9e26-4fb8-a839-6d9ebb677107 tempest-ProjectReaderTests-1676955223 None] Volume 77feb279-2b95-4ce8-9262-47a34d0bea9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77feb279-2b95-4ce8-9262-47a34d0bea9b', 'volume_size': 1} Sep 17 22:12:05 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-0401997e-9e26-4fb8-a839-6d9ebb677107 tempest-ProjectReaderTests-1676955223 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:12:05 devstack sudo[105362]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:05 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-111b0aae-24ec-45d5-b09e-ae503e37afb0 tempest-ProjectMemberTests-1966135882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-45b81ae0-4eee-482c-9db2-20b856cdb2a7.info" returned: 0 in 0.287s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:05 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-111b0aae-24ec-45d5-b09e-ae503e37afb0 tempest-ProjectMemberTests-1966135882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.575s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:12:05 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-0401997e-9e26-4fb8-a839-6d9ebb677107 tempest-ProjectReaderTests-1676955223 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.222s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:12:05 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-0401997e-9e26-4fb8-a839-6d9ebb677107 tempest-ProjectReaderTests-1676955223 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:12:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1420655134',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77feb279-2b95-4ce8-9262-47a34d0bea9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e4464b587ad40759679fd10b5eda168',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:12:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:12:06Z,use_quota=True,user_id='dcf31a786e3845bab1a502363d0f3482',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 22:12:05 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-0401997e-9e26-4fb8-a839-6d9ebb677107 tempest-ProjectReaderTests-1676955223 None] Creating volume 77feb279-2b95-4ce8-9262-47a34d0bea9b {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 22:12:05 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-0401997e-9e26-4fb8-a839-6d9ebb677107 tempest-ProjectReaderTests-1676955223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:12:05 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-0401997e-9e26-4fb8-a839-6d9ebb677107 tempest-ProjectReaderTests-1676955223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:12:05 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-0401997e-9e26-4fb8-a839-6d9ebb677107 tempest-ProjectReaderTests-1676955223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:12:05 devstack sudo[105361]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:05 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-0401997e-9e26-4fb8-a839-6d9ebb677107 tempest-ProjectReaderTests-1676955223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:12:05 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-0401997e-9e26-4fb8-a839-6d9ebb677107 tempest-ProjectReaderTests-1676955223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:12:05 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-0401997e-9e26-4fb8-a839-6d9ebb677107 tempest-ProjectReaderTests-1676955223 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 22:12:05 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-0401997e-9e26-4fb8-a839-6d9ebb677107 tempest-ProjectReaderTests-1676955223 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 22:12:05 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-0401997e-9e26-4fb8-a839-6d9ebb677107 tempest-ProjectReaderTests-1676955223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-77feb279-2b95-4ce8-9262-47a34d0bea9b 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:05 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-d7489ae6-c3a9-4112-a8dd-2ea98fe4c923 tempest-VolumeImageDependencyTests-1657937066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5209f7d6-5a8b-47c6-a8fb-d67c67976ae9_80jb7zi3devstack@QuobyteHD" returned: 1 in 0.396s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:05 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-d7489ae6-c3a9-4112-a8dd-2ea98fe4c923 tempest-VolumeImageDependencyTests-1657937066 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5209f7d6-5a8b-47c6-a8fb-d67c67976ae9_80jb7zi3devstack@QuobyteHD' failed. Not Retrying. {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 22:12:05 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-d7489ae6-c3a9-4112-a8dd-2ea98fe4c923 tempest-VolumeImageDependencyTests-1657937066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:12:05 devstack sudo[105369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-77feb279-2b95-4ce8-9262-47a34d0bea9b 1073741824 Sep 17 22:12:05 devstack sudo[105369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:06 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-111b0aae-24ec-45d5-b09e-ae503e37afb0 tempest-ProjectMemberTests-1966135882 None] Create snapshot completed successfully Sep 17 22:12:06 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-2c52f92a-ecea-4617-95aa-cd32370f6e25 tempest-ProjectMemberTests-1966135882 None] Acquiring lock "cinder-6e62f4a8-d778-4281-ac86-0e8c31823510-delete_snapshot" by "delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:12:06 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-2c52f92a-ecea-4617-95aa-cd32370f6e25 tempest-ProjectMemberTests-1966135882 None] Lock "cinder-6e62f4a8-d778-4281-ac86-0e8c31823510-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:12:06 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-2c52f92a-ecea-4617-95aa-cd32370f6e25 tempest-ProjectMemberTests-1966135882 None] Acquiring lock "cinder-quobyte-45b81ae0-4eee-482c-9db2-20b856cdb2a7" by "delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:12:06 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-2c52f92a-ecea-4617-95aa-cd32370f6e25 tempest-ProjectMemberTests-1966135882 None] Lock "cinder-quobyte-45b81ae0-4eee-482c-9db2-20b856cdb2a7" acquired by "delete_snapshot" :: waited 0.022s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:12:06 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-2c52f92a-ecea-4617-95aa-cd32370f6e25 tempest-ProjectMemberTests-1966135882 None] Acquiring lock "cinder-quobyte-6e62f4a8-d778-4281-ac86-0e8c31823510" by "_delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:12:06 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-2c52f92a-ecea-4617-95aa-cd32370f6e25 tempest-ProjectMemberTests-1966135882 None] Lock "cinder-quobyte-6e62f4a8-d778-4281-ac86-0e8c31823510" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:12:06 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-2c52f92a-ecea-4617-95aa-cd32370f6e25 tempest-ProjectMemberTests-1966135882 None] Deleting offline snapshot 6e62f4a8-d778-4281-ac86-0e8c31823510 of volume 45b81ae0-4eee-482c-9db2-20b856cdb2a7 {{(pid=85458) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 22:12:06 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-2c52f92a-ecea-4617-95aa-cd32370f6e25 tempest-ProjectMemberTests-1966135882 None] snapshot_file for this snap is: volume-45b81ae0-4eee-482c-9db2-20b856cdb2a7.6e62f4a8-d778-4281-ac86-0e8c31823510 {{(pid=85458) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 22:12:06 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ad7e31d-9451-467e-9be4-f9b235c0df5d]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:12:06 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-2c52f92a-ecea-4617-95aa-cd32370f6e25 tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-45b81ae0-4eee-482c-9db2-20b856cdb2a7.6e62f4a8-d778-4281-ac86-0e8c31823510 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:06 devstack sudo[105369]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:06 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-0401997e-9e26-4fb8-a839-6d9ebb677107 tempest-ProjectReaderTests-1676955223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-77feb279-2b95-4ce8-9262-47a34d0bea9b 1073741824" returned: 0 in 0.491s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:06 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-0401997e-9e26-4fb8-a839-6d9ebb677107 tempest-ProjectReaderTests-1676955223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-77feb279-2b95-4ce8-9262-47a34d0bea9b {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:06 devstack sudo[105375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-45b81ae0-4eee-482c-9db2-20b856cdb2a7.6e62f4a8-d778-4281-ac86-0e8c31823510 Sep 17 22:12:06 devstack sudo[105375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:06 devstack sudo[105376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-77feb279-2b95-4ce8-9262-47a34d0bea9b Sep 17 22:12:06 devstack sudo[105376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:06 devstack sudo[105375]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:06 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-2c52f92a-ecea-4617-95aa-cd32370f6e25 tempest-ProjectMemberTests-1966135882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-45b81ae0-4eee-482c-9db2-20b856cdb2a7.6e62f4a8-d778-4281-ac86-0e8c31823510" returned: 0 in 0.379s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:06 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-2c52f92a-ecea-4617-95aa-cd32370f6e25 tempest-ProjectMemberTests-1966135882 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-45b81ae0-4eee-482c-9db2-20b856cdb2a7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85458) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 22:12:06 devstack sudo[105376]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:06 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-0401997e-9e26-4fb8-a839-6d9ebb677107 tempest-ProjectReaderTests-1676955223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-77feb279-2b95-4ce8-9262-47a34d0bea9b" returned: 0 in 0.289s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:06 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-0401997e-9e26-4fb8-a839-6d9ebb677107 tempest-ProjectReaderTests-1676955223 None] <== create_volume: return (824ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 22:12:06 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-0401997e-9e26-4fb8-a839-6d9ebb677107 tempest-ProjectReaderTests-1676955223 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.828s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:12:06 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-d7489ae6-c3a9-4112-a8dd-2ea98fe4c923 tempest-VolumeImageDependencyTests-1657937066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.793s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:12:06 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-d7489ae6-c3a9-4112-a8dd-2ea98fe4c923 tempest-VolumeImageDependencyTests-1657937066 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:12:03Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e1e31d5-0763-4b4c-922d-d34af4dff4d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6dc5792a6f744fd91bbf3ffb448340b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:12:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:12:03Z,use_quota=True,user_id='3673505bc04a4b9c97c064e804269b41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 22:12:06 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-d7489ae6-c3a9-4112-a8dd-2ea98fe4c923 tempest-VolumeImageDependencyTests-1657937066 None] Creating volume 2e1e31d5-0763-4b4c-922d-d34af4dff4d1 {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 22:12:06 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-d7489ae6-c3a9-4112-a8dd-2ea98fe4c923 tempest-VolumeImageDependencyTests-1657937066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:12:06 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-d7489ae6-c3a9-4112-a8dd-2ea98fe4c923 tempest-VolumeImageDependencyTests-1657937066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:12:06 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-d7489ae6-c3a9-4112-a8dd-2ea98fe4c923 tempest-VolumeImageDependencyTests-1657937066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:12:06 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-d7489ae6-c3a9-4112-a8dd-2ea98fe4c923 tempest-VolumeImageDependencyTests-1657937066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:12:06 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-d7489ae6-c3a9-4112-a8dd-2ea98fe4c923 tempest-VolumeImageDependencyTests-1657937066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:12:06 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-d7489ae6-c3a9-4112-a8dd-2ea98fe4c923 tempest-VolumeImageDependencyTests-1657937066 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 22:12:06 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-d7489ae6-c3a9-4112-a8dd-2ea98fe4c923 tempest-VolumeImageDependencyTests-1657937066 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 22:12:06 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-d7489ae6-c3a9-4112-a8dd-2ea98fe4c923 tempest-VolumeImageDependencyTests-1657937066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-2e1e31d5-0763-4b4c-922d-d34af4dff4d1 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:06 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[a54e5251-eba7-45eb-be0b-db98b80e976d]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:12:06 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-2c52f92a-ecea-4617-95aa-cd32370f6e25 tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-45b81ae0-4eee-482c-9db2-20b856cdb2a7 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:06 devstack sudo[105383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-2e1e31d5-0763-4b4c-922d-d34af4dff4d1 1073741824 Sep 17 22:12:06 devstack sudo[105383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:06 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-0401997e-9e26-4fb8-a839-6d9ebb677107 tempest-ProjectReaderTests-1676955223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (913f2428-ed17-472d-8ae0-660e9c7bed0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77feb279-2b95-4ce8-9262-47a34d0bea9b', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:12:06 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-0401997e-9e26-4fb8-a839-6d9ebb677107 tempest-ProjectReaderTests-1676955223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73cf98a6-8da0-43df-aee0-481a8ce88e82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:12:06 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-0401997e-9e26-4fb8-a839-6d9ebb677107 tempest-ProjectReaderTests-1676955223 None] Volume volume-77feb279-2b95-4ce8-9262-47a34d0bea9b (77feb279-2b95-4ce8-9262-47a34d0bea9b): created successfully Sep 17 22:12:06 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-0401997e-9e26-4fb8-a839-6d9ebb677107 tempest-ProjectReaderTests-1676955223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73cf98a6-8da0-43df-aee0-481a8ce88e82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:12:06 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-0401997e-9e26-4fb8-a839-6d9ebb677107 tempest-ProjectReaderTests-1676955223 None] Flow 'volume_create_manager' (91d06dc7-f96a-4a8f-8d82-67625a137003) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:12:06 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-0401997e-9e26-4fb8-a839-6d9ebb677107 tempest-ProjectReaderTests-1676955223 None] Created volume successfully. Sep 17 22:12:06 devstack sudo[105384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-45b81ae0-4eee-482c-9db2-20b856cdb2a7 Sep 17 22:12:06 devstack sudo[105384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:07 devstack sudo[105384]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:07 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-2c52f92a-ecea-4617-95aa-cd32370f6e25 tempest-ProjectMemberTests-1966135882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-45b81ae0-4eee-482c-9db2-20b856cdb2a7" returned: 0 in 0.402s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:07 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-2c52f92a-ecea-4617-95aa-cd32370f6e25 tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-45b81ae0-4eee-482c-9db2-20b856cdb2a7.6e62f4a8-d778-4281-ac86-0e8c31823510 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:07 devstack sudo[105394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-45b81ae0-4eee-482c-9db2-20b856cdb2a7.6e62f4a8-d778-4281-ac86-0e8c31823510 Sep 17 22:12:07 devstack sudo[105394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:07 devstack sudo[105383]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:07 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-d7489ae6-c3a9-4112-a8dd-2ea98fe4c923 tempest-VolumeImageDependencyTests-1657937066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-2e1e31d5-0763-4b4c-922d-d34af4dff4d1 1073741824" returned: 0 in 0.508s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:07 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-d7489ae6-c3a9-4112-a8dd-2ea98fe4c923 tempest-VolumeImageDependencyTests-1657937066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-2e1e31d5-0763-4b4c-922d-d34af4dff4d1 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:07 devstack sudo[105396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-2e1e31d5-0763-4b4c-922d-d34af4dff4d1 Sep 17 22:12:07 devstack sudo[105396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:07 devstack sudo[105394]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:07 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-2c52f92a-ecea-4617-95aa-cd32370f6e25 tempest-ProjectMemberTests-1966135882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-45b81ae0-4eee-482c-9db2-20b856cdb2a7.6e62f4a8-d778-4281-ac86-0e8c31823510" returned: 0 in 0.389s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:07 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-2c52f92a-ecea-4617-95aa-cd32370f6e25 tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-45b81ae0-4eee-482c-9db2-20b856cdb2a7.6e62f4a8-d778-4281-ac86-0e8c31823510 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:07 devstack sudo[105403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-45b81ae0-4eee-482c-9db2-20b856cdb2a7.6e62f4a8-d778-4281-ac86-0e8c31823510 Sep 17 22:12:07 devstack sudo[105403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:07 devstack sudo[105396]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:07 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-d7489ae6-c3a9-4112-a8dd-2ea98fe4c923 tempest-VolumeImageDependencyTests-1657937066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-2e1e31d5-0763-4b4c-922d-d34af4dff4d1" returned: 0 in 0.315s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:07 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-d7489ae6-c3a9-4112-a8dd-2ea98fe4c923 tempest-VolumeImageDependencyTests-1657937066 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 22:12:07 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-d7489ae6-c3a9-4112-a8dd-2ea98fe4c923 tempest-VolumeImageDependencyTests-1657937066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.899s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:12:07 devstack cinder-volume[85458]: DEBUG cinder.volume.volume_utils [None req-d7489ae6-c3a9-4112-a8dd-2ea98fe4c923 tempest-VolumeImageDependencyTests-1657937066 None] Attempting download of 5209f7d6-5a8b-47c6-a8fb-d67c67976ae9 ((None, [{'url': 'file:///opt/stack/data/glance/images/5209f7d6-5a8b-47c6-a8fb-d67c67976ae9', 'metadata': {}}])) to volume 2e1e31d5-0763-4b4c-922d-d34af4dff4d1. {{(pid=85458) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 17 22:12:07 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[558a3e83-e919-4899-bce6-51bbf43bbf67]: (4, 'raw') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:12:07 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-d7489ae6-c3a9-4112-a8dd-2ea98fe4c923 tempest-VolumeImageDependencyTests-1657937066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5209f7d6-5a8b-47c6-a8fb-d67c67976ae9_map2ja0c {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:07 devstack sudo[105403]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:07 devstack sudo[105405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5209f7d6-5a8b-47c6-a8fb-d67c67976ae9_map2ja0c Sep 17 22:12:07 devstack sudo[105405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:07 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-2c52f92a-ecea-4617-95aa-cd32370f6e25 tempest-ProjectMemberTests-1966135882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-45b81ae0-4eee-482c-9db2-20b856cdb2a7.6e62f4a8-d778-4281-ac86-0e8c31823510" returned: 0 in 0.350s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:07 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-2c52f92a-ecea-4617-95aa-cd32370f6e25 tempest-ProjectMemberTests-1966135882 None] Lock "cinder-quobyte-6e62f4a8-d778-4281-ac86-0e8c31823510" released by "_delete_snapshot" :: held 1.651s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:12:07 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-24f58694-62e5-46ea-9126-000ceb3e1056 tempest-ProjectReaderTests-1676955223 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:12:07 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-24f58694-62e5-46ea-9126-000ceb3e1056 tempest-ProjectReaderTests-1676955223 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:12:08 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-2c52f92a-ecea-4617-95aa-cd32370f6e25 tempest-ProjectMemberTests-1966135882 None] Lock "cinder-quobyte-45b81ae0-4eee-482c-9db2-20b856cdb2a7" released by "delete_snapshot" :: held 1.680s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:12:08 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-24f58694-62e5-46ea-9126-000ceb3e1056 tempest-ProjectReaderTests-1676955223 None] Creating offline snapshot 942abedd-e0db-4bb8-931a-acf0c5c63b20 of volume 77feb279-2b95-4ce8-9262-47a34d0bea9b {{(pid=85458) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 22:12:08 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[5199c8fc-80fe-40dd-a816-01b636d0ccc9]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:12:08 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-24f58694-62e5-46ea-9126-000ceb3e1056 tempest-ProjectReaderTests-1676955223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-77feb279-2b95-4ce8-9262-47a34d0bea9b {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:08 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-2c52f92a-ecea-4617-95aa-cd32370f6e25 tempest-ProjectMemberTests-1966135882 None] Created reservations ['247019aa-a693-4130-b55f-e47bb7070be4', 'dad10985-cca3-4cf0-a3bf-cd576e572a3c', 'd683ef80-2a5a-4b8f-86ab-44fa79edbc0a', 'c1d87653-d6e0-42ce-b5ca-292abb7ad6a4'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:12:08 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-2c52f92a-ecea-4617-95aa-cd32370f6e25 tempest-ProjectMemberTests-1966135882 None] Delete snapshot completed successfully. Sep 17 22:12:08 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-2c52f92a-ecea-4617-95aa-cd32370f6e25 tempest-ProjectMemberTests-1966135882 None] Lock "cinder-6e62f4a8-d778-4281-ac86-0e8c31823510-delete_snapshot" released by "delete_snapshot" :: held 1.884s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:12:08 devstack sudo[105408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-77feb279-2b95-4ce8-9262-47a34d0bea9b Sep 17 22:12:08 devstack sudo[105408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:08 devstack sudo[105405]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:08 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-d7489ae6-c3a9-4112-a8dd-2ea98fe4c923 tempest-VolumeImageDependencyTests-1657937066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5209f7d6-5a8b-47c6-a8fb-d67c67976ae9_map2ja0c" returned: 0 in 0.420s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:08 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-d7489ae6-c3a9-4112-a8dd-2ea98fe4c923 tempest-VolumeImageDependencyTests-1657937066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5209f7d6-5a8b-47c6-a8fb-d67c67976ae9_map2ja0c {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:08 devstack sudo[105412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5209f7d6-5a8b-47c6-a8fb-d67c67976ae9_map2ja0c Sep 17 22:12:08 devstack sudo[105412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:08 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-b4a4d429-e557-4b13-8973-1be160e79e32 tempest-ProjectMemberTests-1966135882 None] Acquiring lock "cinder-45b81ae0-4eee-482c-9db2-20b856cdb2a7-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:12:08 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-b4a4d429-e557-4b13-8973-1be160e79e32 tempest-ProjectMemberTests-1966135882 None] Lock "cinder-45b81ae0-4eee-482c-9db2-20b856cdb2a7-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:12:08 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-b4a4d429-e557-4b13-8973-1be160e79e32 tempest-ProjectMemberTests-1966135882 None] Acquiring lock "cinder-quobyte-45b81ae0-4eee-482c-9db2-20b856cdb2a7" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:12:08 devstack sudo[105412]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:08 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-b4a4d429-e557-4b13-8973-1be160e79e32 tempest-ProjectMemberTests-1966135882 None] Lock "cinder-quobyte-45b81ae0-4eee-482c-9db2-20b856cdb2a7" acquired by "delete_volume" :: waited 0.018s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:12:08 devstack sudo[105408]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:08 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-d7489ae6-c3a9-4112-a8dd-2ea98fe4c923 tempest-VolumeImageDependencyTests-1657937066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5209f7d6-5a8b-47c6-a8fb-d67c67976ae9_map2ja0c" returned: 1 in 0.488s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:08 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-d7489ae6-c3a9-4112-a8dd-2ea98fe4c923 tempest-VolumeImageDependencyTests-1657937066 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5209f7d6-5a8b-47c6-a8fb-d67c67976ae9_map2ja0c' failed. Not Retrying. {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 22:12:08 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-24f58694-62e5-46ea-9126-000ceb3e1056 tempest-ProjectReaderTests-1676955223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-77feb279-2b95-4ce8-9262-47a34d0bea9b" returned: 0 in 0.653s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:08 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-24f58694-62e5-46ea-9126-000ceb3e1056 tempest-ProjectReaderTests-1676955223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-77feb279-2b95-4ce8-9262-47a34d0bea9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-77feb279-2b95-4ce8-9262-47a34d0bea9b.942abedd-e0db-4bb8-931a-acf0c5c63b20 1G {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:08 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[c86e1775-2ed6-48b9-b87f-ee087a7030b4]: (4, 'raw') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:12:08 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-d7489ae6-c3a9-4112-a8dd-2ea98fe4c923 tempest-VolumeImageDependencyTests-1657937066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5209f7d6-5a8b-47c6-a8fb-d67c67976ae9_80jb7zi3devstack@QuobyteHD {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:08 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[7682c8ad-f42f-4175-a0d2-b750622eb503]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:12:08 devstack sudo[105419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-77feb279-2b95-4ce8-9262-47a34d0bea9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-77feb279-2b95-4ce8-9262-47a34d0bea9b.942abedd-e0db-4bb8-931a-acf0c5c63b20 1G Sep 17 22:12:08 devstack sudo[105419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:08 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-b4a4d429-e557-4b13-8973-1be160e79e32 tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-45b81ae0-4eee-482c-9db2-20b856cdb2a7 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:08 devstack sudo[105420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5209f7d6-5a8b-47c6-a8fb-d67c67976ae9_80jb7zi3devstack@QuobyteHD Sep 17 22:12:08 devstack sudo[105420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:08 devstack sudo[105422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-45b81ae0-4eee-482c-9db2-20b856cdb2a7 Sep 17 22:12:08 devstack sudo[105422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:09 devstack sudo[105420]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:09 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-d7489ae6-c3a9-4112-a8dd-2ea98fe4c923 tempest-VolumeImageDependencyTests-1657937066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5209f7d6-5a8b-47c6-a8fb-d67c67976ae9_80jb7zi3devstack@QuobyteHD" returned: 0 in 0.415s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:09 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-d7489ae6-c3a9-4112-a8dd-2ea98fe4c923 tempest-VolumeImageDependencyTests-1657937066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5209f7d6-5a8b-47c6-a8fb-d67c67976ae9_80jb7zi3devstack@QuobyteHD {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:09 devstack sudo[105422]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:09 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-b4a4d429-e557-4b13-8973-1be160e79e32 tempest-ProjectMemberTests-1966135882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-45b81ae0-4eee-482c-9db2-20b856cdb2a7" returned: 0 in 0.445s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:09 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-b4a4d429-e557-4b13-8973-1be160e79e32 tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-45b81ae0-4eee-482c-9db2-20b856cdb2a7 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:09 devstack sudo[105435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-45b81ae0-4eee-482c-9db2-20b856cdb2a7 Sep 17 22:12:09 devstack sudo[105435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:09 devstack sudo[105419]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:09 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-24f58694-62e5-46ea-9126-000ceb3e1056 tempest-ProjectReaderTests-1676955223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-77feb279-2b95-4ce8-9262-47a34d0bea9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-77feb279-2b95-4ce8-9262-47a34d0bea9b.942abedd-e0db-4bb8-931a-acf0c5c63b20 1G" returned: 0 in 0.526s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:09 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-24f58694-62e5-46ea-9126-000ceb3e1056 tempest-ProjectReaderTests-1676955223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77feb279-2b95-4ce8-9262-47a34d0bea9b -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-77feb279-2b95-4ce8-9262-47a34d0bea9b.942abedd-e0db-4bb8-931a-acf0c5c63b20 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:09 devstack sudo[105437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77feb279-2b95-4ce8-9262-47a34d0bea9b -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-77feb279-2b95-4ce8-9262-47a34d0bea9b.942abedd-e0db-4bb8-931a-acf0c5c63b20 Sep 17 22:12:09 devstack sudo[105437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:09 devstack sudo[105434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5209f7d6-5a8b-47c6-a8fb-d67c67976ae9_80jb7zi3devstack@QuobyteHD Sep 17 22:12:09 devstack sudo[105434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:09 devstack sudo[105435]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:09 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-b4a4d429-e557-4b13-8973-1be160e79e32 tempest-ProjectMemberTests-1966135882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-45b81ae0-4eee-482c-9db2-20b856cdb2a7" returned: 0 in 0.290s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:09 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-b4a4d429-e557-4b13-8973-1be160e79e32 tempest-ProjectMemberTests-1966135882 None] Lock "cinder-quobyte-45b81ae0-4eee-482c-9db2-20b856cdb2a7" released by "delete_volume" :: held 0.832s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:12:09 devstack sudo[105434]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:09 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-d7489ae6-c3a9-4112-a8dd-2ea98fe4c923 tempest-VolumeImageDependencyTests-1657937066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5209f7d6-5a8b-47c6-a8fb-d67c67976ae9_80jb7zi3devstack@QuobyteHD" returned: 1 in 0.412s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:09 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-d7489ae6-c3a9-4112-a8dd-2ea98fe4c923 tempest-VolumeImageDependencyTests-1657937066 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5209f7d6-5a8b-47c6-a8fb-d67c67976ae9_80jb7zi3devstack@QuobyteHD' failed. Not Retrying. {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 22:12:09 devstack cinder-volume[85458]: DEBUG cinder.image.image_utils [None req-d7489ae6-c3a9-4112-a8dd-2ea98fe4c923 tempest-VolumeImageDependencyTests-1657937066 None] 5209f7d6-5a8b-47c6-a8fb-d67c67976ae9 was raw, converting to qcow2 {{(pid=85458) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 17 22:12:09 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-d7489ae6-c3a9-4112-a8dd-2ea98fe4c923 tempest-VolumeImageDependencyTests-1657937066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_5209f7d6-5a8b-47c6-a8fb-d67c67976ae9_80jb7zi3devstack@QuobyteHD /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-2e1e31d5-0763-4b4c-922d-d34af4dff4d1 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:09 devstack sudo[105447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_5209f7d6-5a8b-47c6-a8fb-d67c67976ae9_80jb7zi3devstack@QuobyteHD /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-2e1e31d5-0763-4b4c-922d-d34af4dff4d1 Sep 17 22:12:09 devstack sudo[105447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:09 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-b4a4d429-e557-4b13-8973-1be160e79e32 tempest-ProjectMemberTests-1966135882 None] Created reservations ['2874f810-ef02-42bd-8307-ab2c281f4f25', '9e686a58-7aac-41b1-92c2-f2b93d6a289b', '779fadfe-83ce-4b00-9012-70c94b91cd64', 'b435ba17-f9b6-4e83-a927-94bd69ef68aa'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:12:09 devstack sudo[105437]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:09 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-24f58694-62e5-46ea-9126-000ceb3e1056 tempest-ProjectReaderTests-1676955223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77feb279-2b95-4ce8-9262-47a34d0bea9b -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-77feb279-2b95-4ce8-9262-47a34d0bea9b.942abedd-e0db-4bb8-931a-acf0c5c63b20" returned: 0 in 0.404s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:09 devstack cinder-volume[85458]: WARNING cinder.volume.drivers.remotefs [None req-24f58694-62e5-46ea-9126-000ceb3e1056 tempest-ProjectReaderTests-1676955223 None] /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-77feb279-2b95-4ce8-9262-47a34d0bea9b.942abedd-e0db-4bb8-931a-acf0c5c63b20 is being set with open permissions: ugo+rw Sep 17 22:12:09 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-24f58694-62e5-46ea-9126-000ceb3e1056 tempest-ProjectReaderTests-1676955223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-77feb279-2b95-4ce8-9262-47a34d0bea9b.942abedd-e0db-4bb8-931a-acf0c5c63b20 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:09 devstack sudo[105450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-77feb279-2b95-4ce8-9262-47a34d0bea9b.942abedd-e0db-4bb8-931a-acf0c5c63b20 Sep 17 22:12:09 devstack sudo[105450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:09 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-b4a4d429-e557-4b13-8973-1be160e79e32 tempest-ProjectMemberTests-1966135882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:12:09 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-b4a4d429-e557-4b13-8973-1be160e79e32 tempest-ProjectMemberTests-1966135882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:12:09 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-b4a4d429-e557-4b13-8973-1be160e79e32 tempest-ProjectMemberTests-1966135882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:12:09 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-b4a4d429-e557-4b13-8973-1be160e79e32 tempest-ProjectMemberTests-1966135882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:12:09 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-b4a4d429-e557-4b13-8973-1be160e79e32 tempest-ProjectMemberTests-1966135882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:12:09 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-b4a4d429-e557-4b13-8973-1be160e79e32 tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:09 devstack sudo[105452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:12:09 devstack sudo[105452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:09 devstack sudo[105450]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:09 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-24f58694-62e5-46ea-9126-000ceb3e1056 tempest-ProjectReaderTests-1676955223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-77feb279-2b95-4ce8-9262-47a34d0bea9b.942abedd-e0db-4bb8-931a-acf0c5c63b20" returned: 0 in 0.364s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:10 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-24f58694-62e5-46ea-9126-000ceb3e1056 tempest-ProjectReaderTests-1676955223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-77feb279-2b95-4ce8-9262-47a34d0bea9b.info {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:10 devstack sudo[105460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-77feb279-2b95-4ce8-9262-47a34d0bea9b.info Sep 17 22:12:10 devstack sudo[105460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:10 devstack sudo[105452]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:10 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-b4a4d429-e557-4b13-8973-1be160e79e32 tempest-ProjectMemberTests-1966135882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.360s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:10 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-b4a4d429-e557-4b13-8973-1be160e79e32 tempest-ProjectMemberTests-1966135882 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:12:10 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-b4a4d429-e557-4b13-8973-1be160e79e32 tempest-ProjectMemberTests-1966135882 None] Deleted volume successfully. Sep 17 22:12:10 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-b4a4d429-e557-4b13-8973-1be160e79e32 tempest-ProjectMemberTests-1966135882 None] Lock "cinder-45b81ae0-4eee-482c-9db2-20b856cdb2a7-delete_volume" released by "delete_volume" :: held 1.537s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:12:10 devstack sudo[105447]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:10 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-d7489ae6-c3a9-4112-a8dd-2ea98fe4c923 tempest-VolumeImageDependencyTests-1657937066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_5209f7d6-5a8b-47c6-a8fb-d67c67976ae9_80jb7zi3devstack@QuobyteHD /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-2e1e31d5-0763-4b4c-922d-d34af4dff4d1" returned: 0 in 0.701s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:10 devstack cinder-volume[85458]: DEBUG cinder.image.image_utils [None req-d7489ae6-c3a9-4112-a8dd-2ea98fe4c923 tempest-VolumeImageDependencyTests-1657937066 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5209f7d6-5a8b-47c6-a8fb-d67c67976ae9_80jb7zi3devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-2e1e31d5-0763-4b4c-922d-d34af4dff4d1 {{(pid=85458) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 17 22:12:10 devstack cinder-volume[85458]: INFO cinder.image.image_utils [None req-d7489ae6-c3a9-4112-a8dd-2ea98fe4c923 tempest-VolumeImageDependencyTests-1657937066 None] Converted 0.00 MB image at 0.00 MB/s Sep 17 22:12:10 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-d7489ae6-c3a9-4112-a8dd-2ea98fe4c923 tempest-VolumeImageDependencyTests-1657937066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-2e1e31d5-0763-4b4c-922d-d34af4dff4d1 1G {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:10 devstack sudo[105462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-2e1e31d5-0763-4b4c-922d-d34af4dff4d1 1G Sep 17 22:12:10 devstack sudo[105462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:10 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6548c7a-8689-4e7e-9add-fa5c67a7afbe tempest-ProjectMemberTests-1966135882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 22:12:10 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-a6548c7a-8689-4e7e-9add-fa5c67a7afbe tempest-ProjectMemberTests-1966135882 None] Flow 'volume_create_manager' (4ee85344-1f2c-4af9-bcbc-656e5ed30901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:12:10 devstack sudo[105460]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:10 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-a6548c7a-8689-4e7e-9add-fa5c67a7afbe tempest-ProjectMemberTests-1966135882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa953ed4-db80-4778-acda-d84349aaedd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:12:10 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-24f58694-62e5-46ea-9126-000ceb3e1056 tempest-ProjectReaderTests-1676955223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-77feb279-2b95-4ce8-9262-47a34d0bea9b.info" returned: 0 in 0.377s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:10 devstack cinder-volume[85458]: WARNING cinder.volume.drivers.remotefs [None req-24f58694-62e5-46ea-9126-000ceb3e1056 tempest-ProjectReaderTests-1676955223 None] /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-77feb279-2b95-4ce8-9262-47a34d0bea9b.info is being set with open permissions: ugo+rw Sep 17 22:12:10 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-24f58694-62e5-46ea-9126-000ceb3e1056 tempest-ProjectReaderTests-1676955223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-77feb279-2b95-4ce8-9262-47a34d0bea9b.info {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:10 devstack sudo[105465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-77feb279-2b95-4ce8-9262-47a34d0bea9b.info Sep 17 22:12:10 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-a6548c7a-8689-4e7e-9add-fa5c67a7afbe tempest-ProjectMemberTests-1966135882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa953ed4-db80-4778-acda-d84349aaedd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:12:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1396248761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=238721b9-a402-422b-b8ef-911c9f28b1b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f277f501a340474ca5d0daea12e88955',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:12:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:12:10Z,use_quota=True,user_id='e584775bfb3c440aa7aac369d15efa55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:12:10 devstack sudo[105465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:10 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-a6548c7a-8689-4e7e-9add-fa5c67a7afbe tempest-ProjectMemberTests-1966135882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb35afa9-fcef-418e-ac34-f1b316ccd48f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:12:10 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-a6548c7a-8689-4e7e-9add-fa5c67a7afbe tempest-ProjectMemberTests-1966135882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb35afa9-fcef-418e-ac34-f1b316ccd48f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:12:10 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-a6548c7a-8689-4e7e-9add-fa5c67a7afbe tempest-ProjectMemberTests-1966135882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7b108f1-d99b-408a-8510-9f7674de60a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:12:10 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-a6548c7a-8689-4e7e-9add-fa5c67a7afbe tempest-ProjectMemberTests-1966135882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7b108f1-d99b-408a-8510-9f7674de60a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '238721b9-a402-422b-b8ef-911c9f28b1b4', 'volume_name': 'volume-238721b9-a402-422b-b8ef-911c9f28b1b4', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:12:10 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-a6548c7a-8689-4e7e-9add-fa5c67a7afbe tempest-ProjectMemberTests-1966135882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a53b8c1-c505-419e-a00e-5729034c1aee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:12:10 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-a6548c7a-8689-4e7e-9add-fa5c67a7afbe tempest-ProjectMemberTests-1966135882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a53b8c1-c505-419e-a00e-5729034c1aee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:12:10 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-a6548c7a-8689-4e7e-9add-fa5c67a7afbe tempest-ProjectMemberTests-1966135882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09f4b4b4-bf61-4a62-983d-d9a33015b97f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:12:10 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-a6548c7a-8689-4e7e-9add-fa5c67a7afbe tempest-ProjectMemberTests-1966135882 None] Volume 238721b9-a402-422b-b8ef-911c9f28b1b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-238721b9-a402-422b-b8ef-911c9f28b1b4', 'volume_size': 1} Sep 17 22:12:10 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-a6548c7a-8689-4e7e-9add-fa5c67a7afbe tempest-ProjectMemberTests-1966135882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:12:10 devstack sudo[105462]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:10 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-d7489ae6-c3a9-4112-a8dd-2ea98fe4c923 tempest-VolumeImageDependencyTests-1657937066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-2e1e31d5-0763-4b4c-922d-d34af4dff4d1 1G" returned: 0 in 0.400s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:10 devstack cinder-volume[85458]: DEBUG cinder.volume.volume_utils [None req-d7489ae6-c3a9-4112-a8dd-2ea98fe4c923 tempest-VolumeImageDependencyTests-1657937066 None] Downloaded image 5209f7d6-5a8b-47c6-a8fb-d67c67976ae9 ((None, [{'url': 'file:///opt/stack/data/glance/images/5209f7d6-5a8b-47c6-a8fb-d67c67976ae9', 'metadata': {}}])) to volume 2e1e31d5-0763-4b4c-922d-d34af4dff4d1 successfully. {{(pid=85458) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 17 22:12:10 devstack cinder-volume[85458]: DEBUG cinder.image.image_utils [None req-d7489ae6-c3a9-4112-a8dd-2ea98fe4c923 tempest-VolumeImageDependencyTests-1657937066 None] Temporary image 5209f7d6-5a8b-47c6-a8fb-d67c67976ae9 for user 3673505bc04a4b9c97c064e804269b41 is deleted. {{(pid=85458) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 17 22:12:10 devstack cinder-volume[85458]: DEBUG cinder.volume.volume_utils [None req-d7489ae6-c3a9-4112-a8dd-2ea98fe4c923 tempest-VolumeImageDependencyTests-1657937066 None] Marking volume 2e1e31d5-0763-4b4c-922d-d34af4dff4d1 as bootable. {{(pid=85458) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 17 22:12:10 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7489ae6-c3a9-4112-a8dd-2ea98fe4c923 tempest-VolumeImageDependencyTests-1657937066 None] Copying metadata from image 5209f7d6-5a8b-47c6-a8fb-d67c67976ae9 to 2e1e31d5-0763-4b4c-922d-d34af4dff4d1. {{(pid=85458) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 17 22:12:10 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7489ae6-c3a9-4112-a8dd-2ea98fe4c923 tempest-VolumeImageDependencyTests-1657937066 None] Creating volume glance metadata for volume 2e1e31d5-0763-4b4c-922d-d34af4dff4d1 backed by image 5209f7d6-5a8b-47c6-a8fb-d67c67976ae9 with: {'image_id': '5209f7d6-5a8b-47c6-a8fb-d67c67976ae9', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'aa559d46eaee01b0940282f5ca6d276d', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=85458) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 17 22:12:10 devstack sudo[105465]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:10 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-24f58694-62e5-46ea-9126-000ceb3e1056 tempest-ProjectReaderTests-1676955223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-77feb279-2b95-4ce8-9262-47a34d0bea9b.info" returned: 0 in 0.294s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:10 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-24f58694-62e5-46ea-9126-000ceb3e1056 tempest-ProjectReaderTests-1676955223 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.725s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:12:10 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-a6548c7a-8689-4e7e-9add-fa5c67a7afbe tempest-ProjectMemberTests-1966135882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.247s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:12:10 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-a6548c7a-8689-4e7e-9add-fa5c67a7afbe tempest-ProjectMemberTests-1966135882 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:12:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1396248761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=238721b9-a402-422b-b8ef-911c9f28b1b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f277f501a340474ca5d0daea12e88955',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:12:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:12:10Z,use_quota=True,user_id='e584775bfb3c440aa7aac369d15efa55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 22:12:10 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-a6548c7a-8689-4e7e-9add-fa5c67a7afbe tempest-ProjectMemberTests-1966135882 None] Creating volume 238721b9-a402-422b-b8ef-911c9f28b1b4 {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 22:12:10 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-a6548c7a-8689-4e7e-9add-fa5c67a7afbe tempest-ProjectMemberTests-1966135882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:12:10 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-a6548c7a-8689-4e7e-9add-fa5c67a7afbe tempest-ProjectMemberTests-1966135882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:12:10 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-a6548c7a-8689-4e7e-9add-fa5c67a7afbe tempest-ProjectMemberTests-1966135882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:12:10 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-a6548c7a-8689-4e7e-9add-fa5c67a7afbe tempest-ProjectMemberTests-1966135882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:12:10 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-a6548c7a-8689-4e7e-9add-fa5c67a7afbe tempest-ProjectMemberTests-1966135882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:12:10 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-a6548c7a-8689-4e7e-9add-fa5c67a7afbe tempest-ProjectMemberTests-1966135882 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 22:12:10 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-a6548c7a-8689-4e7e-9add-fa5c67a7afbe tempest-ProjectMemberTests-1966135882 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 22:12:10 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a6548c7a-8689-4e7e-9add-fa5c67a7afbe tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-238721b9-a402-422b-b8ef-911c9f28b1b4 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:10 devstack sudo[105471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-238721b9-a402-422b-b8ef-911c9f28b1b4 1073741824 Sep 17 22:12:10 devstack sudo[105471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:10 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-24f58694-62e5-46ea-9126-000ceb3e1056 tempest-ProjectReaderTests-1676955223 None] Create snapshot completed successfully Sep 17 22:12:10 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-d7489ae6-c3a9-4112-a8dd-2ea98fe4c923 tempest-VolumeImageDependencyTests-1657937066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63a78cc5-dcd2-479d-a64b-49098d3f4318) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e1e31d5-0763-4b4c-922d-d34af4dff4d1', 'volume_size': 1, 'image_id': '5209f7d6-5a8b-47c6-a8fb-d67c67976ae9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5209f7d6-5a8b-47c6-a8fb-d67c67976ae9', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'aa559d46eaee01b0940282f5ca6d276d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd6dc5792a6f744fd91bbf3ffb448340b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'bf7a7a5da26114427e8ac15e39d11e3bdca8047eeeba12034739b80411d4222c79bdd6ed944353f1a7d8dff2126ad68945e1ee37d8bb49f64a3e78327601e25a', 'id': '5209f7d6-5a8b-47c6-a8fb-d67c67976ae9', 'created_at': datetime.datetime(2026, 9, 17, 20, 12, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 20, 12, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5209f7d6-5a8b-47c6-a8fb-d67c67976ae9/file', 'properties': {}}, 'image_service': }' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:12:10 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-d7489ae6-c3a9-4112-a8dd-2ea98fe4c923 tempest-VolumeImageDependencyTests-1657937066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d101c64-b309-48e3-9f92-096afedaccba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:12:10 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-d7489ae6-c3a9-4112-a8dd-2ea98fe4c923 tempest-VolumeImageDependencyTests-1657937066 None] Volume volume-2e1e31d5-0763-4b4c-922d-d34af4dff4d1 (2e1e31d5-0763-4b4c-922d-d34af4dff4d1): created successfully Sep 17 22:12:10 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-d7489ae6-c3a9-4112-a8dd-2ea98fe4c923 tempest-VolumeImageDependencyTests-1657937066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d101c64-b309-48e3-9f92-096afedaccba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:12:10 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-d7489ae6-c3a9-4112-a8dd-2ea98fe4c923 tempest-VolumeImageDependencyTests-1657937066 None] Flow 'volume_create_manager' (c6a7a808-4809-4304-914a-91913c83d1fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:12:10 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-d7489ae6-c3a9-4112-a8dd-2ea98fe4c923 tempest-VolumeImageDependencyTests-1657937066 None] Created volume successfully. Sep 17 22:12:11 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-90a9b327-ff51-4981-a9f4-b440ede0e788 tempest-ProjectReaderTests-1676955223 None] Acquiring lock "cinder-942abedd-e0db-4bb8-931a-acf0c5c63b20-delete_snapshot" by "delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:12:11 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-90a9b327-ff51-4981-a9f4-b440ede0e788 tempest-ProjectReaderTests-1676955223 None] Lock "cinder-942abedd-e0db-4bb8-931a-acf0c5c63b20-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:12:11 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-90a9b327-ff51-4981-a9f4-b440ede0e788 tempest-ProjectReaderTests-1676955223 None] Acquiring lock "cinder-quobyte-77feb279-2b95-4ce8-9262-47a34d0bea9b" by "delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:12:11 devstack sudo[105471]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:11 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a6548c7a-8689-4e7e-9add-fa5c67a7afbe tempest-ProjectMemberTests-1966135882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-238721b9-a402-422b-b8ef-911c9f28b1b4 1073741824" returned: 0 in 0.500s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:11 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-90a9b327-ff51-4981-a9f4-b440ede0e788 tempest-ProjectReaderTests-1676955223 None] Lock "cinder-quobyte-77feb279-2b95-4ce8-9262-47a34d0bea9b" acquired by "delete_snapshot" :: waited 0.024s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:12:11 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-90a9b327-ff51-4981-a9f4-b440ede0e788 tempest-ProjectReaderTests-1676955223 None] Acquiring lock "cinder-quobyte-942abedd-e0db-4bb8-931a-acf0c5c63b20" by "_delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:12:11 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-90a9b327-ff51-4981-a9f4-b440ede0e788 tempest-ProjectReaderTests-1676955223 None] Lock "cinder-quobyte-942abedd-e0db-4bb8-931a-acf0c5c63b20" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:12:11 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-90a9b327-ff51-4981-a9f4-b440ede0e788 tempest-ProjectReaderTests-1676955223 None] Deleting offline snapshot 942abedd-e0db-4bb8-931a-acf0c5c63b20 of volume 77feb279-2b95-4ce8-9262-47a34d0bea9b {{(pid=85458) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 22:12:11 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-90a9b327-ff51-4981-a9f4-b440ede0e788 tempest-ProjectReaderTests-1676955223 None] snapshot_file for this snap is: volume-77feb279-2b95-4ce8-9262-47a34d0bea9b.942abedd-e0db-4bb8-931a-acf0c5c63b20 {{(pid=85458) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 22:12:11 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3330cb3-d1d4-44f3-b3d6-42f27ff9e004]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:12:11 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-90a9b327-ff51-4981-a9f4-b440ede0e788 tempest-ProjectReaderTests-1676955223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-77feb279-2b95-4ce8-9262-47a34d0bea9b.942abedd-e0db-4bb8-931a-acf0c5c63b20 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:11 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a6548c7a-8689-4e7e-9add-fa5c67a7afbe tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-238721b9-a402-422b-b8ef-911c9f28b1b4 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:11 devstack sudo[105478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-238721b9-a402-422b-b8ef-911c9f28b1b4 Sep 17 22:12:11 devstack sudo[105478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:11 devstack sudo[105477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-77feb279-2b95-4ce8-9262-47a34d0bea9b.942abedd-e0db-4bb8-931a-acf0c5c63b20 Sep 17 22:12:11 devstack sudo[105477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:11 devstack sudo[105478]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:11 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a6548c7a-8689-4e7e-9add-fa5c67a7afbe tempest-ProjectMemberTests-1966135882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-238721b9-a402-422b-b8ef-911c9f28b1b4" returned: 0 in 0.283s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:11 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-a6548c7a-8689-4e7e-9add-fa5c67a7afbe tempest-ProjectMemberTests-1966135882 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 22:12:11 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-a6548c7a-8689-4e7e-9add-fa5c67a7afbe tempest-ProjectMemberTests-1966135882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:12:11 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-a6548c7a-8689-4e7e-9add-fa5c67a7afbe tempest-ProjectMemberTests-1966135882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09f4b4b4-bf61-4a62-983d-d9a33015b97f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-238721b9-a402-422b-b8ef-911c9f28b1b4', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:12:11 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-a6548c7a-8689-4e7e-9add-fa5c67a7afbe tempest-ProjectMemberTests-1966135882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dd9b19b-6d71-4b91-8583-c789bf418cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:12:11 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-a6548c7a-8689-4e7e-9add-fa5c67a7afbe tempest-ProjectMemberTests-1966135882 None] Volume volume-238721b9-a402-422b-b8ef-911c9f28b1b4 (238721b9-a402-422b-b8ef-911c9f28b1b4): created successfully Sep 17 22:12:11 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-a6548c7a-8689-4e7e-9add-fa5c67a7afbe tempest-ProjectMemberTests-1966135882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dd9b19b-6d71-4b91-8583-c789bf418cc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:12:11 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-a6548c7a-8689-4e7e-9add-fa5c67a7afbe tempest-ProjectMemberTests-1966135882 None] Flow 'volume_create_manager' (4ee85344-1f2c-4af9-bcbc-656e5ed30901) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:12:11 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-a6548c7a-8689-4e7e-9add-fa5c67a7afbe tempest-ProjectMemberTests-1966135882 None] Created volume successfully. Sep 17 22:12:11 devstack sudo[105477]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:11 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-90a9b327-ff51-4981-a9f4-b440ede0e788 tempest-ProjectReaderTests-1676955223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-77feb279-2b95-4ce8-9262-47a34d0bea9b.942abedd-e0db-4bb8-931a-acf0c5c63b20" returned: 0 in 0.425s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:11 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-90a9b327-ff51-4981-a9f4-b440ede0e788 tempest-ProjectReaderTests-1676955223 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-77feb279-2b95-4ce8-9262-47a34d0bea9b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85458) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 22:12:11 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[069645ed-6693-410d-af09-7555be2b4e72]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:12:11 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-90a9b327-ff51-4981-a9f4-b440ede0e788 tempest-ProjectReaderTests-1676955223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-77feb279-2b95-4ce8-9262-47a34d0bea9b {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:11 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-36c10b64-5173-41af-be05-3026bcd6213f tempest-VolumeImageDependencyTests-1657937066 None] Acquiring lock "cinder-2e1e31d5-0763-4b4c-922d-d34af4dff4d1-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:12:11 devstack sudo[105485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-77feb279-2b95-4ce8-9262-47a34d0bea9b Sep 17 22:12:11 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-36c10b64-5173-41af-be05-3026bcd6213f tempest-VolumeImageDependencyTests-1657937066 None] Lock "cinder-2e1e31d5-0763-4b4c-922d-d34af4dff4d1-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:12:11 devstack sudo[105485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:11 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-36c10b64-5173-41af-be05-3026bcd6213f tempest-VolumeImageDependencyTests-1657937066 None] Acquiring lock "cinder-quobyte-2e1e31d5-0763-4b4c-922d-d34af4dff4d1" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:12:11 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-36c10b64-5173-41af-be05-3026bcd6213f tempest-VolumeImageDependencyTests-1657937066 None] Lock "cinder-quobyte-2e1e31d5-0763-4b4c-922d-d34af4dff4d1" acquired by "delete_volume" :: waited 0.023s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:12:12 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[49751cfc-5136-4c6a-b5cf-dec84a56b7db]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:12:12 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-36c10b64-5173-41af-be05-3026bcd6213f tempest-VolumeImageDependencyTests-1657937066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-2e1e31d5-0763-4b4c-922d-d34af4dff4d1 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:12 devstack sudo[105487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-2e1e31d5-0763-4b4c-922d-d34af4dff4d1 Sep 17 22:12:12 devstack sudo[105487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:12 devstack sudo[105485]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:12 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-90a9b327-ff51-4981-a9f4-b440ede0e788 tempest-ProjectReaderTests-1676955223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-77feb279-2b95-4ce8-9262-47a34d0bea9b" returned: 0 in 0.401s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:12 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-90a9b327-ff51-4981-a9f4-b440ede0e788 tempest-ProjectReaderTests-1676955223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-77feb279-2b95-4ce8-9262-47a34d0bea9b.942abedd-e0db-4bb8-931a-acf0c5c63b20 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:12 devstack sudo[105492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-77feb279-2b95-4ce8-9262-47a34d0bea9b.942abedd-e0db-4bb8-931a-acf0c5c63b20 Sep 17 22:12:12 devstack sudo[105492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:12 devstack sudo[105487]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:12 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-36c10b64-5173-41af-be05-3026bcd6213f tempest-VolumeImageDependencyTests-1657937066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-2e1e31d5-0763-4b4c-922d-d34af4dff4d1" returned: 0 in 0.403s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:12 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-36c10b64-5173-41af-be05-3026bcd6213f tempest-VolumeImageDependencyTests-1657937066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-2e1e31d5-0763-4b4c-922d-d34af4dff4d1 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:12 devstack sudo[105499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-2e1e31d5-0763-4b4c-922d-d34af4dff4d1 Sep 17 22:12:12 devstack sudo[105499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:12 devstack sudo[105492]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:12 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-90a9b327-ff51-4981-a9f4-b440ede0e788 tempest-ProjectReaderTests-1676955223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-77feb279-2b95-4ce8-9262-47a34d0bea9b.942abedd-e0db-4bb8-931a-acf0c5c63b20" returned: 0 in 0.381s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:12 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-90a9b327-ff51-4981-a9f4-b440ede0e788 tempest-ProjectReaderTests-1676955223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-77feb279-2b95-4ce8-9262-47a34d0bea9b.942abedd-e0db-4bb8-931a-acf0c5c63b20 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:12 devstack sudo[105502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-77feb279-2b95-4ce8-9262-47a34d0bea9b.942abedd-e0db-4bb8-931a-acf0c5c63b20 Sep 17 22:12:12 devstack sudo[105502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:12 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-69191256-705b-4092-b8cf-e423f54fa08e tempest-ProjectMemberTests-1966135882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:12:12 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-69191256-705b-4092-b8cf-e423f54fa08e tempest-ProjectMemberTests-1966135882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:12:12 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-69191256-705b-4092-b8cf-e423f54fa08e tempest-ProjectMemberTests-1966135882 None] Creating offline snapshot 37571a98-0f6e-4975-a0e3-1fd9bc91f9bb of volume 238721b9-a402-422b-b8ef-911c9f28b1b4 {{(pid=85458) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 22:12:12 devstack sudo[105499]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:12 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-36c10b64-5173-41af-be05-3026bcd6213f tempest-VolumeImageDependencyTests-1657937066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-2e1e31d5-0763-4b4c-922d-d34af4dff4d1" returned: 0 in 0.270s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:12 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[cccb0718-e905-4854-bcbf-936e09707b89]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:12:12 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-69191256-705b-4092-b8cf-e423f54fa08e tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-238721b9-a402-422b-b8ef-911c9f28b1b4 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:12 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-36c10b64-5173-41af-be05-3026bcd6213f tempest-VolumeImageDependencyTests-1657937066 None] Lock "cinder-quobyte-2e1e31d5-0763-4b4c-922d-d34af4dff4d1" released by "delete_volume" :: held 0.733s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:12:12 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-36c10b64-5173-41af-be05-3026bcd6213f tempest-VolumeImageDependencyTests-1657937066 None] Created reservations ['ee959bb5-1745-40ae-b0ea-33d521df2244', '7dc20df7-2127-4b31-8823-07a041465d7f', '34362e55-4018-4a6f-a983-478124c0c512', '77d21328-b93f-474e-a59a-d288970cf34b'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:12:12 devstack sudo[105505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-238721b9-a402-422b-b8ef-911c9f28b1b4 Sep 17 22:12:12 devstack sudo[105505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:12 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-36c10b64-5173-41af-be05-3026bcd6213f tempest-VolumeImageDependencyTests-1657937066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:12:12 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-36c10b64-5173-41af-be05-3026bcd6213f tempest-VolumeImageDependencyTests-1657937066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:12:12 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-36c10b64-5173-41af-be05-3026bcd6213f tempest-VolumeImageDependencyTests-1657937066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:12:12 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-36c10b64-5173-41af-be05-3026bcd6213f tempest-VolumeImageDependencyTests-1657937066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:12:12 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-36c10b64-5173-41af-be05-3026bcd6213f tempest-VolumeImageDependencyTests-1657937066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:12:12 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-36c10b64-5173-41af-be05-3026bcd6213f tempest-VolumeImageDependencyTests-1657937066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:12 devstack sudo[105502]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:12 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-90a9b327-ff51-4981-a9f4-b440ede0e788 tempest-ProjectReaderTests-1676955223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-77feb279-2b95-4ce8-9262-47a34d0bea9b.942abedd-e0db-4bb8-931a-acf0c5c63b20" returned: 0 in 0.307s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:12 devstack sudo[105508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:12:12 devstack sudo[105508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:12 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-90a9b327-ff51-4981-a9f4-b440ede0e788 tempest-ProjectReaderTests-1676955223 None] Lock "cinder-quobyte-942abedd-e0db-4bb8-931a-acf0c5c63b20" released by "_delete_snapshot" :: held 1.661s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:12:12 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-90a9b327-ff51-4981-a9f4-b440ede0e788 tempest-ProjectReaderTests-1676955223 None] Lock "cinder-quobyte-77feb279-2b95-4ce8-9262-47a34d0bea9b" released by "delete_snapshot" :: held 1.698s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:12:13 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-90a9b327-ff51-4981-a9f4-b440ede0e788 tempest-ProjectReaderTests-1676955223 None] Created reservations ['5e4f2726-00dd-40f9-945a-1f8e9f1929c1', '068aec6c-0af1-4792-b6fe-1b9c1b97e7c9', '2854da36-5ad1-4f4f-af9a-779d851352b0', 'af47d7dc-c965-4c1a-9a40-2045f263c648'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:12:13 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-90a9b327-ff51-4981-a9f4-b440ede0e788 tempest-ProjectReaderTests-1676955223 None] Delete snapshot completed successfully. Sep 17 22:12:13 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-90a9b327-ff51-4981-a9f4-b440ede0e788 tempest-ProjectReaderTests-1676955223 None] Lock "cinder-942abedd-e0db-4bb8-931a-acf0c5c63b20-delete_snapshot" released by "delete_snapshot" :: held 1.941s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:12:13 devstack sudo[105508]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:13 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-36c10b64-5173-41af-be05-3026bcd6213f tempest-VolumeImageDependencyTests-1657937066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.333s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:13 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-36c10b64-5173-41af-be05-3026bcd6213f tempest-VolumeImageDependencyTests-1657937066 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:12:13 devstack sudo[105505]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:13 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-36c10b64-5173-41af-be05-3026bcd6213f tempest-VolumeImageDependencyTests-1657937066 None] Deleted volume successfully. Sep 17 22:12:13 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-69191256-705b-4092-b8cf-e423f54fa08e tempest-ProjectMemberTests-1966135882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-238721b9-a402-422b-b8ef-911c9f28b1b4" returned: 0 in 0.495s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:13 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-69191256-705b-4092-b8cf-e423f54fa08e tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-238721b9-a402-422b-b8ef-911c9f28b1b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-238721b9-a402-422b-b8ef-911c9f28b1b4.37571a98-0f6e-4975-a0e3-1fd9bc91f9bb 1G {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:13 devstack sudo[105515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-238721b9-a402-422b-b8ef-911c9f28b1b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-238721b9-a402-422b-b8ef-911c9f28b1b4.37571a98-0f6e-4975-a0e3-1fd9bc91f9bb 1G Sep 17 22:12:13 devstack sudo[105515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:13 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-36c10b64-5173-41af-be05-3026bcd6213f tempest-VolumeImageDependencyTests-1657937066 None] Lock "cinder-2e1e31d5-0763-4b4c-922d-d34af4dff4d1-delete_volume" released by "delete_volume" :: held 1.317s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:12:13 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-3bad5708-c3e7-45ea-92ec-2f45dbf0b2a4 tempest-ProjectReaderTests-1676955223 None] Acquiring lock "cinder-77feb279-2b95-4ce8-9262-47a34d0bea9b-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:12:13 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-3bad5708-c3e7-45ea-92ec-2f45dbf0b2a4 tempest-ProjectReaderTests-1676955223 None] Lock "cinder-77feb279-2b95-4ce8-9262-47a34d0bea9b-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:12:13 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-3bad5708-c3e7-45ea-92ec-2f45dbf0b2a4 tempest-ProjectReaderTests-1676955223 None] Acquiring lock "cinder-quobyte-77feb279-2b95-4ce8-9262-47a34d0bea9b" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:12:13 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-3bad5708-c3e7-45ea-92ec-2f45dbf0b2a4 tempest-ProjectReaderTests-1676955223 None] Lock "cinder-quobyte-77feb279-2b95-4ce8-9262-47a34d0bea9b" acquired by "delete_volume" :: waited 0.021s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:12:13 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6317a5d-31e1-4be9-9197-c3a1bd303424]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:12:13 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-3bad5708-c3e7-45ea-92ec-2f45dbf0b2a4 tempest-ProjectReaderTests-1676955223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-77feb279-2b95-4ce8-9262-47a34d0bea9b {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:13 devstack sudo[105520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-77feb279-2b95-4ce8-9262-47a34d0bea9b Sep 17 22:12:13 devstack sudo[105520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:13 devstack sudo[105515]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:13 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-69191256-705b-4092-b8cf-e423f54fa08e tempest-ProjectMemberTests-1966135882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-238721b9-a402-422b-b8ef-911c9f28b1b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-238721b9-a402-422b-b8ef-911c9f28b1b4.37571a98-0f6e-4975-a0e3-1fd9bc91f9bb 1G" returned: 0 in 0.587s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:13 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-69191256-705b-4092-b8cf-e423f54fa08e tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-238721b9-a402-422b-b8ef-911c9f28b1b4 -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-238721b9-a402-422b-b8ef-911c9f28b1b4.37571a98-0f6e-4975-a0e3-1fd9bc91f9bb {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:13 devstack sudo[105522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-238721b9-a402-422b-b8ef-911c9f28b1b4 -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-238721b9-a402-422b-b8ef-911c9f28b1b4.37571a98-0f6e-4975-a0e3-1fd9bc91f9bb Sep 17 22:12:13 devstack sudo[105522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:14 devstack sudo[105520]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:14 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-3bad5708-c3e7-45ea-92ec-2f45dbf0b2a4 tempest-ProjectReaderTests-1676955223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-77feb279-2b95-4ce8-9262-47a34d0bea9b" returned: 0 in 0.549s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:14 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-3bad5708-c3e7-45ea-92ec-2f45dbf0b2a4 tempest-ProjectReaderTests-1676955223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-77feb279-2b95-4ce8-9262-47a34d0bea9b {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:14 devstack sudo[105530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-77feb279-2b95-4ce8-9262-47a34d0bea9b Sep 17 22:12:14 devstack sudo[105530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:14 devstack sudo[105522]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:14 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-69191256-705b-4092-b8cf-e423f54fa08e tempest-ProjectMemberTests-1966135882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-238721b9-a402-422b-b8ef-911c9f28b1b4 -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-238721b9-a402-422b-b8ef-911c9f28b1b4.37571a98-0f6e-4975-a0e3-1fd9bc91f9bb" returned: 0 in 0.385s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:14 devstack cinder-volume[85458]: WARNING cinder.volume.drivers.remotefs [None req-69191256-705b-4092-b8cf-e423f54fa08e tempest-ProjectMemberTests-1966135882 None] /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-238721b9-a402-422b-b8ef-911c9f28b1b4.37571a98-0f6e-4975-a0e3-1fd9bc91f9bb is being set with open permissions: ugo+rw Sep 17 22:12:14 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-69191256-705b-4092-b8cf-e423f54fa08e tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-238721b9-a402-422b-b8ef-911c9f28b1b4.37571a98-0f6e-4975-a0e3-1fd9bc91f9bb {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:14 devstack sudo[105532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-238721b9-a402-422b-b8ef-911c9f28b1b4.37571a98-0f6e-4975-a0e3-1fd9bc91f9bb Sep 17 22:12:14 devstack sudo[105532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:14 devstack sudo[105530]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:14 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-3bad5708-c3e7-45ea-92ec-2f45dbf0b2a4 tempest-ProjectReaderTests-1676955223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-77feb279-2b95-4ce8-9262-47a34d0bea9b" returned: 0 in 0.292s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:14 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-3bad5708-c3e7-45ea-92ec-2f45dbf0b2a4 tempest-ProjectReaderTests-1676955223 None] Lock "cinder-quobyte-77feb279-2b95-4ce8-9262-47a34d0bea9b" released by "delete_volume" :: held 0.934s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:12:14 devstack sudo[105532]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:14 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-69191256-705b-4092-b8cf-e423f54fa08e tempest-ProjectMemberTests-1966135882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-238721b9-a402-422b-b8ef-911c9f28b1b4.37571a98-0f6e-4975-a0e3-1fd9bc91f9bb" returned: 0 in 0.306s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:14 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-3bad5708-c3e7-45ea-92ec-2f45dbf0b2a4 tempest-ProjectReaderTests-1676955223 None] Created reservations ['b6291da1-63e6-4796-b321-d3b3d429df70', 'c3aa3e12-d7aa-4aed-b78c-a73d0e14792b', 'ab584355-ce57-43f1-9dd8-1bd47c74752a', 'ec1973d3-254d-4956-a92f-087a6b48cb7e'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:12:14 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-69191256-705b-4092-b8cf-e423f54fa08e tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-238721b9-a402-422b-b8ef-911c9f28b1b4.info {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:14 devstack sudo[105536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-238721b9-a402-422b-b8ef-911c9f28b1b4.info Sep 17 22:12:14 devstack sudo[105536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:14 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-3bad5708-c3e7-45ea-92ec-2f45dbf0b2a4 tempest-ProjectReaderTests-1676955223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:12:14 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-3bad5708-c3e7-45ea-92ec-2f45dbf0b2a4 tempest-ProjectReaderTests-1676955223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:12:14 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-3bad5708-c3e7-45ea-92ec-2f45dbf0b2a4 tempest-ProjectReaderTests-1676955223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:12:14 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-3bad5708-c3e7-45ea-92ec-2f45dbf0b2a4 tempest-ProjectReaderTests-1676955223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:12:14 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-3bad5708-c3e7-45ea-92ec-2f45dbf0b2a4 tempest-ProjectReaderTests-1676955223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:12:14 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-3bad5708-c3e7-45ea-92ec-2f45dbf0b2a4 tempest-ProjectReaderTests-1676955223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:14 devstack sudo[105538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:12:14 devstack sudo[105538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:14 devstack sudo[105536]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:14 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-69191256-705b-4092-b8cf-e423f54fa08e tempest-ProjectMemberTests-1966135882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-238721b9-a402-422b-b8ef-911c9f28b1b4.info" returned: 0 in 0.306s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:14 devstack cinder-volume[85458]: WARNING cinder.volume.drivers.remotefs [None req-69191256-705b-4092-b8cf-e423f54fa08e tempest-ProjectMemberTests-1966135882 None] /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-238721b9-a402-422b-b8ef-911c9f28b1b4.info is being set with open permissions: ugo+rw Sep 17 22:12:14 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-69191256-705b-4092-b8cf-e423f54fa08e tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-238721b9-a402-422b-b8ef-911c9f28b1b4.info {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:14 devstack sudo[105541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-238721b9-a402-422b-b8ef-911c9f28b1b4.info Sep 17 22:12:14 devstack sudo[105541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:14 devstack sudo[105538]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:14 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-3bad5708-c3e7-45ea-92ec-2f45dbf0b2a4 tempest-ProjectReaderTests-1676955223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.284s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:14 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-3bad5708-c3e7-45ea-92ec-2f45dbf0b2a4 tempest-ProjectReaderTests-1676955223 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:12:14 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-3bad5708-c3e7-45ea-92ec-2f45dbf0b2a4 tempest-ProjectReaderTests-1676955223 None] Deleted volume successfully. Sep 17 22:12:14 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-3bad5708-c3e7-45ea-92ec-2f45dbf0b2a4 tempest-ProjectReaderTests-1676955223 None] Lock "cinder-77feb279-2b95-4ce8-9262-47a34d0bea9b-delete_volume" released by "delete_volume" :: held 1.521s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:12:15 devstack sudo[105541]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:15 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-69191256-705b-4092-b8cf-e423f54fa08e tempest-ProjectMemberTests-1966135882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-238721b9-a402-422b-b8ef-911c9f28b1b4.info" returned: 0 in 0.288s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:15 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-69191256-705b-4092-b8cf-e423f54fa08e tempest-ProjectMemberTests-1966135882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.473s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:12:15 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-69191256-705b-4092-b8cf-e423f54fa08e tempest-ProjectMemberTests-1966135882 None] Create snapshot completed successfully Sep 17 22:12:15 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-a467a273-d783-416d-bfc6-5be6bfa2a2f2 tempest-ProjectMemberTests-1966135882 None] Acquiring lock "cinder-37571a98-0f6e-4975-a0e3-1fd9bc91f9bb-delete_snapshot" by "delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:12:15 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-a467a273-d783-416d-bfc6-5be6bfa2a2f2 tempest-ProjectMemberTests-1966135882 None] Lock "cinder-37571a98-0f6e-4975-a0e3-1fd9bc91f9bb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:12:15 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-a467a273-d783-416d-bfc6-5be6bfa2a2f2 tempest-ProjectMemberTests-1966135882 None] Acquiring lock "cinder-quobyte-238721b9-a402-422b-b8ef-911c9f28b1b4" by "delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:12:15 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-a467a273-d783-416d-bfc6-5be6bfa2a2f2 tempest-ProjectMemberTests-1966135882 None] Lock "cinder-quobyte-238721b9-a402-422b-b8ef-911c9f28b1b4" acquired by "delete_snapshot" :: waited 0.030s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:12:15 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-a467a273-d783-416d-bfc6-5be6bfa2a2f2 tempest-ProjectMemberTests-1966135882 None] Acquiring lock "cinder-quobyte-37571a98-0f6e-4975-a0e3-1fd9bc91f9bb" by "_delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:12:15 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-a467a273-d783-416d-bfc6-5be6bfa2a2f2 tempest-ProjectMemberTests-1966135882 None] Lock "cinder-quobyte-37571a98-0f6e-4975-a0e3-1fd9bc91f9bb" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:12:15 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-a467a273-d783-416d-bfc6-5be6bfa2a2f2 tempest-ProjectMemberTests-1966135882 None] Deleting offline snapshot 37571a98-0f6e-4975-a0e3-1fd9bc91f9bb of volume 238721b9-a402-422b-b8ef-911c9f28b1b4 {{(pid=85458) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 22:12:16 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-a467a273-d783-416d-bfc6-5be6bfa2a2f2 tempest-ProjectMemberTests-1966135882 None] snapshot_file for this snap is: volume-238721b9-a402-422b-b8ef-911c9f28b1b4.37571a98-0f6e-4975-a0e3-1fd9bc91f9bb {{(pid=85458) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 22:12:16 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[3971ff53-7626-4b89-8f39-fb3e77426658]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:12:16 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a467a273-d783-416d-bfc6-5be6bfa2a2f2 tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-238721b9-a402-422b-b8ef-911c9f28b1b4.37571a98-0f6e-4975-a0e3-1fd9bc91f9bb {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:16 devstack sudo[105545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-238721b9-a402-422b-b8ef-911c9f28b1b4.37571a98-0f6e-4975-a0e3-1fd9bc91f9bb Sep 17 22:12:16 devstack sudo[105545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:16 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-35b5c7da-d871-44fd-bffe-1d3e7227ae02 tempest-ProjectReaderTests-1676955223 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 22:12:16 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-35b5c7da-d871-44fd-bffe-1d3e7227ae02 tempest-ProjectReaderTests-1676955223 None] Flow 'volume_create_manager' (4082307a-8ed6-4eed-b95b-9af93b779ab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:12:16 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-35b5c7da-d871-44fd-bffe-1d3e7227ae02 tempest-ProjectReaderTests-1676955223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fe6243f-5d68-464d-92bb-a59bcd32834d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:12:16 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-35b5c7da-d871-44fd-bffe-1d3e7227ae02 tempest-ProjectReaderTests-1676955223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fe6243f-5d68-464d-92bb-a59bcd32834d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:12:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2106784097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d5effe3-e557-4222-9ea3-c6138935197a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e4464b587ad40759679fd10b5eda168',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:12:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:12:16Z,use_quota=True,user_id='dcf31a786e3845bab1a502363d0f3482',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:12:16 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-35b5c7da-d871-44fd-bffe-1d3e7227ae02 tempest-ProjectReaderTests-1676955223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9a2f43b-7f82-4576-bbb7-65f8be9cf043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:12:16 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-35b5c7da-d871-44fd-bffe-1d3e7227ae02 tempest-ProjectReaderTests-1676955223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9a2f43b-7f82-4576-bbb7-65f8be9cf043) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:12:16 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-35b5c7da-d871-44fd-bffe-1d3e7227ae02 tempest-ProjectReaderTests-1676955223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc235c5b-fa4d-442e-8dc7-18a4a95b6ade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:12:16 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-35b5c7da-d871-44fd-bffe-1d3e7227ae02 tempest-ProjectReaderTests-1676955223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc235c5b-fa4d-442e-8dc7-18a4a95b6ade) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d5effe3-e557-4222-9ea3-c6138935197a', 'volume_name': 'volume-7d5effe3-e557-4222-9ea3-c6138935197a', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:12:16 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-35b5c7da-d871-44fd-bffe-1d3e7227ae02 tempest-ProjectReaderTests-1676955223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4eea032b-1d38-4a21-82ef-aa9807f3d250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:12:16 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-35b5c7da-d871-44fd-bffe-1d3e7227ae02 tempest-ProjectReaderTests-1676955223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4eea032b-1d38-4a21-82ef-aa9807f3d250) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:12:16 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-35b5c7da-d871-44fd-bffe-1d3e7227ae02 tempest-ProjectReaderTests-1676955223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f0a12bc-af9a-4596-8bec-8cc7b423ea7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:12:16 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-35b5c7da-d871-44fd-bffe-1d3e7227ae02 tempest-ProjectReaderTests-1676955223 None] Volume 7d5effe3-e557-4222-9ea3-c6138935197a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d5effe3-e557-4222-9ea3-c6138935197a', 'volume_size': 1} Sep 17 22:12:16 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-35b5c7da-d871-44fd-bffe-1d3e7227ae02 tempest-ProjectReaderTests-1676955223 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:12:16 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-35b5c7da-d871-44fd-bffe-1d3e7227ae02 tempest-ProjectReaderTests-1676955223 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:12:16 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-35b5c7da-d871-44fd-bffe-1d3e7227ae02 tempest-ProjectReaderTests-1676955223 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:12:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2106784097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d5effe3-e557-4222-9ea3-c6138935197a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e4464b587ad40759679fd10b5eda168',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:12:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:12:16Z,use_quota=True,user_id='dcf31a786e3845bab1a502363d0f3482',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 22:12:16 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-35b5c7da-d871-44fd-bffe-1d3e7227ae02 tempest-ProjectReaderTests-1676955223 None] Creating volume 7d5effe3-e557-4222-9ea3-c6138935197a {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 22:12:16 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-35b5c7da-d871-44fd-bffe-1d3e7227ae02 tempest-ProjectReaderTests-1676955223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:12:16 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-35b5c7da-d871-44fd-bffe-1d3e7227ae02 tempest-ProjectReaderTests-1676955223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:12:16 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-35b5c7da-d871-44fd-bffe-1d3e7227ae02 tempest-ProjectReaderTests-1676955223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:12:16 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-35b5c7da-d871-44fd-bffe-1d3e7227ae02 tempest-ProjectReaderTests-1676955223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:12:16 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-35b5c7da-d871-44fd-bffe-1d3e7227ae02 tempest-ProjectReaderTests-1676955223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:12:16 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-35b5c7da-d871-44fd-bffe-1d3e7227ae02 tempest-ProjectReaderTests-1676955223 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 22:12:16 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-35b5c7da-d871-44fd-bffe-1d3e7227ae02 tempest-ProjectReaderTests-1676955223 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 22:12:16 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-35b5c7da-d871-44fd-bffe-1d3e7227ae02 tempest-ProjectReaderTests-1676955223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7d5effe3-e557-4222-9ea3-c6138935197a 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:16 devstack sudo[105547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7d5effe3-e557-4222-9ea3-c6138935197a 1073741824 Sep 17 22:12:16 devstack sudo[105547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:16 devstack sudo[105545]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:16 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a467a273-d783-416d-bfc6-5be6bfa2a2f2 tempest-ProjectMemberTests-1966135882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-238721b9-a402-422b-b8ef-911c9f28b1b4.37571a98-0f6e-4975-a0e3-1fd9bc91f9bb" returned: 0 in 0.573s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:16 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-a467a273-d783-416d-bfc6-5be6bfa2a2f2 tempest-ProjectMemberTests-1966135882 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-238721b9-a402-422b-b8ef-911c9f28b1b4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85458) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 22:12:16 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[472b82d5-3c15-4756-bbb8-fcc6753a831f]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:12:16 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a467a273-d783-416d-bfc6-5be6bfa2a2f2 tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-238721b9-a402-422b-b8ef-911c9f28b1b4 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:16 devstack sudo[105552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-238721b9-a402-422b-b8ef-911c9f28b1b4 Sep 17 22:12:16 devstack sudo[105552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:17 devstack sudo[105547]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:17 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-35b5c7da-d871-44fd-bffe-1d3e7227ae02 tempest-ProjectReaderTests-1676955223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7d5effe3-e557-4222-9ea3-c6138935197a 1073741824" returned: 0 in 0.568s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:17 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-35b5c7da-d871-44fd-bffe-1d3e7227ae02 tempest-ProjectReaderTests-1676955223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7d5effe3-e557-4222-9ea3-c6138935197a {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:17 devstack sudo[105560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7d5effe3-e557-4222-9ea3-c6138935197a Sep 17 22:12:17 devstack sudo[105560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:17 devstack sudo[105552]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:17 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a467a273-d783-416d-bfc6-5be6bfa2a2f2 tempest-ProjectMemberTests-1966135882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-238721b9-a402-422b-b8ef-911c9f28b1b4" returned: 0 in 0.512s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:17 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a467a273-d783-416d-bfc6-5be6bfa2a2f2 tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-238721b9-a402-422b-b8ef-911c9f28b1b4.37571a98-0f6e-4975-a0e3-1fd9bc91f9bb {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:17 devstack sudo[105563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-238721b9-a402-422b-b8ef-911c9f28b1b4.37571a98-0f6e-4975-a0e3-1fd9bc91f9bb Sep 17 22:12:17 devstack sudo[105563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:17 devstack sudo[105560]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:17 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-35b5c7da-d871-44fd-bffe-1d3e7227ae02 tempest-ProjectReaderTests-1676955223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7d5effe3-e557-4222-9ea3-c6138935197a" returned: 0 in 0.345s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:17 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-35b5c7da-d871-44fd-bffe-1d3e7227ae02 tempest-ProjectReaderTests-1676955223 None] <== create_volume: return (970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 22:12:17 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-35b5c7da-d871-44fd-bffe-1d3e7227ae02 tempest-ProjectReaderTests-1676955223 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.974s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:12:17 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-35b5c7da-d871-44fd-bffe-1d3e7227ae02 tempest-ProjectReaderTests-1676955223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f0a12bc-af9a-4596-8bec-8cc7b423ea7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d5effe3-e557-4222-9ea3-c6138935197a', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:12:17 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-35b5c7da-d871-44fd-bffe-1d3e7227ae02 tempest-ProjectReaderTests-1676955223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9da92af-7995-4f68-9f9a-987913b8782a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:12:17 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-35b5c7da-d871-44fd-bffe-1d3e7227ae02 tempest-ProjectReaderTests-1676955223 None] Volume volume-7d5effe3-e557-4222-9ea3-c6138935197a (7d5effe3-e557-4222-9ea3-c6138935197a): created successfully Sep 17 22:12:17 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-35b5c7da-d871-44fd-bffe-1d3e7227ae02 tempest-ProjectReaderTests-1676955223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9da92af-7995-4f68-9f9a-987913b8782a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:12:17 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-35b5c7da-d871-44fd-bffe-1d3e7227ae02 tempest-ProjectReaderTests-1676955223 None] Flow 'volume_create_manager' (4082307a-8ed6-4eed-b95b-9af93b779ab4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:12:17 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-35b5c7da-d871-44fd-bffe-1d3e7227ae02 tempest-ProjectReaderTests-1676955223 None] Created volume successfully. Sep 17 22:12:17 devstack sudo[105563]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:17 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a467a273-d783-416d-bfc6-5be6bfa2a2f2 tempest-ProjectMemberTests-1966135882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-238721b9-a402-422b-b8ef-911c9f28b1b4.37571a98-0f6e-4975-a0e3-1fd9bc91f9bb" returned: 0 in 0.482s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:17 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a467a273-d783-416d-bfc6-5be6bfa2a2f2 tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-238721b9-a402-422b-b8ef-911c9f28b1b4.37571a98-0f6e-4975-a0e3-1fd9bc91f9bb {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:17 devstack sudo[105569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-238721b9-a402-422b-b8ef-911c9f28b1b4.37571a98-0f6e-4975-a0e3-1fd9bc91f9bb Sep 17 22:12:17 devstack sudo[105569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:17 devstack sudo[105569]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:17 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-a467a273-d783-416d-bfc6-5be6bfa2a2f2 tempest-ProjectMemberTests-1966135882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-238721b9-a402-422b-b8ef-911c9f28b1b4.37571a98-0f6e-4975-a0e3-1fd9bc91f9bb" returned: 0 in 0.296s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:17 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-a467a273-d783-416d-bfc6-5be6bfa2a2f2 tempest-ProjectMemberTests-1966135882 None] Lock "cinder-quobyte-37571a98-0f6e-4975-a0e3-1fd9bc91f9bb" released by "_delete_snapshot" :: held 1.994s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:12:17 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-a467a273-d783-416d-bfc6-5be6bfa2a2f2 tempest-ProjectMemberTests-1966135882 None] Lock "cinder-quobyte-238721b9-a402-422b-b8ef-911c9f28b1b4" released by "delete_snapshot" :: held 2.031s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:12:18 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-a467a273-d783-416d-bfc6-5be6bfa2a2f2 tempest-ProjectMemberTests-1966135882 None] Created reservations ['781423f7-4617-40d3-b3d0-a4e426737ffc', 'f4deb3f9-5ba6-4de9-a9db-b84967522e93', '2afa80d4-7879-418d-8c0e-630d62179775', '3066cc2a-f209-4ab0-96f8-90e23f45f45a'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:12:18 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-a467a273-d783-416d-bfc6-5be6bfa2a2f2 tempest-ProjectMemberTests-1966135882 None] Delete snapshot completed successfully. Sep 17 22:12:18 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-a467a273-d783-416d-bfc6-5be6bfa2a2f2 tempest-ProjectMemberTests-1966135882 None] Lock "cinder-37571a98-0f6e-4975-a0e3-1fd9bc91f9bb-delete_snapshot" released by "delete_snapshot" :: held 2.188s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:12:18 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-4a0b337e-3d0a-45e6-8f1f-fd3f8c900abf tempest-ProjectReaderTests-1676955223 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:12:18 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-4a0b337e-3d0a-45e6-8f1f-fd3f8c900abf tempest-ProjectReaderTests-1676955223 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:12:18 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-4a0b337e-3d0a-45e6-8f1f-fd3f8c900abf tempest-ProjectReaderTests-1676955223 None] Creating offline snapshot a0995db2-7c93-4fa7-a00b-76bbb20347b1 of volume 7d5effe3-e557-4222-9ea3-c6138935197a {{(pid=85458) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 22:12:18 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[507e558e-e284-4431-a590-8fc33c52120a]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:12:18 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-4a0b337e-3d0a-45e6-8f1f-fd3f8c900abf tempest-ProjectReaderTests-1676955223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7d5effe3-e557-4222-9ea3-c6138935197a {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:18 devstack sudo[105572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7d5effe3-e557-4222-9ea3-c6138935197a Sep 17 22:12:18 devstack sudo[105572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:19 devstack sudo[105572]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:19 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-4a0b337e-3d0a-45e6-8f1f-fd3f8c900abf tempest-ProjectReaderTests-1676955223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7d5effe3-e557-4222-9ea3-c6138935197a" returned: 0 in 0.429s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:19 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-4a0b337e-3d0a-45e6-8f1f-fd3f8c900abf tempest-ProjectReaderTests-1676955223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7d5effe3-e557-4222-9ea3-c6138935197a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7d5effe3-e557-4222-9ea3-c6138935197a.a0995db2-7c93-4fa7-a00b-76bbb20347b1 1G {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:19 devstack sudo[105577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7d5effe3-e557-4222-9ea3-c6138935197a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7d5effe3-e557-4222-9ea3-c6138935197a.a0995db2-7c93-4fa7-a00b-76bbb20347b1 1G Sep 17 22:12:19 devstack sudo[105577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:19 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-55b95af7-110c-4a38-930a-8e6bbcee2160 tempest-ProjectMemberTests-1966135882 None] Acquiring lock "cinder-238721b9-a402-422b-b8ef-911c9f28b1b4-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:12:19 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-55b95af7-110c-4a38-930a-8e6bbcee2160 tempest-ProjectMemberTests-1966135882 None] Lock "cinder-238721b9-a402-422b-b8ef-911c9f28b1b4-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:12:19 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-55b95af7-110c-4a38-930a-8e6bbcee2160 tempest-ProjectMemberTests-1966135882 None] Acquiring lock "cinder-quobyte-238721b9-a402-422b-b8ef-911c9f28b1b4" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:12:19 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-55b95af7-110c-4a38-930a-8e6bbcee2160 tempest-ProjectMemberTests-1966135882 None] Lock "cinder-quobyte-238721b9-a402-422b-b8ef-911c9f28b1b4" acquired by "delete_volume" :: waited 0.019s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:12:19 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ac9c0a9-7eab-4a53-803b-61ed4dd2a835]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:12:19 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-55b95af7-110c-4a38-930a-8e6bbcee2160 tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-238721b9-a402-422b-b8ef-911c9f28b1b4 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:19 devstack sudo[105579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-238721b9-a402-422b-b8ef-911c9f28b1b4 Sep 17 22:12:19 devstack sudo[105579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:19 devstack sudo[105577]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:19 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-4a0b337e-3d0a-45e6-8f1f-fd3f8c900abf tempest-ProjectReaderTests-1676955223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7d5effe3-e557-4222-9ea3-c6138935197a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7d5effe3-e557-4222-9ea3-c6138935197a.a0995db2-7c93-4fa7-a00b-76bbb20347b1 1G" returned: 0 in 0.661s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:19 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-4a0b337e-3d0a-45e6-8f1f-fd3f8c900abf tempest-ProjectReaderTests-1676955223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d5effe3-e557-4222-9ea3-c6138935197a -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7d5effe3-e557-4222-9ea3-c6138935197a.a0995db2-7c93-4fa7-a00b-76bbb20347b1 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:19 devstack sudo[105588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d5effe3-e557-4222-9ea3-c6138935197a -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7d5effe3-e557-4222-9ea3-c6138935197a.a0995db2-7c93-4fa7-a00b-76bbb20347b1 Sep 17 22:12:19 devstack sudo[105588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:19 devstack sudo[105579]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:19 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-55b95af7-110c-4a38-930a-8e6bbcee2160 tempest-ProjectMemberTests-1966135882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-238721b9-a402-422b-b8ef-911c9f28b1b4" returned: 0 in 0.474s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:19 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-55b95af7-110c-4a38-930a-8e6bbcee2160 tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-238721b9-a402-422b-b8ef-911c9f28b1b4 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:19 devstack sudo[105592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-238721b9-a402-422b-b8ef-911c9f28b1b4 Sep 17 22:12:19 devstack sudo[105592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:20 devstack sudo[105588]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:20 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-4a0b337e-3d0a-45e6-8f1f-fd3f8c900abf tempest-ProjectReaderTests-1676955223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d5effe3-e557-4222-9ea3-c6138935197a -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7d5effe3-e557-4222-9ea3-c6138935197a.a0995db2-7c93-4fa7-a00b-76bbb20347b1" returned: 0 in 0.423s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:20 devstack cinder-volume[85458]: WARNING cinder.volume.drivers.remotefs [None req-4a0b337e-3d0a-45e6-8f1f-fd3f8c900abf tempest-ProjectReaderTests-1676955223 None] /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7d5effe3-e557-4222-9ea3-c6138935197a.a0995db2-7c93-4fa7-a00b-76bbb20347b1 is being set with open permissions: ugo+rw Sep 17 22:12:20 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-4a0b337e-3d0a-45e6-8f1f-fd3f8c900abf tempest-ProjectReaderTests-1676955223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7d5effe3-e557-4222-9ea3-c6138935197a.a0995db2-7c93-4fa7-a00b-76bbb20347b1 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:20 devstack sudo[105592]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:20 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-55b95af7-110c-4a38-930a-8e6bbcee2160 tempest-ProjectMemberTests-1966135882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-238721b9-a402-422b-b8ef-911c9f28b1b4" returned: 0 in 0.359s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:20 devstack sudo[105598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7d5effe3-e557-4222-9ea3-c6138935197a.a0995db2-7c93-4fa7-a00b-76bbb20347b1 Sep 17 22:12:20 devstack sudo[105598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:20 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-55b95af7-110c-4a38-930a-8e6bbcee2160 tempest-ProjectMemberTests-1966135882 None] Lock "cinder-quobyte-238721b9-a402-422b-b8ef-911c9f28b1b4" released by "delete_volume" :: held 0.937s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:12:20 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-55b95af7-110c-4a38-930a-8e6bbcee2160 tempest-ProjectMemberTests-1966135882 None] Created reservations ['f4febbfd-4972-4c0c-81fe-aea702d3f305', 'a837247e-429b-4c73-9220-a5fdb94cfda8', 'ba01a516-54aa-4c93-a54f-da48a15a4c08', '1e3e84ca-523e-431a-9c9e-45a6f24c29ff'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:12:20 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-55b95af7-110c-4a38-930a-8e6bbcee2160 tempest-ProjectMemberTests-1966135882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:12:20 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-55b95af7-110c-4a38-930a-8e6bbcee2160 tempest-ProjectMemberTests-1966135882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:12:20 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-55b95af7-110c-4a38-930a-8e6bbcee2160 tempest-ProjectMemberTests-1966135882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:12:20 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-55b95af7-110c-4a38-930a-8e6bbcee2160 tempest-ProjectMemberTests-1966135882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:12:20 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-55b95af7-110c-4a38-930a-8e6bbcee2160 tempest-ProjectMemberTests-1966135882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:12:20 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-55b95af7-110c-4a38-930a-8e6bbcee2160 tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:20 devstack sudo[105600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:12:20 devstack sudo[105600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:20 devstack sudo[105598]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:20 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-4a0b337e-3d0a-45e6-8f1f-fd3f8c900abf tempest-ProjectReaderTests-1676955223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7d5effe3-e557-4222-9ea3-c6138935197a.a0995db2-7c93-4fa7-a00b-76bbb20347b1" returned: 0 in 0.289s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:20 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-4a0b337e-3d0a-45e6-8f1f-fd3f8c900abf tempest-ProjectReaderTests-1676955223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7d5effe3-e557-4222-9ea3-c6138935197a.info {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:20 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5b4360f-5763-4cd4-849a-f63a35e079d7 tempest-ProjectReaderTests-34270978 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 22:12:20 devstack sudo[105603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7d5effe3-e557-4222-9ea3-c6138935197a.info Sep 17 22:12:20 devstack sudo[105603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:20 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b5b4360f-5763-4cd4-849a-f63a35e079d7 tempest-ProjectReaderTests-34270978 None] Flow 'volume_create_manager' (5b34b114-2d1d-43a5-a026-fc6bebcf1370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:12:20 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b5b4360f-5763-4cd4-849a-f63a35e079d7 tempest-ProjectReaderTests-34270978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c45bfc3-231a-4425-b7d0-bef6ab1afc4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:12:20 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b5b4360f-5763-4cd4-849a-f63a35e079d7 tempest-ProjectReaderTests-34270978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c45bfc3-231a-4425-b7d0-bef6ab1afc4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:12:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1807476153',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5239ba6-b6dc-4142-9b0f-ee39212169f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93161e2722304812b3988840a55e6b7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:12:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:12:20Z,use_quota=True,user_id='9f53f87df5e24c87ae5ae18f30f2dd3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:12:20 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b5b4360f-5763-4cd4-849a-f63a35e079d7 tempest-ProjectReaderTests-34270978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8262e829-493f-4980-8b13-f510d90221f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:12:20 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b5b4360f-5763-4cd4-849a-f63a35e079d7 tempest-ProjectReaderTests-34270978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8262e829-493f-4980-8b13-f510d90221f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:12:20 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b5b4360f-5763-4cd4-849a-f63a35e079d7 tempest-ProjectReaderTests-34270978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a569817-28ee-40f6-988c-d0fbae378698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:12:20 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b5b4360f-5763-4cd4-849a-f63a35e079d7 tempest-ProjectReaderTests-34270978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a569817-28ee-40f6-988c-d0fbae378698) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5239ba6-b6dc-4142-9b0f-ee39212169f6', 'volume_name': 'volume-b5239ba6-b6dc-4142-9b0f-ee39212169f6', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:12:20 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b5b4360f-5763-4cd4-849a-f63a35e079d7 tempest-ProjectReaderTests-34270978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fb0fee8-d53b-4b48-b43d-536c1020ac79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:12:20 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b5b4360f-5763-4cd4-849a-f63a35e079d7 tempest-ProjectReaderTests-34270978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fb0fee8-d53b-4b48-b43d-536c1020ac79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:12:20 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b5b4360f-5763-4cd4-849a-f63a35e079d7 tempest-ProjectReaderTests-34270978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (373209e4-cff2-4902-830a-3035e053d167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:12:20 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-b5b4360f-5763-4cd4-849a-f63a35e079d7 tempest-ProjectReaderTests-34270978 None] Volume b5239ba6-b6dc-4142-9b0f-ee39212169f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5239ba6-b6dc-4142-9b0f-ee39212169f6', 'volume_size': 1} Sep 17 22:12:20 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-b5b4360f-5763-4cd4-849a-f63a35e079d7 tempest-ProjectReaderTests-34270978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:12:20 devstack sudo[105600]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:20 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-55b95af7-110c-4a38-930a-8e6bbcee2160 tempest-ProjectMemberTests-1966135882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.263s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:20 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-55b95af7-110c-4a38-930a-8e6bbcee2160 tempest-ProjectMemberTests-1966135882 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:12:20 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-55b95af7-110c-4a38-930a-8e6bbcee2160 tempest-ProjectMemberTests-1966135882 None] Deleted volume successfully. Sep 17 22:12:20 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-55b95af7-110c-4a38-930a-8e6bbcee2160 tempest-ProjectMemberTests-1966135882 None] Lock "cinder-238721b9-a402-422b-b8ef-911c9f28b1b4-delete_volume" released by "delete_volume" :: held 1.497s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:12:20 devstack sudo[105603]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:20 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-4a0b337e-3d0a-45e6-8f1f-fd3f8c900abf tempest-ProjectReaderTests-1676955223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7d5effe3-e557-4222-9ea3-c6138935197a.info" returned: 0 in 0.269s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:20 devstack cinder-volume[85458]: WARNING cinder.volume.drivers.remotefs [None req-4a0b337e-3d0a-45e6-8f1f-fd3f8c900abf tempest-ProjectReaderTests-1676955223 None] /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7d5effe3-e557-4222-9ea3-c6138935197a.info is being set with open permissions: ugo+rw Sep 17 22:12:20 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-4a0b337e-3d0a-45e6-8f1f-fd3f8c900abf tempest-ProjectReaderTests-1676955223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7d5effe3-e557-4222-9ea3-c6138935197a.info {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:20 devstack sudo[105607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7d5effe3-e557-4222-9ea3-c6138935197a.info Sep 17 22:12:20 devstack sudo[105607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:20 devstack sudo[105607]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:20 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-4a0b337e-3d0a-45e6-8f1f-fd3f8c900abf tempest-ProjectReaderTests-1676955223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7d5effe3-e557-4222-9ea3-c6138935197a.info" returned: 0 in 0.251s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:21 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-4a0b337e-3d0a-45e6-8f1f-fd3f8c900abf tempest-ProjectReaderTests-1676955223 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.426s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:12:21 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-b5b4360f-5763-4cd4-849a-f63a35e079d7 tempest-ProjectReaderTests-34270978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.429s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:12:21 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-b5b4360f-5763-4cd4-849a-f63a35e079d7 tempest-ProjectReaderTests-34270978 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:12:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1807476153',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5239ba6-b6dc-4142-9b0f-ee39212169f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93161e2722304812b3988840a55e6b7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:12:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:12:20Z,use_quota=True,user_id='9f53f87df5e24c87ae5ae18f30f2dd3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 22:12:21 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-b5b4360f-5763-4cd4-849a-f63a35e079d7 tempest-ProjectReaderTests-34270978 None] Creating volume b5239ba6-b6dc-4142-9b0f-ee39212169f6 {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 22:12:21 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-b5b4360f-5763-4cd4-849a-f63a35e079d7 tempest-ProjectReaderTests-34270978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:12:21 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-b5b4360f-5763-4cd4-849a-f63a35e079d7 tempest-ProjectReaderTests-34270978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:12:21 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-b5b4360f-5763-4cd4-849a-f63a35e079d7 tempest-ProjectReaderTests-34270978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:12:21 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-b5b4360f-5763-4cd4-849a-f63a35e079d7 tempest-ProjectReaderTests-34270978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:12:21 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-b5b4360f-5763-4cd4-849a-f63a35e079d7 tempest-ProjectReaderTests-34270978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:12:21 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-b5b4360f-5763-4cd4-849a-f63a35e079d7 tempest-ProjectReaderTests-34270978 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 22:12:21 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-b5b4360f-5763-4cd4-849a-f63a35e079d7 tempest-ProjectReaderTests-34270978 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 22:12:21 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-b5b4360f-5763-4cd4-849a-f63a35e079d7 tempest-ProjectReaderTests-34270978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b5239ba6-b6dc-4142-9b0f-ee39212169f6 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:21 devstack sudo[105610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b5239ba6-b6dc-4142-9b0f-ee39212169f6 1073741824 Sep 17 22:12:21 devstack sudo[105610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:21 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-4a0b337e-3d0a-45e6-8f1f-fd3f8c900abf tempest-ProjectReaderTests-1676955223 None] Create snapshot completed successfully Sep 17 22:12:21 devstack sudo[105610]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:21 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-b5b4360f-5763-4cd4-849a-f63a35e079d7 tempest-ProjectReaderTests-34270978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b5239ba6-b6dc-4142-9b0f-ee39212169f6 1073741824" returned: 0 in 0.541s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:21 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-b5b4360f-5763-4cd4-849a-f63a35e079d7 tempest-ProjectReaderTests-34270978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b5239ba6-b6dc-4142-9b0f-ee39212169f6 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:21 devstack sudo[105616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b5239ba6-b6dc-4142-9b0f-ee39212169f6 Sep 17 22:12:21 devstack sudo[105616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:21 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-cba02d96-a9b9-4bc4-880f-9c5145ad5743 tempest-ProjectReaderTests-1676955223 None] Acquiring lock "cinder-a0995db2-7c93-4fa7-a00b-76bbb20347b1-delete_snapshot" by "delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:12:21 devstack sudo[105616]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:21 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-cba02d96-a9b9-4bc4-880f-9c5145ad5743 tempest-ProjectReaderTests-1676955223 None] Lock "cinder-a0995db2-7c93-4fa7-a00b-76bbb20347b1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:12:21 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-cba02d96-a9b9-4bc4-880f-9c5145ad5743 tempest-ProjectReaderTests-1676955223 None] Acquiring lock "cinder-quobyte-7d5effe3-e557-4222-9ea3-c6138935197a" by "delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:12:21 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-b5b4360f-5763-4cd4-849a-f63a35e079d7 tempest-ProjectReaderTests-34270978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b5239ba6-b6dc-4142-9b0f-ee39212169f6" returned: 0 in 0.347s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:21 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-b5b4360f-5763-4cd4-849a-f63a35e079d7 tempest-ProjectReaderTests-34270978 None] <== create_volume: return (941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 22:12:21 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-b5b4360f-5763-4cd4-849a-f63a35e079d7 tempest-ProjectReaderTests-34270978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.943s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:12:21 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b5b4360f-5763-4cd4-849a-f63a35e079d7 tempest-ProjectReaderTests-34270978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (373209e4-cff2-4902-830a-3035e053d167) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5239ba6-b6dc-4142-9b0f-ee39212169f6', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:12:21 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b5b4360f-5763-4cd4-849a-f63a35e079d7 tempest-ProjectReaderTests-34270978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17b46418-dbbb-4af2-a102-142cac1cb352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:12:21 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-cba02d96-a9b9-4bc4-880f-9c5145ad5743 tempest-ProjectReaderTests-1676955223 None] Lock "cinder-quobyte-7d5effe3-e557-4222-9ea3-c6138935197a" acquired by "delete_snapshot" :: waited 0.047s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:12:21 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-cba02d96-a9b9-4bc4-880f-9c5145ad5743 tempest-ProjectReaderTests-1676955223 None] Acquiring lock "cinder-quobyte-a0995db2-7c93-4fa7-a00b-76bbb20347b1" by "_delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:12:22 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4b0535d-6bb0-4f8c-9531-69911156bcb4 tempest-ProjectMemberTests-1966135882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 22:12:22 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b4b0535d-6bb0-4f8c-9531-69911156bcb4 tempest-ProjectMemberTests-1966135882 None] Flow 'volume_create_manager' (cd84a706-a60c-4993-85a7-6e2802108522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:12:22 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b4b0535d-6bb0-4f8c-9531-69911156bcb4 tempest-ProjectMemberTests-1966135882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc5571d0-1f39-4339-a6f7-7325007723d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:12:22 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-cba02d96-a9b9-4bc4-880f-9c5145ad5743 tempest-ProjectReaderTests-1676955223 None] Lock "cinder-quobyte-a0995db2-7c93-4fa7-a00b-76bbb20347b1" acquired by "_delete_snapshot" :: waited 0.056s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:12:22 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-cba02d96-a9b9-4bc4-880f-9c5145ad5743 tempest-ProjectReaderTests-1676955223 None] Deleting offline snapshot a0995db2-7c93-4fa7-a00b-76bbb20347b1 of volume 7d5effe3-e557-4222-9ea3-c6138935197a {{(pid=85458) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 22:12:22 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-cba02d96-a9b9-4bc4-880f-9c5145ad5743 tempest-ProjectReaderTests-1676955223 None] snapshot_file for this snap is: volume-7d5effe3-e557-4222-9ea3-c6138935197a.a0995db2-7c93-4fa7-a00b-76bbb20347b1 {{(pid=85458) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 22:12:22 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-b5b4360f-5763-4cd4-849a-f63a35e079d7 tempest-ProjectReaderTests-34270978 None] Volume volume-b5239ba6-b6dc-4142-9b0f-ee39212169f6 (b5239ba6-b6dc-4142-9b0f-ee39212169f6): created successfully Sep 17 22:12:22 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b5b4360f-5763-4cd4-849a-f63a35e079d7 tempest-ProjectReaderTests-34270978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17b46418-dbbb-4af2-a102-142cac1cb352) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:12:22 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b5b4360f-5763-4cd4-849a-f63a35e079d7 tempest-ProjectReaderTests-34270978 None] Flow 'volume_create_manager' (5b34b114-2d1d-43a5-a026-fc6bebcf1370) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:12:22 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b4b0535d-6bb0-4f8c-9531-69911156bcb4 tempest-ProjectMemberTests-1966135882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc5571d0-1f39-4339-a6f7-7325007723d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:12:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1736169795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c210208e-fced-42bc-ab86-5536febafd01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f277f501a340474ca5d0daea12e88955',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:12:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:12:22Z,use_quota=True,user_id='e584775bfb3c440aa7aac369d15efa55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:12:22 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b4b0535d-6bb0-4f8c-9531-69911156bcb4 tempest-ProjectMemberTests-1966135882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07e5c691-c6a6-404e-8aeb-8762e807f5ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:12:22 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b4b0535d-6bb0-4f8c-9531-69911156bcb4 tempest-ProjectMemberTests-1966135882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07e5c691-c6a6-404e-8aeb-8762e807f5ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:12:22 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b4b0535d-6bb0-4f8c-9531-69911156bcb4 tempest-ProjectMemberTests-1966135882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ad35483-d43b-43b8-acf2-9f0be7d45fa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:12:22 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b4b0535d-6bb0-4f8c-9531-69911156bcb4 tempest-ProjectMemberTests-1966135882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ad35483-d43b-43b8-acf2-9f0be7d45fa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c210208e-fced-42bc-ab86-5536febafd01', 'volume_name': 'volume-c210208e-fced-42bc-ab86-5536febafd01', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:12:22 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b4b0535d-6bb0-4f8c-9531-69911156bcb4 tempest-ProjectMemberTests-1966135882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7d669dd-ee79-497a-a159-e709573dbad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:12:22 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b4b0535d-6bb0-4f8c-9531-69911156bcb4 tempest-ProjectMemberTests-1966135882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7d669dd-ee79-497a-a159-e709573dbad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:12:22 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b4b0535d-6bb0-4f8c-9531-69911156bcb4 tempest-ProjectMemberTests-1966135882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9eb5d8ab-3b12-49be-883b-a4261592c110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:12:22 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-b4b0535d-6bb0-4f8c-9531-69911156bcb4 tempest-ProjectMemberTests-1966135882 None] Volume c210208e-fced-42bc-ab86-5536febafd01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c210208e-fced-42bc-ab86-5536febafd01', 'volume_size': 1} Sep 17 22:12:22 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-b4b0535d-6bb0-4f8c-9531-69911156bcb4 tempest-ProjectMemberTests-1966135882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:12:22 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-b4b0535d-6bb0-4f8c-9531-69911156bcb4 tempest-ProjectMemberTests-1966135882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:12:22 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-b4b0535d-6bb0-4f8c-9531-69911156bcb4 tempest-ProjectMemberTests-1966135882 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:12:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1736169795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c210208e-fced-42bc-ab86-5536febafd01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f277f501a340474ca5d0daea12e88955',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:12:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:12:22Z,use_quota=True,user_id='e584775bfb3c440aa7aac369d15efa55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 22:12:22 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-b4b0535d-6bb0-4f8c-9531-69911156bcb4 tempest-ProjectMemberTests-1966135882 None] Creating volume c210208e-fced-42bc-ab86-5536febafd01 {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 22:12:22 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-b4b0535d-6bb0-4f8c-9531-69911156bcb4 tempest-ProjectMemberTests-1966135882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:12:22 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-b4b0535d-6bb0-4f8c-9531-69911156bcb4 tempest-ProjectMemberTests-1966135882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:12:22 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-b4b0535d-6bb0-4f8c-9531-69911156bcb4 tempest-ProjectMemberTests-1966135882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:12:22 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-b4b0535d-6bb0-4f8c-9531-69911156bcb4 tempest-ProjectMemberTests-1966135882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:12:22 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-b4b0535d-6bb0-4f8c-9531-69911156bcb4 tempest-ProjectMemberTests-1966135882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:12:22 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-b4b0535d-6bb0-4f8c-9531-69911156bcb4 tempest-ProjectMemberTests-1966135882 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 22:12:22 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-b4b0535d-6bb0-4f8c-9531-69911156bcb4 tempest-ProjectMemberTests-1966135882 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 22:12:22 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-b4b0535d-6bb0-4f8c-9531-69911156bcb4 tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c210208e-fced-42bc-ab86-5536febafd01 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:22 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[73a27b5d-8f16-43e2-b43e-828545dfc18b]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:12:22 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-cba02d96-a9b9-4bc4-880f-9c5145ad5743 tempest-ProjectReaderTests-1676955223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7d5effe3-e557-4222-9ea3-c6138935197a.a0995db2-7c93-4fa7-a00b-76bbb20347b1 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:22 devstack sudo[105619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c210208e-fced-42bc-ab86-5536febafd01 1073741824 Sep 17 22:12:22 devstack sudo[105619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:22 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-b5b4360f-5763-4cd4-849a-f63a35e079d7 tempest-ProjectReaderTests-34270978 None] Created volume successfully. Sep 17 22:12:22 devstack sudo[105620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7d5effe3-e557-4222-9ea3-c6138935197a.a0995db2-7c93-4fa7-a00b-76bbb20347b1 Sep 17 22:12:22 devstack sudo[105620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:22 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-ccc1c407-7f77-4c70-9f1d-e92990f40435 tempest-ProjectReaderTests-34270978 None] Acquiring lock "cinder-b5239ba6-b6dc-4142-9b0f-ee39212169f6-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:12:22 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-ccc1c407-7f77-4c70-9f1d-e92990f40435 tempest-ProjectReaderTests-34270978 None] Lock "cinder-b5239ba6-b6dc-4142-9b0f-ee39212169f6-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:12:22 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-ccc1c407-7f77-4c70-9f1d-e92990f40435 tempest-ProjectReaderTests-34270978 None] Acquiring lock "cinder-quobyte-b5239ba6-b6dc-4142-9b0f-ee39212169f6" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:12:22 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-ccc1c407-7f77-4c70-9f1d-e92990f40435 tempest-ProjectReaderTests-34270978 None] Lock "cinder-quobyte-b5239ba6-b6dc-4142-9b0f-ee39212169f6" acquired by "delete_volume" :: waited 0.018s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:12:22 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[0132c639-87ee-4ace-9c0a-17659b05e957]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:12:22 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-ccc1c407-7f77-4c70-9f1d-e92990f40435 tempest-ProjectReaderTests-34270978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b5239ba6-b6dc-4142-9b0f-ee39212169f6 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:22 devstack sudo[105620]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:22 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-cba02d96-a9b9-4bc4-880f-9c5145ad5743 tempest-ProjectReaderTests-1676955223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7d5effe3-e557-4222-9ea3-c6138935197a.a0995db2-7c93-4fa7-a00b-76bbb20347b1" returned: 0 in 0.473s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:22 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-cba02d96-a9b9-4bc4-880f-9c5145ad5743 tempest-ProjectReaderTests-1676955223 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d5effe3-e557-4222-9ea3-c6138935197a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85458) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 22:12:22 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[33a8907f-d1cb-455c-b519-eb6e6d1a1cec]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:12:22 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-cba02d96-a9b9-4bc4-880f-9c5145ad5743 tempest-ProjectReaderTests-1676955223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7d5effe3-e557-4222-9ea3-c6138935197a {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:22 devstack sudo[105619]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:22 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-b4b0535d-6bb0-4f8c-9531-69911156bcb4 tempest-ProjectMemberTests-1966135882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c210208e-fced-42bc-ab86-5536febafd01 1073741824" returned: 0 in 0.562s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:22 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-b4b0535d-6bb0-4f8c-9531-69911156bcb4 tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c210208e-fced-42bc-ab86-5536febafd01 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:22 devstack sudo[105629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b5239ba6-b6dc-4142-9b0f-ee39212169f6 Sep 17 22:12:22 devstack sudo[105629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:22 devstack sudo[105633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c210208e-fced-42bc-ab86-5536febafd01 Sep 17 22:12:22 devstack sudo[105633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:22 devstack sudo[105631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7d5effe3-e557-4222-9ea3-c6138935197a Sep 17 22:12:22 devstack sudo[105631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:23 devstack sudo[105633]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:23 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-b4b0535d-6bb0-4f8c-9531-69911156bcb4 tempest-ProjectMemberTests-1966135882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c210208e-fced-42bc-ab86-5536febafd01" returned: 0 in 0.269s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:23 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-b4b0535d-6bb0-4f8c-9531-69911156bcb4 tempest-ProjectMemberTests-1966135882 None] <== create_volume: return (877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 22:12:23 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-b4b0535d-6bb0-4f8c-9531-69911156bcb4 tempest-ProjectMemberTests-1966135882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.881s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:12:23 devstack sudo[105629]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:23 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b4b0535d-6bb0-4f8c-9531-69911156bcb4 tempest-ProjectMemberTests-1966135882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9eb5d8ab-3b12-49be-883b-a4261592c110) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c210208e-fced-42bc-ab86-5536febafd01', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:12:23 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b4b0535d-6bb0-4f8c-9531-69911156bcb4 tempest-ProjectMemberTests-1966135882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a5848a6-61ec-4f88-b810-189c0eeb5c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:12:23 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-ccc1c407-7f77-4c70-9f1d-e92990f40435 tempest-ProjectReaderTests-34270978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b5239ba6-b6dc-4142-9b0f-ee39212169f6" returned: 0 in 0.415s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:23 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-ccc1c407-7f77-4c70-9f1d-e92990f40435 tempest-ProjectReaderTests-34270978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b5239ba6-b6dc-4142-9b0f-ee39212169f6 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:23 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-b4b0535d-6bb0-4f8c-9531-69911156bcb4 tempest-ProjectMemberTests-1966135882 None] Volume volume-c210208e-fced-42bc-ab86-5536febafd01 (c210208e-fced-42bc-ab86-5536febafd01): created successfully Sep 17 22:12:23 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b4b0535d-6bb0-4f8c-9531-69911156bcb4 tempest-ProjectMemberTests-1966135882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a5848a6-61ec-4f88-b810-189c0eeb5c16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:12:23 devstack sudo[105643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b5239ba6-b6dc-4142-9b0f-ee39212169f6 Sep 17 22:12:23 devstack sudo[105643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:23 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-b4b0535d-6bb0-4f8c-9531-69911156bcb4 tempest-ProjectMemberTests-1966135882 None] Flow 'volume_create_manager' (cd84a706-a60c-4993-85a7-6e2802108522) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:12:23 devstack sudo[105631]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:23 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-cba02d96-a9b9-4bc4-880f-9c5145ad5743 tempest-ProjectReaderTests-1676955223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7d5effe3-e557-4222-9ea3-c6138935197a" returned: 0 in 0.404s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:23 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-cba02d96-a9b9-4bc4-880f-9c5145ad5743 tempest-ProjectReaderTests-1676955223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7d5effe3-e557-4222-9ea3-c6138935197a.a0995db2-7c93-4fa7-a00b-76bbb20347b1 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:23 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-b4b0535d-6bb0-4f8c-9531-69911156bcb4 tempest-ProjectMemberTests-1966135882 None] Created volume successfully. Sep 17 22:12:23 devstack sudo[105645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7d5effe3-e557-4222-9ea3-c6138935197a.a0995db2-7c93-4fa7-a00b-76bbb20347b1 Sep 17 22:12:23 devstack sudo[105645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:23 devstack sudo[105643]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:23 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-ccc1c407-7f77-4c70-9f1d-e92990f40435 tempest-ProjectReaderTests-34270978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-b5239ba6-b6dc-4142-9b0f-ee39212169f6" returned: 0 in 0.265s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:23 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-ccc1c407-7f77-4c70-9f1d-e92990f40435 tempest-ProjectReaderTests-34270978 None] Lock "cinder-quobyte-b5239ba6-b6dc-4142-9b0f-ee39212169f6" released by "delete_volume" :: held 0.732s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:12:23 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-ccc1c407-7f77-4c70-9f1d-e92990f40435 tempest-ProjectReaderTests-34270978 None] Created reservations ['e76a31ce-07fd-4004-983f-056a12a67a35', '6b89e964-4993-4cf1-aae4-6f3ba34e0849', '8e375f93-d68a-4bb8-bb50-c849a4205afc', '5f19354f-f2c6-4a9c-83fd-19c47fd53aca'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:12:23 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-ccc1c407-7f77-4c70-9f1d-e92990f40435 tempest-ProjectReaderTests-34270978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:12:23 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-ccc1c407-7f77-4c70-9f1d-e92990f40435 tempest-ProjectReaderTests-34270978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:12:23 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-ccc1c407-7f77-4c70-9f1d-e92990f40435 tempest-ProjectReaderTests-34270978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:12:23 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-ccc1c407-7f77-4c70-9f1d-e92990f40435 tempest-ProjectReaderTests-34270978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:12:23 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-ccc1c407-7f77-4c70-9f1d-e92990f40435 tempest-ProjectReaderTests-34270978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:12:23 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-ccc1c407-7f77-4c70-9f1d-e92990f40435 tempest-ProjectReaderTests-34270978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:23 devstack sudo[105645]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:23 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-cba02d96-a9b9-4bc4-880f-9c5145ad5743 tempest-ProjectReaderTests-1676955223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7d5effe3-e557-4222-9ea3-c6138935197a.a0995db2-7c93-4fa7-a00b-76bbb20347b1" returned: 0 in 0.393s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:23 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-cba02d96-a9b9-4bc4-880f-9c5145ad5743 tempest-ProjectReaderTests-1676955223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7d5effe3-e557-4222-9ea3-c6138935197a.a0995db2-7c93-4fa7-a00b-76bbb20347b1 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:23 devstack sudo[105652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:12:23 devstack sudo[105652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:23 devstack sudo[105653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7d5effe3-e557-4222-9ea3-c6138935197a.a0995db2-7c93-4fa7-a00b-76bbb20347b1 Sep 17 22:12:23 devstack sudo[105653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:23 devstack sudo[105652]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:23 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-ccc1c407-7f77-4c70-9f1d-e92990f40435 tempest-ProjectReaderTests-34270978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.278s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:23 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-ccc1c407-7f77-4c70-9f1d-e92990f40435 tempest-ProjectReaderTests-34270978 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:12:23 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-ccc1c407-7f77-4c70-9f1d-e92990f40435 tempest-ProjectReaderTests-34270978 None] Deleted volume successfully. Sep 17 22:12:23 devstack sudo[105653]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:23 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-ccc1c407-7f77-4c70-9f1d-e92990f40435 tempest-ProjectReaderTests-34270978 None] Lock "cinder-b5239ba6-b6dc-4142-9b0f-ee39212169f6-delete_volume" released by "delete_volume" :: held 1.235s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:12:23 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-cba02d96-a9b9-4bc4-880f-9c5145ad5743 tempest-ProjectReaderTests-1676955223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7d5effe3-e557-4222-9ea3-c6138935197a.a0995db2-7c93-4fa7-a00b-76bbb20347b1" returned: 0 in 0.296s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:23 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-cba02d96-a9b9-4bc4-880f-9c5145ad5743 tempest-ProjectReaderTests-1676955223 None] Lock "cinder-quobyte-a0995db2-7c93-4fa7-a00b-76bbb20347b1" released by "_delete_snapshot" :: held 1.769s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:12:23 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-cba02d96-a9b9-4bc4-880f-9c5145ad5743 tempest-ProjectReaderTests-1676955223 None] Lock "cinder-quobyte-7d5effe3-e557-4222-9ea3-c6138935197a" released by "delete_snapshot" :: held 1.835s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:12:23 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-cba02d96-a9b9-4bc4-880f-9c5145ad5743 tempest-ProjectReaderTests-1676955223 None] Created reservations ['2ae500ed-43fb-4028-8d98-35c1eab959ad', '2d6bc3ef-c452-4977-859d-fa97f3bb9ab9', 'e684dd59-190b-4cab-a119-a168a37884f0', '8c5a474d-e745-4403-ac09-91f33ee6622f'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:12:24 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-cba02d96-a9b9-4bc4-880f-9c5145ad5743 tempest-ProjectReaderTests-1676955223 None] Delete snapshot completed successfully. Sep 17 22:12:24 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-cba02d96-a9b9-4bc4-880f-9c5145ad5743 tempest-ProjectReaderTests-1676955223 None] Lock "cinder-a0995db2-7c93-4fa7-a00b-76bbb20347b1-delete_snapshot" released by "delete_snapshot" :: held 2.063s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:12:24 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-9d914769-bfd6-4955-855e-7d0a3233fd6b tempest-ProjectReaderTests-1676955223 None] Acquiring lock "cinder-7d5effe3-e557-4222-9ea3-c6138935197a-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:12:24 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-9d914769-bfd6-4955-855e-7d0a3233fd6b tempest-ProjectReaderTests-1676955223 None] Lock "cinder-7d5effe3-e557-4222-9ea3-c6138935197a-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:12:24 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-9d914769-bfd6-4955-855e-7d0a3233fd6b tempest-ProjectReaderTests-1676955223 None] Acquiring lock "cinder-quobyte-7d5effe3-e557-4222-9ea3-c6138935197a" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:12:24 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-9d914769-bfd6-4955-855e-7d0a3233fd6b tempest-ProjectReaderTests-1676955223 None] Lock "cinder-quobyte-7d5effe3-e557-4222-9ea3-c6138935197a" acquired by "delete_volume" :: waited 0.023s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:12:24 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed696623-6081-4a37-bc4b-6261b428e735]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:12:24 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-9d914769-bfd6-4955-855e-7d0a3233fd6b tempest-ProjectReaderTests-1676955223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7d5effe3-e557-4222-9ea3-c6138935197a {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:24 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-712a5bbd-d0f6-4473-8a0e-7db115ffa39a tempest-ProjectMemberTests-1966135882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:12:24 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-712a5bbd-d0f6-4473-8a0e-7db115ffa39a tempest-ProjectMemberTests-1966135882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:12:24 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfab4a4f-20ce-4543-8874-73f247abee7e tempest-ProjectReaderTests-34270978 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 22:12:24 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-bfab4a4f-20ce-4543-8874-73f247abee7e tempest-ProjectReaderTests-34270978 None] Flow 'volume_create_manager' (4ce65d97-3860-49ed-b3b8-e242fc8b45ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:12:24 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-bfab4a4f-20ce-4543-8874-73f247abee7e tempest-ProjectReaderTests-34270978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4245cf51-4c40-4a36-ba2c-49445a4cf4d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:12:24 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-712a5bbd-d0f6-4473-8a0e-7db115ffa39a tempest-ProjectMemberTests-1966135882 None] Creating offline snapshot 50f3ddce-cab2-4949-bf49-0d70568460c7 of volume c210208e-fced-42bc-ab86-5536febafd01 {{(pid=85458) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 22:12:24 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-bfab4a4f-20ce-4543-8874-73f247abee7e tempest-ProjectReaderTests-34270978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4245cf51-4c40-4a36-ba2c-49445a4cf4d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:12:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-457175356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30d4f5fd-9841-41bb-b4c1-3a1164867edd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93161e2722304812b3988840a55e6b7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:12:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:12:24Z,use_quota=True,user_id='9f53f87df5e24c87ae5ae18f30f2dd3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:12:24 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-bfab4a4f-20ce-4543-8874-73f247abee7e tempest-ProjectReaderTests-34270978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c39b45f4-4d4c-4d75-81a2-ed5717b95f7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:12:24 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-bfab4a4f-20ce-4543-8874-73f247abee7e tempest-ProjectReaderTests-34270978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c39b45f4-4d4c-4d75-81a2-ed5717b95f7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:12:24 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-bfab4a4f-20ce-4543-8874-73f247abee7e tempest-ProjectReaderTests-34270978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89ccaf69-1b90-412c-a2c9-b41814927017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:12:24 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-bfab4a4f-20ce-4543-8874-73f247abee7e tempest-ProjectReaderTests-34270978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89ccaf69-1b90-412c-a2c9-b41814927017) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30d4f5fd-9841-41bb-b4c1-3a1164867edd', 'volume_name': 'volume-30d4f5fd-9841-41bb-b4c1-3a1164867edd', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:12:24 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-bfab4a4f-20ce-4543-8874-73f247abee7e tempest-ProjectReaderTests-34270978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c44777c-404f-490f-af9c-475bfd44963f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:12:24 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-bfab4a4f-20ce-4543-8874-73f247abee7e tempest-ProjectReaderTests-34270978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c44777c-404f-490f-af9c-475bfd44963f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:12:24 devstack sudo[105658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7d5effe3-e557-4222-9ea3-c6138935197a Sep 17 22:12:24 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-bfab4a4f-20ce-4543-8874-73f247abee7e tempest-ProjectReaderTests-34270978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcf77a93-333e-4781-a348-86b9d8744374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:12:24 devstack sudo[105658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:24 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-bfab4a4f-20ce-4543-8874-73f247abee7e tempest-ProjectReaderTests-34270978 None] Volume 30d4f5fd-9841-41bb-b4c1-3a1164867edd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30d4f5fd-9841-41bb-b4c1-3a1164867edd', 'volume_size': 1} Sep 17 22:12:24 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-bfab4a4f-20ce-4543-8874-73f247abee7e tempest-ProjectReaderTests-34270978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:12:24 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[229f4015-9d02-4ce9-a4d8-1ae93388d808]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:12:24 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-712a5bbd-d0f6-4473-8a0e-7db115ffa39a tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c210208e-fced-42bc-ab86-5536febafd01 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:24 devstack sudo[105660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c210208e-fced-42bc-ab86-5536febafd01 Sep 17 22:12:24 devstack sudo[105660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:24 devstack sudo[105658]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:24 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-9d914769-bfd6-4955-855e-7d0a3233fd6b tempest-ProjectReaderTests-1676955223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7d5effe3-e557-4222-9ea3-c6138935197a" returned: 0 in 0.436s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:24 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-9d914769-bfd6-4955-855e-7d0a3233fd6b tempest-ProjectReaderTests-1676955223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7d5effe3-e557-4222-9ea3-c6138935197a {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:24 devstack sudo[105665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7d5effe3-e557-4222-9ea3-c6138935197a Sep 17 22:12:24 devstack sudo[105665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:24 devstack sudo[105660]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:24 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-712a5bbd-d0f6-4473-8a0e-7db115ffa39a tempest-ProjectMemberTests-1966135882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c210208e-fced-42bc-ab86-5536febafd01" returned: 0 in 0.415s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:24 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-712a5bbd-d0f6-4473-8a0e-7db115ffa39a tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c210208e-fced-42bc-ab86-5536febafd01,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c210208e-fced-42bc-ab86-5536febafd01.50f3ddce-cab2-4949-bf49-0d70568460c7 1G {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:25 devstack sudo[105670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c210208e-fced-42bc-ab86-5536febafd01,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c210208e-fced-42bc-ab86-5536febafd01.50f3ddce-cab2-4949-bf49-0d70568460c7 1G Sep 17 22:12:25 devstack sudo[105670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:25 devstack sudo[105665]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:25 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-9d914769-bfd6-4955-855e-7d0a3233fd6b tempest-ProjectReaderTests-1676955223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7d5effe3-e557-4222-9ea3-c6138935197a" returned: 0 in 0.282s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:25 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-9d914769-bfd6-4955-855e-7d0a3233fd6b tempest-ProjectReaderTests-1676955223 None] Lock "cinder-quobyte-7d5effe3-e557-4222-9ea3-c6138935197a" released by "delete_volume" :: held 0.796s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:12:25 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-9d914769-bfd6-4955-855e-7d0a3233fd6b tempest-ProjectReaderTests-1676955223 None] Created reservations ['bfedb32d-ce5e-40b7-8217-4c0631e4c93f', '0eaf9a1f-ea06-4b55-9316-d899fbaad688', '03b7b55d-d139-4121-9078-3a2a461225ae', 'aa1f6591-3d1c-465f-8e25-eff9b4f0a02b'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:12:25 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-9d914769-bfd6-4955-855e-7d0a3233fd6b tempest-ProjectReaderTests-1676955223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:12:25 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-9d914769-bfd6-4955-855e-7d0a3233fd6b tempest-ProjectReaderTests-1676955223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:12:25 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-9d914769-bfd6-4955-855e-7d0a3233fd6b tempest-ProjectReaderTests-1676955223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:12:25 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-9d914769-bfd6-4955-855e-7d0a3233fd6b tempest-ProjectReaderTests-1676955223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:12:25 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-9d914769-bfd6-4955-855e-7d0a3233fd6b tempest-ProjectReaderTests-1676955223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:12:25 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-9d914769-bfd6-4955-855e-7d0a3233fd6b tempest-ProjectReaderTests-1676955223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:25 devstack sudo[105676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:12:25 devstack sudo[105676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:25 devstack sudo[105670]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:25 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-712a5bbd-d0f6-4473-8a0e-7db115ffa39a tempest-ProjectMemberTests-1966135882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c210208e-fced-42bc-ab86-5536febafd01,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c210208e-fced-42bc-ab86-5536febafd01.50f3ddce-cab2-4949-bf49-0d70568460c7 1G" returned: 0 in 0.584s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:25 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-712a5bbd-d0f6-4473-8a0e-7db115ffa39a tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c210208e-fced-42bc-ab86-5536febafd01 -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c210208e-fced-42bc-ab86-5536febafd01.50f3ddce-cab2-4949-bf49-0d70568460c7 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:25 devstack sudo[105680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c210208e-fced-42bc-ab86-5536febafd01 -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c210208e-fced-42bc-ab86-5536febafd01.50f3ddce-cab2-4949-bf49-0d70568460c7 Sep 17 22:12:25 devstack sudo[105680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:25 devstack sudo[105676]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:25 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-9d914769-bfd6-4955-855e-7d0a3233fd6b tempest-ProjectReaderTests-1676955223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.289s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:25 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-9d914769-bfd6-4955-855e-7d0a3233fd6b tempest-ProjectReaderTests-1676955223 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:12:25 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-9d914769-bfd6-4955-855e-7d0a3233fd6b tempest-ProjectReaderTests-1676955223 None] Deleted volume successfully. Sep 17 22:12:25 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-9d914769-bfd6-4955-855e-7d0a3233fd6b tempest-ProjectReaderTests-1676955223 None] Lock "cinder-7d5effe3-e557-4222-9ea3-c6138935197a-delete_volume" released by "delete_volume" :: held 1.420s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:12:25 devstack sudo[105680]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:25 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-712a5bbd-d0f6-4473-8a0e-7db115ffa39a tempest-ProjectMemberTests-1966135882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c210208e-fced-42bc-ab86-5536febafd01 -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c210208e-fced-42bc-ab86-5536febafd01.50f3ddce-cab2-4949-bf49-0d70568460c7" returned: 0 in 0.418s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:25 devstack cinder-volume[85458]: WARNING cinder.volume.drivers.remotefs [None req-712a5bbd-d0f6-4473-8a0e-7db115ffa39a tempest-ProjectMemberTests-1966135882 None] /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c210208e-fced-42bc-ab86-5536febafd01.50f3ddce-cab2-4949-bf49-0d70568460c7 is being set with open permissions: ugo+rw Sep 17 22:12:25 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-712a5bbd-d0f6-4473-8a0e-7db115ffa39a tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c210208e-fced-42bc-ab86-5536febafd01.50f3ddce-cab2-4949-bf49-0d70568460c7 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:26 devstack sudo[105720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c210208e-fced-42bc-ab86-5536febafd01.50f3ddce-cab2-4949-bf49-0d70568460c7 Sep 17 22:12:26 devstack sudo[105720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:26 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a9ced39-de03-4f20-9f3b-ab130e6f7366 tempest-ProjectReaderTests-1676955223 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 22:12:26 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-6a9ced39-de03-4f20-9f3b-ab130e6f7366 tempest-ProjectReaderTests-1676955223 None] Flow 'volume_create_manager' (29c63cfe-bdce-4a58-91ad-0f9429281fab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:12:26 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-6a9ced39-de03-4f20-9f3b-ab130e6f7366 tempest-ProjectReaderTests-1676955223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (124322e6-a65c-46ad-a352-8909b285d62e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:12:26 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-6a9ced39-de03-4f20-9f3b-ab130e6f7366 tempest-ProjectReaderTests-1676955223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (124322e6-a65c-46ad-a352-8909b285d62e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:12:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-474046259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a41af51-fba4-4c09-a9d6-6afddd6691f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e4464b587ad40759679fd10b5eda168',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:12:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:12:26Z,use_quota=True,user_id='dcf31a786e3845bab1a502363d0f3482',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:12:26 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-6a9ced39-de03-4f20-9f3b-ab130e6f7366 tempest-ProjectReaderTests-1676955223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (796f43ad-35fd-4f97-b415-bf5d215e2925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:12:26 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-6a9ced39-de03-4f20-9f3b-ab130e6f7366 tempest-ProjectReaderTests-1676955223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (796f43ad-35fd-4f97-b415-bf5d215e2925) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:12:26 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-6a9ced39-de03-4f20-9f3b-ab130e6f7366 tempest-ProjectReaderTests-1676955223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed7b6964-255e-46a8-8b24-d73ac2ecacd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:12:26 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-6a9ced39-de03-4f20-9f3b-ab130e6f7366 tempest-ProjectReaderTests-1676955223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed7b6964-255e-46a8-8b24-d73ac2ecacd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a41af51-fba4-4c09-a9d6-6afddd6691f8', 'volume_name': 'volume-0a41af51-fba4-4c09-a9d6-6afddd6691f8', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:12:26 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-6a9ced39-de03-4f20-9f3b-ab130e6f7366 tempest-ProjectReaderTests-1676955223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28b67d66-1ce5-45f0-8373-e4588116ef28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:12:26 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-6a9ced39-de03-4f20-9f3b-ab130e6f7366 tempest-ProjectReaderTests-1676955223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28b67d66-1ce5-45f0-8373-e4588116ef28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:12:26 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-6a9ced39-de03-4f20-9f3b-ab130e6f7366 tempest-ProjectReaderTests-1676955223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ca3f9b2-fcaf-4c98-9a5f-4148be377742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:12:26 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-6a9ced39-de03-4f20-9f3b-ab130e6f7366 tempest-ProjectReaderTests-1676955223 None] Volume 0a41af51-fba4-4c09-a9d6-6afddd6691f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a41af51-fba4-4c09-a9d6-6afddd6691f8', 'volume_size': 1} Sep 17 22:12:26 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-6a9ced39-de03-4f20-9f3b-ab130e6f7366 tempest-ProjectReaderTests-1676955223 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:12:26 devstack sudo[105720]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:26 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-712a5bbd-d0f6-4473-8a0e-7db115ffa39a tempest-ProjectMemberTests-1966135882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c210208e-fced-42bc-ab86-5536febafd01.50f3ddce-cab2-4949-bf49-0d70568460c7" returned: 0 in 0.402s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:26 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-712a5bbd-d0f6-4473-8a0e-7db115ffa39a tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c210208e-fced-42bc-ab86-5536febafd01.info {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:26 devstack sudo[105725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c210208e-fced-42bc-ab86-5536febafd01.info Sep 17 22:12:26 devstack sudo[105725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:26 devstack sudo[105725]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:26 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-712a5bbd-d0f6-4473-8a0e-7db115ffa39a tempest-ProjectMemberTests-1966135882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c210208e-fced-42bc-ab86-5536febafd01.info" returned: 0 in 0.261s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:26 devstack cinder-volume[85458]: WARNING cinder.volume.drivers.remotefs [None req-712a5bbd-d0f6-4473-8a0e-7db115ffa39a tempest-ProjectMemberTests-1966135882 None] /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c210208e-fced-42bc-ab86-5536febafd01.info is being set with open permissions: ugo+rw Sep 17 22:12:26 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-712a5bbd-d0f6-4473-8a0e-7db115ffa39a tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c210208e-fced-42bc-ab86-5536febafd01.info {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:26 devstack sudo[105728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c210208e-fced-42bc-ab86-5536febafd01.info Sep 17 22:12:26 devstack sudo[105728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:26 devstack sudo[105728]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:26 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-712a5bbd-d0f6-4473-8a0e-7db115ffa39a tempest-ProjectMemberTests-1966135882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c210208e-fced-42bc-ab86-5536febafd01.info" returned: 0 in 0.250s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:26 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-712a5bbd-d0f6-4473-8a0e-7db115ffa39a tempest-ProjectMemberTests-1966135882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.502s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:12:26 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-bfab4a4f-20ce-4543-8874-73f247abee7e tempest-ProjectReaderTests-34270978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.407s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:12:26 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-bfab4a4f-20ce-4543-8874-73f247abee7e tempest-ProjectReaderTests-34270978 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:12:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-457175356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30d4f5fd-9841-41bb-b4c1-3a1164867edd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93161e2722304812b3988840a55e6b7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:12:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:12:24Z,use_quota=True,user_id='9f53f87df5e24c87ae5ae18f30f2dd3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 22:12:26 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-bfab4a4f-20ce-4543-8874-73f247abee7e tempest-ProjectReaderTests-34270978 None] Creating volume 30d4f5fd-9841-41bb-b4c1-3a1164867edd {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 22:12:26 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-bfab4a4f-20ce-4543-8874-73f247abee7e tempest-ProjectReaderTests-34270978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:12:26 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-bfab4a4f-20ce-4543-8874-73f247abee7e tempest-ProjectReaderTests-34270978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:12:26 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-bfab4a4f-20ce-4543-8874-73f247abee7e tempest-ProjectReaderTests-34270978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:12:26 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-bfab4a4f-20ce-4543-8874-73f247abee7e tempest-ProjectReaderTests-34270978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:12:26 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-bfab4a4f-20ce-4543-8874-73f247abee7e tempest-ProjectReaderTests-34270978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:12:26 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-bfab4a4f-20ce-4543-8874-73f247abee7e tempest-ProjectReaderTests-34270978 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 22:12:26 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-bfab4a4f-20ce-4543-8874-73f247abee7e tempest-ProjectReaderTests-34270978 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 22:12:26 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-bfab4a4f-20ce-4543-8874-73f247abee7e tempest-ProjectReaderTests-34270978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-30d4f5fd-9841-41bb-b4c1-3a1164867edd 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:27 devstack sudo[105731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-30d4f5fd-9841-41bb-b4c1-3a1164867edd 1073741824 Sep 17 22:12:27 devstack sudo[105731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:27 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-712a5bbd-d0f6-4473-8a0e-7db115ffa39a tempest-ProjectMemberTests-1966135882 None] Create snapshot completed successfully Sep 17 22:12:27 devstack sudo[105731]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:27 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-b08e1bbe-039a-4348-b9fe-4b1cfb4da4c4 tempest-ProjectMemberTests-1966135882 None] Acquiring lock "cinder-50f3ddce-cab2-4949-bf49-0d70568460c7-delete_snapshot" by "delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:12:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-bfab4a4f-20ce-4543-8874-73f247abee7e tempest-ProjectReaderTests-34270978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-30d4f5fd-9841-41bb-b4c1-3a1164867edd 1073741824" returned: 0 in 0.465s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:27 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-b08e1bbe-039a-4348-b9fe-4b1cfb4da4c4 tempest-ProjectMemberTests-1966135882 None] Lock "cinder-50f3ddce-cab2-4949-bf49-0d70568460c7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:12:27 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-b08e1bbe-039a-4348-b9fe-4b1cfb4da4c4 tempest-ProjectMemberTests-1966135882 None] Acquiring lock "cinder-quobyte-c210208e-fced-42bc-ab86-5536febafd01" by "delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:12:27 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-b08e1bbe-039a-4348-b9fe-4b1cfb4da4c4 tempest-ProjectMemberTests-1966135882 None] Lock "cinder-quobyte-c210208e-fced-42bc-ab86-5536febafd01" acquired by "delete_snapshot" :: waited 0.021s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:12:27 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-b08e1bbe-039a-4348-b9fe-4b1cfb4da4c4 tempest-ProjectMemberTests-1966135882 None] Acquiring lock "cinder-quobyte-50f3ddce-cab2-4949-bf49-0d70568460c7" by "_delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:12:27 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-b08e1bbe-039a-4348-b9fe-4b1cfb4da4c4 tempest-ProjectMemberTests-1966135882 None] Lock "cinder-quobyte-50f3ddce-cab2-4949-bf49-0d70568460c7" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:12:27 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-b08e1bbe-039a-4348-b9fe-4b1cfb4da4c4 tempest-ProjectMemberTests-1966135882 None] Deleting offline snapshot 50f3ddce-cab2-4949-bf49-0d70568460c7 of volume c210208e-fced-42bc-ab86-5536febafd01 {{(pid=85458) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 22:12:27 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-b08e1bbe-039a-4348-b9fe-4b1cfb4da4c4 tempest-ProjectMemberTests-1966135882 None] snapshot_file for this snap is: volume-c210208e-fced-42bc-ab86-5536febafd01.50f3ddce-cab2-4949-bf49-0d70568460c7 {{(pid=85458) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 22:12:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-bfab4a4f-20ce-4543-8874-73f247abee7e tempest-ProjectReaderTests-34270978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-30d4f5fd-9841-41bb-b4c1-3a1164867edd {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:27 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c4b2de4-5d3c-4047-916d-93f61129266f]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:12:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-b08e1bbe-039a-4348-b9fe-4b1cfb4da4c4 tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c210208e-fced-42bc-ab86-5536febafd01.50f3ddce-cab2-4949-bf49-0d70568460c7 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:27 devstack sudo[105737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-30d4f5fd-9841-41bb-b4c1-3a1164867edd Sep 17 22:12:27 devstack sudo[105737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:27 devstack sudo[105738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c210208e-fced-42bc-ab86-5536febafd01.50f3ddce-cab2-4949-bf49-0d70568460c7 Sep 17 22:12:27 devstack sudo[105738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:27 devstack cinder-volume[85458]: DEBUG oslo_service.periodic_task [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85458) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 22:12:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:12:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:12:27 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:12:27 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:12:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:12:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:27 devstack sudo[105742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:12:27 devstack sudo[105742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:27 devstack sudo[105737]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-bfab4a4f-20ce-4543-8874-73f247abee7e tempest-ProjectReaderTests-34270978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-30d4f5fd-9841-41bb-b4c1-3a1164867edd" returned: 0 in 0.304s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:27 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-bfab4a4f-20ce-4543-8874-73f247abee7e tempest-ProjectReaderTests-34270978 None] <== create_volume: return (882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 22:12:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-bfab4a4f-20ce-4543-8874-73f247abee7e tempest-ProjectReaderTests-34270978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.885s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:12:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-6a9ced39-de03-4f20-9f3b-ab130e6f7366 tempest-ProjectReaderTests-1676955223 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.699s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:12:27 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-6a9ced39-de03-4f20-9f3b-ab130e6f7366 tempest-ProjectReaderTests-1676955223 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:12:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-474046259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a41af51-fba4-4c09-a9d6-6afddd6691f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e4464b587ad40759679fd10b5eda168',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:12:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:12:26Z,use_quota=True,user_id='dcf31a786e3845bab1a502363d0f3482',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 22:12:27 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-6a9ced39-de03-4f20-9f3b-ab130e6f7366 tempest-ProjectReaderTests-1676955223 None] Creating volume 0a41af51-fba4-4c09-a9d6-6afddd6691f8 {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 22:12:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-6a9ced39-de03-4f20-9f3b-ab130e6f7366 tempest-ProjectReaderTests-1676955223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:12:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-6a9ced39-de03-4f20-9f3b-ab130e6f7366 tempest-ProjectReaderTests-1676955223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:12:27 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-6a9ced39-de03-4f20-9f3b-ab130e6f7366 tempest-ProjectReaderTests-1676955223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:12:27 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-6a9ced39-de03-4f20-9f3b-ab130e6f7366 tempest-ProjectReaderTests-1676955223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:12:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-6a9ced39-de03-4f20-9f3b-ab130e6f7366 tempest-ProjectReaderTests-1676955223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:12:27 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-6a9ced39-de03-4f20-9f3b-ab130e6f7366 tempest-ProjectReaderTests-1676955223 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 22:12:27 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-6a9ced39-de03-4f20-9f3b-ab130e6f7366 tempest-ProjectReaderTests-1676955223 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 22:12:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-6a9ced39-de03-4f20-9f3b-ab130e6f7366 tempest-ProjectReaderTests-1676955223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0a41af51-fba4-4c09-a9d6-6afddd6691f8 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:27 devstack sudo[105745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0a41af51-fba4-4c09-a9d6-6afddd6691f8 1073741824 Sep 17 22:12:27 devstack sudo[105745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:27 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-bfab4a4f-20ce-4543-8874-73f247abee7e tempest-ProjectReaderTests-34270978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcf77a93-333e-4781-a348-86b9d8744374) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30d4f5fd-9841-41bb-b4c1-3a1164867edd', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:12:27 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-bfab4a4f-20ce-4543-8874-73f247abee7e tempest-ProjectReaderTests-34270978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64a5b986-bcc1-4fc2-8c4e-4dc52178f69c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:12:27 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-bfab4a4f-20ce-4543-8874-73f247abee7e tempest-ProjectReaderTests-34270978 None] Volume volume-30d4f5fd-9841-41bb-b4c1-3a1164867edd (30d4f5fd-9841-41bb-b4c1-3a1164867edd): created successfully Sep 17 22:12:27 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-bfab4a4f-20ce-4543-8874-73f247abee7e tempest-ProjectReaderTests-34270978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64a5b986-bcc1-4fc2-8c4e-4dc52178f69c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:12:27 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-bfab4a4f-20ce-4543-8874-73f247abee7e tempest-ProjectReaderTests-34270978 None] Flow 'volume_create_manager' (4ce65d97-3860-49ed-b3b8-e242fc8b45ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:12:27 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-bfab4a4f-20ce-4543-8874-73f247abee7e tempest-ProjectReaderTests-34270978 None] Created volume successfully. Sep 17 22:12:28 devstack sudo[105738]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:28 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-b08e1bbe-039a-4348-b9fe-4b1cfb4da4c4 tempest-ProjectMemberTests-1966135882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c210208e-fced-42bc-ab86-5536febafd01.50f3ddce-cab2-4949-bf49-0d70568460c7" returned: 0 in 0.527s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:28 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-b08e1bbe-039a-4348-b9fe-4b1cfb4da4c4 tempest-ProjectMemberTests-1966135882 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c210208e-fced-42bc-ab86-5536febafd01(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85458) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 22:12:28 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7d09cb6-dae3-4c57-9f43-391d3bfa26bf]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:12:28 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-b08e1bbe-039a-4348-b9fe-4b1cfb4da4c4 tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c210208e-fced-42bc-ab86-5536febafd01 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:28 devstack sudo[105742]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:28 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.405s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:28 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:12:28 devstack cinder-volume[85458]: DEBUG oslo_service.periodic_task [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Running periodic task VolumeManager._thread_info {{(pid=85458) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 22:12:28 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] thread count: 28 {{(pid=85458) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 22:12:28 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] thread info: [<_MainThread(MainThread, started 127546830999680)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85458) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 22:12:28 devstack sudo[105751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c210208e-fced-42bc-ab86-5536febafd01 Sep 17 22:12:28 devstack sudo[105751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:28 devstack sudo[105745]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:28 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-6a9ced39-de03-4f20-9f3b-ab130e6f7366 tempest-ProjectReaderTests-1676955223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0a41af51-fba4-4c09-a9d6-6afddd6691f8 1073741824" returned: 0 in 0.617s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:28 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-6a9ced39-de03-4f20-9f3b-ab130e6f7366 tempest-ProjectReaderTests-1676955223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0a41af51-fba4-4c09-a9d6-6afddd6691f8 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:28 devstack sudo[105760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0a41af51-fba4-4c09-a9d6-6afddd6691f8 Sep 17 22:12:28 devstack sudo[105760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:28 devstack sudo[105751]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:28 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-b08e1bbe-039a-4348-b9fe-4b1cfb4da4c4 tempest-ProjectMemberTests-1966135882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c210208e-fced-42bc-ab86-5536febafd01" returned: 0 in 0.489s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:28 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-b08e1bbe-039a-4348-b9fe-4b1cfb4da4c4 tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c210208e-fced-42bc-ab86-5536febafd01.50f3ddce-cab2-4949-bf49-0d70568460c7 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:28 devstack sudo[105762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c210208e-fced-42bc-ab86-5536febafd01.50f3ddce-cab2-4949-bf49-0d70568460c7 Sep 17 22:12:28 devstack sudo[105762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:28 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-ac18d70f-1cd5-401a-b076-77f96570112d tempest-ProjectReaderTests-34270978 None] Acquiring lock "cinder-30d4f5fd-9841-41bb-b4c1-3a1164867edd-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:12:28 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-ac18d70f-1cd5-401a-b076-77f96570112d tempest-ProjectReaderTests-34270978 None] Lock "cinder-30d4f5fd-9841-41bb-b4c1-3a1164867edd-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:12:28 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-ac18d70f-1cd5-401a-b076-77f96570112d tempest-ProjectReaderTests-34270978 None] Acquiring lock "cinder-quobyte-30d4f5fd-9841-41bb-b4c1-3a1164867edd" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:12:28 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-ac18d70f-1cd5-401a-b076-77f96570112d tempest-ProjectReaderTests-34270978 None] Lock "cinder-quobyte-30d4f5fd-9841-41bb-b4c1-3a1164867edd" acquired by "delete_volume" :: waited 0.022s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:12:28 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[c606358f-3851-48f0-a2f4-42df59f08da3]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:12:28 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-ac18d70f-1cd5-401a-b076-77f96570112d tempest-ProjectReaderTests-34270978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-30d4f5fd-9841-41bb-b4c1-3a1164867edd {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:28 devstack sudo[105760]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:28 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-6a9ced39-de03-4f20-9f3b-ab130e6f7366 tempest-ProjectReaderTests-1676955223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0a41af51-fba4-4c09-a9d6-6afddd6691f8" returned: 0 in 0.340s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:28 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-6a9ced39-de03-4f20-9f3b-ab130e6f7366 tempest-ProjectReaderTests-1676955223 None] <== create_volume: return (1029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 22:12:28 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-6a9ced39-de03-4f20-9f3b-ab130e6f7366 tempest-ProjectReaderTests-1676955223 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.033s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:12:28 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-6a9ced39-de03-4f20-9f3b-ab130e6f7366 tempest-ProjectReaderTests-1676955223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ca3f9b2-fcaf-4c98-9a5f-4148be377742) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a41af51-fba4-4c09-a9d6-6afddd6691f8', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:12:28 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-6a9ced39-de03-4f20-9f3b-ab130e6f7366 tempest-ProjectReaderTests-1676955223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2c03cc9-44ee-4d7a-a887-12717cbebe3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:12:28 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-6a9ced39-de03-4f20-9f3b-ab130e6f7366 tempest-ProjectReaderTests-1676955223 None] Volume volume-0a41af51-fba4-4c09-a9d6-6afddd6691f8 (0a41af51-fba4-4c09-a9d6-6afddd6691f8): created successfully Sep 17 22:12:28 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-6a9ced39-de03-4f20-9f3b-ab130e6f7366 tempest-ProjectReaderTests-1676955223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2c03cc9-44ee-4d7a-a887-12717cbebe3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:12:28 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-6a9ced39-de03-4f20-9f3b-ab130e6f7366 tempest-ProjectReaderTests-1676955223 None] Flow 'volume_create_manager' (29c63cfe-bdce-4a58-91ad-0f9429281fab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:12:28 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-6a9ced39-de03-4f20-9f3b-ab130e6f7366 tempest-ProjectReaderTests-1676955223 None] Created volume successfully. Sep 17 22:12:29 devstack sudo[105765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-30d4f5fd-9841-41bb-b4c1-3a1164867edd Sep 17 22:12:29 devstack sudo[105765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:29 devstack sudo[105762]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:29 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-b08e1bbe-039a-4348-b9fe-4b1cfb4da4c4 tempest-ProjectMemberTests-1966135882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c210208e-fced-42bc-ab86-5536febafd01.50f3ddce-cab2-4949-bf49-0d70568460c7" returned: 0 in 0.476s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:29 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-b08e1bbe-039a-4348-b9fe-4b1cfb4da4c4 tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c210208e-fced-42bc-ab86-5536febafd01.50f3ddce-cab2-4949-bf49-0d70568460c7 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:29 devstack sudo[105771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c210208e-fced-42bc-ab86-5536febafd01.50f3ddce-cab2-4949-bf49-0d70568460c7 Sep 17 22:12:29 devstack sudo[105771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:29 devstack sudo[105765]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:29 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-91f84c90-a851-4ce5-b438-99f536d5515e tempest-ProjectReaderTests-1676955223 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:12:29 devstack sudo[105771]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:29 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-91f84c90-a851-4ce5-b438-99f536d5515e tempest-ProjectReaderTests-1676955223 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:12:29 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-b08e1bbe-039a-4348-b9fe-4b1cfb4da4c4 tempest-ProjectMemberTests-1966135882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c210208e-fced-42bc-ab86-5536febafd01.50f3ddce-cab2-4949-bf49-0d70568460c7" returned: 0 in 0.315s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:29 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-ac18d70f-1cd5-401a-b076-77f96570112d tempest-ProjectReaderTests-34270978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-30d4f5fd-9841-41bb-b4c1-3a1164867edd" returned: 0 in 0.540s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:29 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-ac18d70f-1cd5-401a-b076-77f96570112d tempest-ProjectReaderTests-34270978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-30d4f5fd-9841-41bb-b4c1-3a1164867edd {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:29 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-91f84c90-a851-4ce5-b438-99f536d5515e tempest-ProjectReaderTests-1676955223 None] Creating offline snapshot dcd7c8dd-345f-437d-b901-fe595f860f9a of volume 0a41af51-fba4-4c09-a9d6-6afddd6691f8 {{(pid=85458) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 22:12:29 devstack sudo[105777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-30d4f5fd-9841-41bb-b4c1-3a1164867edd Sep 17 22:12:29 devstack sudo[105777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:29 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-b08e1bbe-039a-4348-b9fe-4b1cfb4da4c4 tempest-ProjectMemberTests-1966135882 None] Lock "cinder-quobyte-50f3ddce-cab2-4949-bf49-0d70568460c7" released by "_delete_snapshot" :: held 1.963s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:12:29 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-b08e1bbe-039a-4348-b9fe-4b1cfb4da4c4 tempest-ProjectMemberTests-1966135882 None] Lock "cinder-quobyte-c210208e-fced-42bc-ab86-5536febafd01" released by "delete_snapshot" :: held 1.995s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:12:29 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[41a503de-1b42-4832-8ba1-a815e8b58a18]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:12:29 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-91f84c90-a851-4ce5-b438-99f536d5515e tempest-ProjectReaderTests-1676955223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0a41af51-fba4-4c09-a9d6-6afddd6691f8 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:29 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-b08e1bbe-039a-4348-b9fe-4b1cfb4da4c4 tempest-ProjectMemberTests-1966135882 None] Created reservations ['1aa6f98c-393c-4e0c-b726-fbd8d4b4c02f', '772a674f-b87b-4d91-929d-b73e3d0e9720', '2a47dd7b-1067-4e06-987a-5bb539d0f59c', '1c19d803-7cd0-4a67-bc25-34e1fe272d1b'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:12:29 devstack sudo[105779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0a41af51-fba4-4c09-a9d6-6afddd6691f8 Sep 17 22:12:29 devstack sudo[105779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:29 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-b08e1bbe-039a-4348-b9fe-4b1cfb4da4c4 tempest-ProjectMemberTests-1966135882 None] Delete snapshot completed successfully. Sep 17 22:12:29 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-b08e1bbe-039a-4348-b9fe-4b1cfb4da4c4 tempest-ProjectMemberTests-1966135882 None] Lock "cinder-50f3ddce-cab2-4949-bf49-0d70568460c7-delete_snapshot" released by "delete_snapshot" :: held 2.192s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:12:29 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-e893d88c-426a-4837-af15-46a1a62be810 tempest-ProjectMemberTests-1966135882 None] Acquiring lock "cinder-c210208e-fced-42bc-ab86-5536febafd01-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:12:29 devstack sudo[105777]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:29 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-ac18d70f-1cd5-401a-b076-77f96570112d tempest-ProjectReaderTests-34270978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-30d4f5fd-9841-41bb-b4c1-3a1164867edd" returned: 0 in 0.326s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:29 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-ac18d70f-1cd5-401a-b076-77f96570112d tempest-ProjectReaderTests-34270978 None] Lock "cinder-quobyte-30d4f5fd-9841-41bb-b4c1-3a1164867edd" released by "delete_volume" :: held 0.970s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:12:29 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-e893d88c-426a-4837-af15-46a1a62be810 tempest-ProjectMemberTests-1966135882 None] Lock "cinder-c210208e-fced-42bc-ab86-5536febafd01-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:12:29 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-e893d88c-426a-4837-af15-46a1a62be810 tempest-ProjectMemberTests-1966135882 None] Acquiring lock "cinder-quobyte-c210208e-fced-42bc-ab86-5536febafd01" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:12:29 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-ac18d70f-1cd5-401a-b076-77f96570112d tempest-ProjectReaderTests-34270978 None] Created reservations ['1a354637-a482-4a26-b5ca-d10a3efdae74', '7646b647-77b7-43ea-9e3a-1987c6f52aeb', '615a6b4f-47fe-4759-ac1f-6b41c6602f9e', '63a81898-9e37-4faf-b989-0dd177f72680'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:12:29 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-e893d88c-426a-4837-af15-46a1a62be810 tempest-ProjectMemberTests-1966135882 None] Lock "cinder-quobyte-c210208e-fced-42bc-ab86-5536febafd01" acquired by "delete_volume" :: waited 0.033s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:12:29 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6192b7b-83c4-4e32-9cf6-fe92229fb75f]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:12:29 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e893d88c-426a-4837-af15-46a1a62be810 tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c210208e-fced-42bc-ab86-5536febafd01 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:29 devstack sudo[105779]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:29 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-91f84c90-a851-4ce5-b438-99f536d5515e tempest-ProjectReaderTests-1676955223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0a41af51-fba4-4c09-a9d6-6afddd6691f8" returned: 0 in 0.494s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:29 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-91f84c90-a851-4ce5-b438-99f536d5515e tempest-ProjectReaderTests-1676955223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0a41af51-fba4-4c09-a9d6-6afddd6691f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0a41af51-fba4-4c09-a9d6-6afddd6691f8.dcd7c8dd-345f-437d-b901-fe595f860f9a 1G {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:30 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-ac18d70f-1cd5-401a-b076-77f96570112d tempest-ProjectReaderTests-34270978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:12:30 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-ac18d70f-1cd5-401a-b076-77f96570112d tempest-ProjectReaderTests-34270978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:12:30 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-ac18d70f-1cd5-401a-b076-77f96570112d tempest-ProjectReaderTests-34270978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:12:30 devstack sudo[105788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0a41af51-fba4-4c09-a9d6-6afddd6691f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0a41af51-fba4-4c09-a9d6-6afddd6691f8.dcd7c8dd-345f-437d-b901-fe595f860f9a 1G Sep 17 22:12:30 devstack sudo[105788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:30 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-ac18d70f-1cd5-401a-b076-77f96570112d tempest-ProjectReaderTests-34270978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:12:30 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-ac18d70f-1cd5-401a-b076-77f96570112d tempest-ProjectReaderTests-34270978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:12:30 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-ac18d70f-1cd5-401a-b076-77f96570112d tempest-ProjectReaderTests-34270978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:30 devstack sudo[105790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:12:30 devstack sudo[105790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:30 devstack sudo[105787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c210208e-fced-42bc-ab86-5536febafd01 Sep 17 22:12:30 devstack sudo[105787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:30 devstack sudo[105790]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:30 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-ac18d70f-1cd5-401a-b076-77f96570112d tempest-ProjectReaderTests-34270978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.381s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:30 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-ac18d70f-1cd5-401a-b076-77f96570112d tempest-ProjectReaderTests-34270978 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:12:30 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-ac18d70f-1cd5-401a-b076-77f96570112d tempest-ProjectReaderTests-34270978 None] Deleted volume successfully. Sep 17 22:12:30 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-ac18d70f-1cd5-401a-b076-77f96570112d tempest-ProjectReaderTests-34270978 None] Lock "cinder-30d4f5fd-9841-41bb-b4c1-3a1164867edd-delete_volume" released by "delete_volume" :: held 1.725s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:12:30 devstack sudo[105787]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:30 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e893d88c-426a-4837-af15-46a1a62be810 tempest-ProjectMemberTests-1966135882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c210208e-fced-42bc-ab86-5536febafd01" returned: 0 in 0.522s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:30 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e893d88c-426a-4837-af15-46a1a62be810 tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c210208e-fced-42bc-ab86-5536febafd01 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:30 devstack sudo[105803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c210208e-fced-42bc-ab86-5536febafd01 Sep 17 22:12:30 devstack sudo[105803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:30 devstack sudo[105788]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:30 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-91f84c90-a851-4ce5-b438-99f536d5515e tempest-ProjectReaderTests-1676955223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0a41af51-fba4-4c09-a9d6-6afddd6691f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0a41af51-fba4-4c09-a9d6-6afddd6691f8.dcd7c8dd-345f-437d-b901-fe595f860f9a 1G" returned: 0 in 0.537s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:30 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-91f84c90-a851-4ce5-b438-99f536d5515e tempest-ProjectReaderTests-1676955223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a41af51-fba4-4c09-a9d6-6afddd6691f8 -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0a41af51-fba4-4c09-a9d6-6afddd6691f8.dcd7c8dd-345f-437d-b901-fe595f860f9a {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:30 devstack sudo[105805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a41af51-fba4-4c09-a9d6-6afddd6691f8 -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0a41af51-fba4-4c09-a9d6-6afddd6691f8.dcd7c8dd-345f-437d-b901-fe595f860f9a Sep 17 22:12:30 devstack sudo[105805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:30 devstack sudo[105803]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:30 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e893d88c-426a-4837-af15-46a1a62be810 tempest-ProjectMemberTests-1966135882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-c210208e-fced-42bc-ab86-5536febafd01" returned: 0 in 0.289s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:30 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-e893d88c-426a-4837-af15-46a1a62be810 tempest-ProjectMemberTests-1966135882 None] Lock "cinder-quobyte-c210208e-fced-42bc-ab86-5536febafd01" released by "delete_volume" :: held 0.888s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:12:30 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-e893d88c-426a-4837-af15-46a1a62be810 tempest-ProjectMemberTests-1966135882 None] Created reservations ['a2f03757-0343-4b1c-a707-3f1cefc3595b', 'c5af9f48-9bd2-4e81-9113-46cff71fe5a1', '30b98692-2797-447b-bdb7-428d75429f4d', '335b0dd7-2a16-4869-809b-2fadbb18e51c'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:12:30 devstack sudo[105805]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:30 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-91f84c90-a851-4ce5-b438-99f536d5515e tempest-ProjectReaderTests-1676955223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a41af51-fba4-4c09-a9d6-6afddd6691f8 -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0a41af51-fba4-4c09-a9d6-6afddd6691f8.dcd7c8dd-345f-437d-b901-fe595f860f9a" returned: 0 in 0.354s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:30 devstack cinder-volume[85458]: WARNING cinder.volume.drivers.remotefs [None req-91f84c90-a851-4ce5-b438-99f536d5515e tempest-ProjectReaderTests-1676955223 None] /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0a41af51-fba4-4c09-a9d6-6afddd6691f8.dcd7c8dd-345f-437d-b901-fe595f860f9a is being set with open permissions: ugo+rw Sep 17 22:12:30 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-91f84c90-a851-4ce5-b438-99f536d5515e tempest-ProjectReaderTests-1676955223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0a41af51-fba4-4c09-a9d6-6afddd6691f8.dcd7c8dd-345f-437d-b901-fe595f860f9a {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:30 devstack sudo[105811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0a41af51-fba4-4c09-a9d6-6afddd6691f8.dcd7c8dd-345f-437d-b901-fe595f860f9a Sep 17 22:12:30 devstack sudo[105811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:30 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e893d88c-426a-4837-af15-46a1a62be810 tempest-ProjectMemberTests-1966135882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:12:30 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e893d88c-426a-4837-af15-46a1a62be810 tempest-ProjectMemberTests-1966135882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:12:30 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-e893d88c-426a-4837-af15-46a1a62be810 tempest-ProjectMemberTests-1966135882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:12:30 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-e893d88c-426a-4837-af15-46a1a62be810 tempest-ProjectMemberTests-1966135882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:12:30 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e893d88c-426a-4837-af15-46a1a62be810 tempest-ProjectMemberTests-1966135882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:12:30 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e893d88c-426a-4837-af15-46a1a62be810 tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:31 devstack sudo[105813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:12:31 devstack sudo[105813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:31 devstack sudo[105811]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:31 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-91f84c90-a851-4ce5-b438-99f536d5515e tempest-ProjectReaderTests-1676955223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0a41af51-fba4-4c09-a9d6-6afddd6691f8.dcd7c8dd-345f-437d-b901-fe595f860f9a" returned: 0 in 0.294s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:31 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-91f84c90-a851-4ce5-b438-99f536d5515e tempest-ProjectReaderTests-1676955223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0a41af51-fba4-4c09-a9d6-6afddd6691f8.info {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:31 devstack sudo[105816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0a41af51-fba4-4c09-a9d6-6afddd6691f8.info Sep 17 22:12:31 devstack sudo[105816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:31 devstack sudo[105813]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:31 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e893d88c-426a-4837-af15-46a1a62be810 tempest-ProjectMemberTests-1966135882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.299s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:31 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-e893d88c-426a-4837-af15-46a1a62be810 tempest-ProjectMemberTests-1966135882 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:12:31 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-e893d88c-426a-4837-af15-46a1a62be810 tempest-ProjectMemberTests-1966135882 None] Deleted volume successfully. Sep 17 22:12:31 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-e893d88c-426a-4837-af15-46a1a62be810 tempest-ProjectMemberTests-1966135882 None] Lock "cinder-c210208e-fced-42bc-ab86-5536febafd01-delete_volume" released by "delete_volume" :: held 1.528s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:12:31 devstack sudo[105816]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:31 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-91f84c90-a851-4ce5-b438-99f536d5515e tempest-ProjectReaderTests-1676955223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0a41af51-fba4-4c09-a9d6-6afddd6691f8.info" returned: 0 in 0.340s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:31 devstack cinder-volume[85458]: WARNING cinder.volume.drivers.remotefs [None req-91f84c90-a851-4ce5-b438-99f536d5515e tempest-ProjectReaderTests-1676955223 None] /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0a41af51-fba4-4c09-a9d6-6afddd6691f8.info is being set with open permissions: ugo+rw Sep 17 22:12:31 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-91f84c90-a851-4ce5-b438-99f536d5515e tempest-ProjectReaderTests-1676955223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0a41af51-fba4-4c09-a9d6-6afddd6691f8.info {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:31 devstack sudo[105826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0a41af51-fba4-4c09-a9d6-6afddd6691f8.info Sep 17 22:12:31 devstack sudo[105826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:31 devstack sudo[105826]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:31 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-91f84c90-a851-4ce5-b438-99f536d5515e tempest-ProjectReaderTests-1676955223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0a41af51-fba4-4c09-a9d6-6afddd6691f8.info" returned: 0 in 0.247s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:31 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-91f84c90-a851-4ce5-b438-99f536d5515e tempest-ProjectReaderTests-1676955223 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.418s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:12:31 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-91f84c90-a851-4ce5-b438-99f536d5515e tempest-ProjectReaderTests-1676955223 None] Create snapshot completed successfully Sep 17 22:12:32 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-81744932-1bea-417a-b51e-d2eb55cb0345 tempest-ProjectMemberTests-1966135882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 22:12:32 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-81744932-1bea-417a-b51e-d2eb55cb0345 tempest-ProjectMemberTests-1966135882 None] Flow 'volume_create_manager' (26be668c-7330-439a-bd13-3952ecaae296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:12:32 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-81744932-1bea-417a-b51e-d2eb55cb0345 tempest-ProjectMemberTests-1966135882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b144455-4487-4bcf-ac41-87fafa478bb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:12:32 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-81744932-1bea-417a-b51e-d2eb55cb0345 tempest-ProjectMemberTests-1966135882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b144455-4487-4bcf-ac41-87fafa478bb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:12:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-391103110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64f8ce4a-b2a7-4255-b491-a36fc6ff74c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f277f501a340474ca5d0daea12e88955',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:12:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:12:32Z,use_quota=True,user_id='e584775bfb3c440aa7aac369d15efa55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:12:32 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-81744932-1bea-417a-b51e-d2eb55cb0345 tempest-ProjectMemberTests-1966135882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (203c989c-08c4-47f2-9f1d-3ba7e5e05cdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:12:32 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-81744932-1bea-417a-b51e-d2eb55cb0345 tempest-ProjectMemberTests-1966135882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (203c989c-08c4-47f2-9f1d-3ba7e5e05cdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:12:32 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-81744932-1bea-417a-b51e-d2eb55cb0345 tempest-ProjectMemberTests-1966135882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a949e22f-2a1e-41ce-96b7-860e4ce9105f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:12:32 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-81744932-1bea-417a-b51e-d2eb55cb0345 tempest-ProjectMemberTests-1966135882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a949e22f-2a1e-41ce-96b7-860e4ce9105f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64f8ce4a-b2a7-4255-b491-a36fc6ff74c1', 'volume_name': 'volume-64f8ce4a-b2a7-4255-b491-a36fc6ff74c1', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:12:32 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-81744932-1bea-417a-b51e-d2eb55cb0345 tempest-ProjectMemberTests-1966135882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c30eec70-d152-4a01-8308-af2a468e69ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:12:32 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-81744932-1bea-417a-b51e-d2eb55cb0345 tempest-ProjectMemberTests-1966135882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c30eec70-d152-4a01-8308-af2a468e69ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:12:32 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-81744932-1bea-417a-b51e-d2eb55cb0345 tempest-ProjectMemberTests-1966135882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e0035eb-4af4-4d02-bb70-127cc74513ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:12:32 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-81744932-1bea-417a-b51e-d2eb55cb0345 tempest-ProjectMemberTests-1966135882 None] Volume 64f8ce4a-b2a7-4255-b491-a36fc6ff74c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64f8ce4a-b2a7-4255-b491-a36fc6ff74c1', 'volume_size': 1} Sep 17 22:12:32 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-81744932-1bea-417a-b51e-d2eb55cb0345 tempest-ProjectMemberTests-1966135882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:12:32 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-81744932-1bea-417a-b51e-d2eb55cb0345 tempest-ProjectMemberTests-1966135882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:12:32 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-81744932-1bea-417a-b51e-d2eb55cb0345 tempest-ProjectMemberTests-1966135882 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:12:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-391103110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64f8ce4a-b2a7-4255-b491-a36fc6ff74c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f277f501a340474ca5d0daea12e88955',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:12:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:12:32Z,use_quota=True,user_id='e584775bfb3c440aa7aac369d15efa55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 22:12:32 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-81744932-1bea-417a-b51e-d2eb55cb0345 tempest-ProjectMemberTests-1966135882 None] Creating volume 64f8ce4a-b2a7-4255-b491-a36fc6ff74c1 {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 22:12:32 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-81744932-1bea-417a-b51e-d2eb55cb0345 tempest-ProjectMemberTests-1966135882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:12:32 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-81744932-1bea-417a-b51e-d2eb55cb0345 tempest-ProjectMemberTests-1966135882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:12:32 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-81744932-1bea-417a-b51e-d2eb55cb0345 tempest-ProjectMemberTests-1966135882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:12:32 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-81744932-1bea-417a-b51e-d2eb55cb0345 tempest-ProjectMemberTests-1966135882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:12:32 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-81744932-1bea-417a-b51e-d2eb55cb0345 tempest-ProjectMemberTests-1966135882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:12:32 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-81744932-1bea-417a-b51e-d2eb55cb0345 tempest-ProjectMemberTests-1966135882 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 22:12:32 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-81744932-1bea-417a-b51e-d2eb55cb0345 tempest-ProjectMemberTests-1966135882 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 22:12:32 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-81744932-1bea-417a-b51e-d2eb55cb0345 tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-64f8ce4a-b2a7-4255-b491-a36fc6ff74c1 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:32 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-88e04407-3bfa-4b96-bb3a-ed87bf076e14 tempest-ProjectReaderTests-1676955223 None] Acquiring lock "cinder-dcd7c8dd-345f-437d-b901-fe595f860f9a-delete_snapshot" by "delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:12:32 devstack sudo[105829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-64f8ce4a-b2a7-4255-b491-a36fc6ff74c1 1073741824 Sep 17 22:12:32 devstack sudo[105829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:32 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-88e04407-3bfa-4b96-bb3a-ed87bf076e14 tempest-ProjectReaderTests-1676955223 None] Lock "cinder-dcd7c8dd-345f-437d-b901-fe595f860f9a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:12:32 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-88e04407-3bfa-4b96-bb3a-ed87bf076e14 tempest-ProjectReaderTests-1676955223 None] Acquiring lock "cinder-quobyte-0a41af51-fba4-4c09-a9d6-6afddd6691f8" by "delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:12:32 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-88e04407-3bfa-4b96-bb3a-ed87bf076e14 tempest-ProjectReaderTests-1676955223 None] Lock "cinder-quobyte-0a41af51-fba4-4c09-a9d6-6afddd6691f8" acquired by "delete_snapshot" :: waited 0.019s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:12:32 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-88e04407-3bfa-4b96-bb3a-ed87bf076e14 tempest-ProjectReaderTests-1676955223 None] Acquiring lock "cinder-quobyte-dcd7c8dd-345f-437d-b901-fe595f860f9a" by "_delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:12:32 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-88e04407-3bfa-4b96-bb3a-ed87bf076e14 tempest-ProjectReaderTests-1676955223 None] Lock "cinder-quobyte-dcd7c8dd-345f-437d-b901-fe595f860f9a" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:12:32 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-88e04407-3bfa-4b96-bb3a-ed87bf076e14 tempest-ProjectReaderTests-1676955223 None] Deleting offline snapshot dcd7c8dd-345f-437d-b901-fe595f860f9a of volume 0a41af51-fba4-4c09-a9d6-6afddd6691f8 {{(pid=85458) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 22:12:32 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-88e04407-3bfa-4b96-bb3a-ed87bf076e14 tempest-ProjectReaderTests-1676955223 None] snapshot_file for this snap is: volume-0a41af51-fba4-4c09-a9d6-6afddd6691f8.dcd7c8dd-345f-437d-b901-fe595f860f9a {{(pid=85458) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 22:12:32 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[dab3d4e7-d7f6-4912-8904-9d9c8afdf50c]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:12:32 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-88e04407-3bfa-4b96-bb3a-ed87bf076e14 tempest-ProjectReaderTests-1676955223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0a41af51-fba4-4c09-a9d6-6afddd6691f8.dcd7c8dd-345f-437d-b901-fe595f860f9a {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:32 devstack sudo[105831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0a41af51-fba4-4c09-a9d6-6afddd6691f8.dcd7c8dd-345f-437d-b901-fe595f860f9a Sep 17 22:12:32 devstack sudo[105831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:33 devstack sudo[105829]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:33 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-81744932-1bea-417a-b51e-d2eb55cb0345 tempest-ProjectMemberTests-1966135882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-64f8ce4a-b2a7-4255-b491-a36fc6ff74c1 1073741824" returned: 0 in 0.437s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:33 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-81744932-1bea-417a-b51e-d2eb55cb0345 tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-64f8ce4a-b2a7-4255-b491-a36fc6ff74c1 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:33 devstack sudo[105831]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:33 devstack sudo[105839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-64f8ce4a-b2a7-4255-b491-a36fc6ff74c1 Sep 17 22:12:33 devstack sudo[105839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:33 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-88e04407-3bfa-4b96-bb3a-ed87bf076e14 tempest-ProjectReaderTests-1676955223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0a41af51-fba4-4c09-a9d6-6afddd6691f8.dcd7c8dd-345f-437d-b901-fe595f860f9a" returned: 0 in 0.384s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:33 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-88e04407-3bfa-4b96-bb3a-ed87bf076e14 tempest-ProjectReaderTests-1676955223 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a41af51-fba4-4c09-a9d6-6afddd6691f8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85458) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 22:12:33 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fba4100-6271-4cba-a827-b7298c805bc3]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:12:33 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-88e04407-3bfa-4b96-bb3a-ed87bf076e14 tempest-ProjectReaderTests-1676955223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0a41af51-fba4-4c09-a9d6-6afddd6691f8 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:33 devstack sudo[105841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0a41af51-fba4-4c09-a9d6-6afddd6691f8 Sep 17 22:12:33 devstack sudo[105841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:33 devstack sudo[105839]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:33 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-81744932-1bea-417a-b51e-d2eb55cb0345 tempest-ProjectMemberTests-1966135882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-64f8ce4a-b2a7-4255-b491-a36fc6ff74c1" returned: 0 in 0.254s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:33 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-81744932-1bea-417a-b51e-d2eb55cb0345 tempest-ProjectMemberTests-1966135882 None] <== create_volume: return (739ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 22:12:33 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-81744932-1bea-417a-b51e-d2eb55cb0345 tempest-ProjectMemberTests-1966135882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.742s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:12:33 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-81744932-1bea-417a-b51e-d2eb55cb0345 tempest-ProjectMemberTests-1966135882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e0035eb-4af4-4d02-bb70-127cc74513ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64f8ce4a-b2a7-4255-b491-a36fc6ff74c1', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:12:33 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-81744932-1bea-417a-b51e-d2eb55cb0345 tempest-ProjectMemberTests-1966135882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27ad088c-2142-464c-9515-c9a7ed31d360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:12:33 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-81744932-1bea-417a-b51e-d2eb55cb0345 tempest-ProjectMemberTests-1966135882 None] Volume volume-64f8ce4a-b2a7-4255-b491-a36fc6ff74c1 (64f8ce4a-b2a7-4255-b491-a36fc6ff74c1): created successfully Sep 17 22:12:33 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-81744932-1bea-417a-b51e-d2eb55cb0345 tempest-ProjectMemberTests-1966135882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27ad088c-2142-464c-9515-c9a7ed31d360) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:12:33 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-81744932-1bea-417a-b51e-d2eb55cb0345 tempest-ProjectMemberTests-1966135882 None] Flow 'volume_create_manager' (26be668c-7330-439a-bd13-3952ecaae296) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:12:33 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-81744932-1bea-417a-b51e-d2eb55cb0345 tempest-ProjectMemberTests-1966135882 None] Created volume successfully. Sep 17 22:12:33 devstack sudo[105841]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:33 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-88e04407-3bfa-4b96-bb3a-ed87bf076e14 tempest-ProjectReaderTests-1676955223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0a41af51-fba4-4c09-a9d6-6afddd6691f8" returned: 0 in 0.381s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:33 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-88e04407-3bfa-4b96-bb3a-ed87bf076e14 tempest-ProjectReaderTests-1676955223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0a41af51-fba4-4c09-a9d6-6afddd6691f8.dcd7c8dd-345f-437d-b901-fe595f860f9a {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:33 devstack sudo[105847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0a41af51-fba4-4c09-a9d6-6afddd6691f8.dcd7c8dd-345f-437d-b901-fe595f860f9a Sep 17 22:12:33 devstack sudo[105847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:33 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-94cfa2e5-8a76-4d6d-aac7-bef60b3ae83b tempest-ProjectMemberTests-1966135882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:12:33 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-94cfa2e5-8a76-4d6d-aac7-bef60b3ae83b tempest-ProjectMemberTests-1966135882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:12:33 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-94cfa2e5-8a76-4d6d-aac7-bef60b3ae83b tempest-ProjectMemberTests-1966135882 None] Creating offline snapshot c28fcf32-b058-443a-9b4a-811b032fd17c of volume 64f8ce4a-b2a7-4255-b491-a36fc6ff74c1 {{(pid=85458) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 22:12:33 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3472e56-c5bb-4dcd-a4a2-398ac5ea4540]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:12:33 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-94cfa2e5-8a76-4d6d-aac7-bef60b3ae83b tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-64f8ce4a-b2a7-4255-b491-a36fc6ff74c1 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:33 devstack sudo[105849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-64f8ce4a-b2a7-4255-b491-a36fc6ff74c1 Sep 17 22:12:33 devstack sudo[105849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:33 devstack sudo[105847]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:33 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-88e04407-3bfa-4b96-bb3a-ed87bf076e14 tempest-ProjectReaderTests-1676955223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0a41af51-fba4-4c09-a9d6-6afddd6691f8.dcd7c8dd-345f-437d-b901-fe595f860f9a" returned: 0 in 0.352s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:33 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-88e04407-3bfa-4b96-bb3a-ed87bf076e14 tempest-ProjectReaderTests-1676955223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0a41af51-fba4-4c09-a9d6-6afddd6691f8.dcd7c8dd-345f-437d-b901-fe595f860f9a {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:33 devstack sudo[105854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0a41af51-fba4-4c09-a9d6-6afddd6691f8.dcd7c8dd-345f-437d-b901-fe595f860f9a Sep 17 22:12:33 devstack sudo[105854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:34 devstack sudo[105849]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:34 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-94cfa2e5-8a76-4d6d-aac7-bef60b3ae83b tempest-ProjectMemberTests-1966135882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-64f8ce4a-b2a7-4255-b491-a36fc6ff74c1" returned: 0 in 0.378s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:34 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-94cfa2e5-8a76-4d6d-aac7-bef60b3ae83b tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-64f8ce4a-b2a7-4255-b491-a36fc6ff74c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-64f8ce4a-b2a7-4255-b491-a36fc6ff74c1.c28fcf32-b058-443a-9b4a-811b032fd17c 1G {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:34 devstack sudo[105859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-64f8ce4a-b2a7-4255-b491-a36fc6ff74c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-64f8ce4a-b2a7-4255-b491-a36fc6ff74c1.c28fcf32-b058-443a-9b4a-811b032fd17c 1G Sep 17 22:12:34 devstack sudo[105859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:34 devstack sudo[105854]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:34 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-88e04407-3bfa-4b96-bb3a-ed87bf076e14 tempest-ProjectReaderTests-1676955223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0a41af51-fba4-4c09-a9d6-6afddd6691f8.dcd7c8dd-345f-437d-b901-fe595f860f9a" returned: 0 in 0.257s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:34 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-88e04407-3bfa-4b96-bb3a-ed87bf076e14 tempest-ProjectReaderTests-1676955223 None] Lock "cinder-quobyte-dcd7c8dd-345f-437d-b901-fe595f860f9a" released by "_delete_snapshot" :: held 1.495s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:12:34 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-88e04407-3bfa-4b96-bb3a-ed87bf076e14 tempest-ProjectReaderTests-1676955223 None] Lock "cinder-quobyte-0a41af51-fba4-4c09-a9d6-6afddd6691f8" released by "delete_snapshot" :: held 1.518s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:12:34 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-88e04407-3bfa-4b96-bb3a-ed87bf076e14 tempest-ProjectReaderTests-1676955223 None] Created reservations ['cc86364a-d397-4dc4-911a-a591dd89af7a', '581945a4-e3aa-4e1a-957f-0120b63f3f02', '480c7c33-f345-48f7-aec1-cee34f21b425', 'c937ff2d-c338-4079-8d19-22cbf0ce6f51'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:12:34 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-88e04407-3bfa-4b96-bb3a-ed87bf076e14 tempest-ProjectReaderTests-1676955223 None] Delete snapshot completed successfully. Sep 17 22:12:34 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-88e04407-3bfa-4b96-bb3a-ed87bf076e14 tempest-ProjectReaderTests-1676955223 None] Lock "cinder-dcd7c8dd-345f-437d-b901-fe595f860f9a-delete_snapshot" released by "delete_snapshot" :: held 1.722s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:12:34 devstack sudo[105859]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:34 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-94cfa2e5-8a76-4d6d-aac7-bef60b3ae83b tempest-ProjectMemberTests-1966135882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-64f8ce4a-b2a7-4255-b491-a36fc6ff74c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-64f8ce4a-b2a7-4255-b491-a36fc6ff74c1.c28fcf32-b058-443a-9b4a-811b032fd17c 1G" returned: 0 in 0.405s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:34 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-94cfa2e5-8a76-4d6d-aac7-bef60b3ae83b tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64f8ce4a-b2a7-4255-b491-a36fc6ff74c1 -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-64f8ce4a-b2a7-4255-b491-a36fc6ff74c1.c28fcf32-b058-443a-9b4a-811b032fd17c {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:34 devstack sudo[105865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64f8ce4a-b2a7-4255-b491-a36fc6ff74c1 -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-64f8ce4a-b2a7-4255-b491-a36fc6ff74c1.c28fcf32-b058-443a-9b4a-811b032fd17c Sep 17 22:12:34 devstack sudo[105865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:34 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-c8274257-36dc-454e-baab-f35e5bfd68d4 tempest-ProjectReaderTests-1676955223 None] Acquiring lock "cinder-0a41af51-fba4-4c09-a9d6-6afddd6691f8-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:12:34 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-c8274257-36dc-454e-baab-f35e5bfd68d4 tempest-ProjectReaderTests-1676955223 None] Lock "cinder-0a41af51-fba4-4c09-a9d6-6afddd6691f8-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:12:34 devstack sudo[105865]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:34 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-94cfa2e5-8a76-4d6d-aac7-bef60b3ae83b tempest-ProjectMemberTests-1966135882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64f8ce4a-b2a7-4255-b491-a36fc6ff74c1 -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-64f8ce4a-b2a7-4255-b491-a36fc6ff74c1.c28fcf32-b058-443a-9b4a-811b032fd17c" returned: 0 in 0.317s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:34 devstack cinder-volume[85458]: WARNING cinder.volume.drivers.remotefs [None req-94cfa2e5-8a76-4d6d-aac7-bef60b3ae83b tempest-ProjectMemberTests-1966135882 None] /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-64f8ce4a-b2a7-4255-b491-a36fc6ff74c1.c28fcf32-b058-443a-9b4a-811b032fd17c is being set with open permissions: ugo+rw Sep 17 22:12:34 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-94cfa2e5-8a76-4d6d-aac7-bef60b3ae83b tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-64f8ce4a-b2a7-4255-b491-a36fc6ff74c1.c28fcf32-b058-443a-9b4a-811b032fd17c {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:34 devstack sudo[105870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-64f8ce4a-b2a7-4255-b491-a36fc6ff74c1.c28fcf32-b058-443a-9b4a-811b032fd17c Sep 17 22:12:34 devstack sudo[105870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:34 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-c8274257-36dc-454e-baab-f35e5bfd68d4 tempest-ProjectReaderTests-1676955223 None] Acquiring lock "cinder-quobyte-0a41af51-fba4-4c09-a9d6-6afddd6691f8" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:12:34 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-c8274257-36dc-454e-baab-f35e5bfd68d4 tempest-ProjectReaderTests-1676955223 None] Lock "cinder-quobyte-0a41af51-fba4-4c09-a9d6-6afddd6691f8" acquired by "delete_volume" :: waited 0.014s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:12:34 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7f0066d-5f92-45d5-b2a0-e767124c99fb]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:12:34 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-c8274257-36dc-454e-baab-f35e5bfd68d4 tempest-ProjectReaderTests-1676955223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0a41af51-fba4-4c09-a9d6-6afddd6691f8 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:35 devstack sudo[105872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0a41af51-fba4-4c09-a9d6-6afddd6691f8 Sep 17 22:12:35 devstack sudo[105872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:35 devstack sudo[105870]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:35 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-94cfa2e5-8a76-4d6d-aac7-bef60b3ae83b tempest-ProjectMemberTests-1966135882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-64f8ce4a-b2a7-4255-b491-a36fc6ff74c1.c28fcf32-b058-443a-9b4a-811b032fd17c" returned: 0 in 0.254s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:35 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-94cfa2e5-8a76-4d6d-aac7-bef60b3ae83b tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-64f8ce4a-b2a7-4255-b491-a36fc6ff74c1.info {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:35 devstack sudo[105875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-64f8ce4a-b2a7-4255-b491-a36fc6ff74c1.info Sep 17 22:12:35 devstack sudo[105875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:35 devstack sudo[105872]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:35 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-c8274257-36dc-454e-baab-f35e5bfd68d4 tempest-ProjectReaderTests-1676955223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0a41af51-fba4-4c09-a9d6-6afddd6691f8" returned: 0 in 0.369s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:35 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-c8274257-36dc-454e-baab-f35e5bfd68d4 tempest-ProjectReaderTests-1676955223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0a41af51-fba4-4c09-a9d6-6afddd6691f8 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:35 devstack sudo[105880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0a41af51-fba4-4c09-a9d6-6afddd6691f8 Sep 17 22:12:35 devstack sudo[105880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:35 devstack sudo[105875]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:35 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-94cfa2e5-8a76-4d6d-aac7-bef60b3ae83b tempest-ProjectMemberTests-1966135882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-64f8ce4a-b2a7-4255-b491-a36fc6ff74c1.info" returned: 0 in 0.269s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:35 devstack cinder-volume[85458]: WARNING cinder.volume.drivers.remotefs [None req-94cfa2e5-8a76-4d6d-aac7-bef60b3ae83b tempest-ProjectMemberTests-1966135882 None] /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-64f8ce4a-b2a7-4255-b491-a36fc6ff74c1.info is being set with open permissions: ugo+rw Sep 17 22:12:35 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-94cfa2e5-8a76-4d6d-aac7-bef60b3ae83b tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-64f8ce4a-b2a7-4255-b491-a36fc6ff74c1.info {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:35 devstack sudo[105883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-64f8ce4a-b2a7-4255-b491-a36fc6ff74c1.info Sep 17 22:12:35 devstack sudo[105883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:35 devstack sudo[105880]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:35 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-c8274257-36dc-454e-baab-f35e5bfd68d4 tempest-ProjectReaderTests-1676955223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0a41af51-fba4-4c09-a9d6-6afddd6691f8" returned: 0 in 0.255s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:35 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-c8274257-36dc-454e-baab-f35e5bfd68d4 tempest-ProjectReaderTests-1676955223 None] Lock "cinder-quobyte-0a41af51-fba4-4c09-a9d6-6afddd6691f8" released by "delete_volume" :: held 0.690s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:12:35 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-c8274257-36dc-454e-baab-f35e5bfd68d4 tempest-ProjectReaderTests-1676955223 None] Created reservations ['be3d4dd6-1f78-49ed-a09d-5af0fda5d545', '3c2d83ff-3d59-40f6-9421-cb344a14aa2d', 'efb32ee1-d81c-4c57-baf5-f208c264a948', '3ae77c81-575c-4106-b461-a34ecf61f9a2'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:12:35 devstack sudo[105883]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:35 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-94cfa2e5-8a76-4d6d-aac7-bef60b3ae83b tempest-ProjectMemberTests-1966135882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-64f8ce4a-b2a7-4255-b491-a36fc6ff74c1.info" returned: 0 in 0.258s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:35 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-94cfa2e5-8a76-4d6d-aac7-bef60b3ae83b tempest-ProjectMemberTests-1966135882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.963s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:12:35 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-94cfa2e5-8a76-4d6d-aac7-bef60b3ae83b tempest-ProjectMemberTests-1966135882 None] Create snapshot completed successfully Sep 17 22:12:35 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-c8274257-36dc-454e-baab-f35e5bfd68d4 tempest-ProjectReaderTests-1676955223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:12:35 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-c8274257-36dc-454e-baab-f35e5bfd68d4 tempest-ProjectReaderTests-1676955223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:12:35 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-c8274257-36dc-454e-baab-f35e5bfd68d4 tempest-ProjectReaderTests-1676955223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:12:35 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-c8274257-36dc-454e-baab-f35e5bfd68d4 tempest-ProjectReaderTests-1676955223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:12:35 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-c8274257-36dc-454e-baab-f35e5bfd68d4 tempest-ProjectReaderTests-1676955223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:12:35 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-c8274257-36dc-454e-baab-f35e5bfd68d4 tempest-ProjectReaderTests-1676955223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:35 devstack sudo[105887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:12:35 devstack sudo[105887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:35 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-b0a64154-7dc0-4e5a-8d43-190fe351a729 tempest-ProjectMemberTests-1966135882 None] Acquiring lock "cinder-c28fcf32-b058-443a-9b4a-811b032fd17c-delete_snapshot" by "delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:12:35 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-b0a64154-7dc0-4e5a-8d43-190fe351a729 tempest-ProjectMemberTests-1966135882 None] Lock "cinder-c28fcf32-b058-443a-9b4a-811b032fd17c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:12:35 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-b0a64154-7dc0-4e5a-8d43-190fe351a729 tempest-ProjectMemberTests-1966135882 None] Acquiring lock "cinder-quobyte-64f8ce4a-b2a7-4255-b491-a36fc6ff74c1" by "delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:12:35 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-b0a64154-7dc0-4e5a-8d43-190fe351a729 tempest-ProjectMemberTests-1966135882 None] Lock "cinder-quobyte-64f8ce4a-b2a7-4255-b491-a36fc6ff74c1" acquired by "delete_snapshot" :: waited 0.024s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:12:35 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-b0a64154-7dc0-4e5a-8d43-190fe351a729 tempest-ProjectMemberTests-1966135882 None] Acquiring lock "cinder-quobyte-c28fcf32-b058-443a-9b4a-811b032fd17c" by "_delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:12:35 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-b0a64154-7dc0-4e5a-8d43-190fe351a729 tempest-ProjectMemberTests-1966135882 None] Lock "cinder-quobyte-c28fcf32-b058-443a-9b4a-811b032fd17c" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:12:35 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-b0a64154-7dc0-4e5a-8d43-190fe351a729 tempest-ProjectMemberTests-1966135882 None] Deleting offline snapshot c28fcf32-b058-443a-9b4a-811b032fd17c of volume 64f8ce4a-b2a7-4255-b491-a36fc6ff74c1 {{(pid=85458) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 22:12:35 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-b0a64154-7dc0-4e5a-8d43-190fe351a729 tempest-ProjectMemberTests-1966135882 None] snapshot_file for this snap is: volume-64f8ce4a-b2a7-4255-b491-a36fc6ff74c1.c28fcf32-b058-443a-9b4a-811b032fd17c {{(pid=85458) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 22:12:35 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a3d0dff-980f-4dc9-bdf7-c3bedb33bae3]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:12:35 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-b0a64154-7dc0-4e5a-8d43-190fe351a729 tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-64f8ce4a-b2a7-4255-b491-a36fc6ff74c1.c28fcf32-b058-443a-9b4a-811b032fd17c {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:35 devstack sudo[105887]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:35 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-c8274257-36dc-454e-baab-f35e5bfd68d4 tempest-ProjectReaderTests-1676955223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.280s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:35 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-c8274257-36dc-454e-baab-f35e5bfd68d4 tempest-ProjectReaderTests-1676955223 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:12:35 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-c8274257-36dc-454e-baab-f35e5bfd68d4 tempest-ProjectReaderTests-1676955223 None] Deleted volume successfully. Sep 17 22:12:36 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-c8274257-36dc-454e-baab-f35e5bfd68d4 tempest-ProjectReaderTests-1676955223 None] Lock "cinder-0a41af51-fba4-4c09-a9d6-6afddd6691f8-delete_volume" released by "delete_volume" :: held 1.222s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:12:36 devstack sudo[105889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-64f8ce4a-b2a7-4255-b491-a36fc6ff74c1.c28fcf32-b058-443a-9b4a-811b032fd17c Sep 17 22:12:36 devstack sudo[105889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:36 devstack sudo[105889]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:36 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-b0a64154-7dc0-4e5a-8d43-190fe351a729 tempest-ProjectMemberTests-1966135882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-64f8ce4a-b2a7-4255-b491-a36fc6ff74c1.c28fcf32-b058-443a-9b4a-811b032fd17c" returned: 0 in 0.407s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:36 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-b0a64154-7dc0-4e5a-8d43-190fe351a729 tempest-ProjectMemberTests-1966135882 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-64f8ce4a-b2a7-4255-b491-a36fc6ff74c1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85458) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 22:12:36 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[2167c738-51d5-4f0e-b588-cd511e18dab2]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:12:36 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-b0a64154-7dc0-4e5a-8d43-190fe351a729 tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-64f8ce4a-b2a7-4255-b491-a36fc6ff74c1 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:36 devstack sudo[105895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-64f8ce4a-b2a7-4255-b491-a36fc6ff74c1 Sep 17 22:12:36 devstack sudo[105895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:36 devstack sudo[105895]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:36 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-b0a64154-7dc0-4e5a-8d43-190fe351a729 tempest-ProjectMemberTests-1966135882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-64f8ce4a-b2a7-4255-b491-a36fc6ff74c1" returned: 0 in 0.366s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:36 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-b0a64154-7dc0-4e5a-8d43-190fe351a729 tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-64f8ce4a-b2a7-4255-b491-a36fc6ff74c1.c28fcf32-b058-443a-9b4a-811b032fd17c {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:36 devstack sudo[105900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-64f8ce4a-b2a7-4255-b491-a36fc6ff74c1.c28fcf32-b058-443a-9b4a-811b032fd17c Sep 17 22:12:36 devstack sudo[105900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:37 devstack sudo[105900]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:37 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-b0a64154-7dc0-4e5a-8d43-190fe351a729 tempest-ProjectMemberTests-1966135882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-64f8ce4a-b2a7-4255-b491-a36fc6ff74c1.c28fcf32-b058-443a-9b4a-811b032fd17c" returned: 0 in 0.380s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:37 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-b0a64154-7dc0-4e5a-8d43-190fe351a729 tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-64f8ce4a-b2a7-4255-b491-a36fc6ff74c1.c28fcf32-b058-443a-9b4a-811b032fd17c {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:37 devstack sudo[105906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-64f8ce4a-b2a7-4255-b491-a36fc6ff74c1.c28fcf32-b058-443a-9b4a-811b032fd17c Sep 17 22:12:37 devstack sudo[105906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:37 devstack sudo[105906]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:37 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-b0a64154-7dc0-4e5a-8d43-190fe351a729 tempest-ProjectMemberTests-1966135882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-64f8ce4a-b2a7-4255-b491-a36fc6ff74c1.c28fcf32-b058-443a-9b4a-811b032fd17c" returned: 0 in 0.271s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:37 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-b0a64154-7dc0-4e5a-8d43-190fe351a729 tempest-ProjectMemberTests-1966135882 None] Lock "cinder-quobyte-c28fcf32-b058-443a-9b4a-811b032fd17c" released by "_delete_snapshot" :: held 1.542s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:12:37 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-b0a64154-7dc0-4e5a-8d43-190fe351a729 tempest-ProjectMemberTests-1966135882 None] Lock "cinder-quobyte-64f8ce4a-b2a7-4255-b491-a36fc6ff74c1" released by "delete_snapshot" :: held 1.573s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:12:37 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-b0a64154-7dc0-4e5a-8d43-190fe351a729 tempest-ProjectMemberTests-1966135882 None] Created reservations ['53533b29-36f9-4676-829c-371ad5cd8d0a', '4b00b98c-8778-4656-b588-4cd91718996c', '9a246e07-f2cd-4c4a-b37b-34a0e4f74aef', '8daa8250-1655-40d6-a967-8199b692234f'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:12:37 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-b0a64154-7dc0-4e5a-8d43-190fe351a729 tempest-ProjectMemberTests-1966135882 None] Delete snapshot completed successfully. Sep 17 22:12:37 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-b0a64154-7dc0-4e5a-8d43-190fe351a729 tempest-ProjectMemberTests-1966135882 None] Lock "cinder-c28fcf32-b058-443a-9b4a-811b032fd17c-delete_snapshot" released by "delete_snapshot" :: held 1.723s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:12:37 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-aee627b3-2cf6-4643-baa6-0b55db51c041 tempest-ProjectMemberTests-1966135882 None] Acquiring lock "cinder-64f8ce4a-b2a7-4255-b491-a36fc6ff74c1-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:12:38 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-aee627b3-2cf6-4643-baa6-0b55db51c041 tempest-ProjectMemberTests-1966135882 None] Lock "cinder-64f8ce4a-b2a7-4255-b491-a36fc6ff74c1-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:12:38 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-aee627b3-2cf6-4643-baa6-0b55db51c041 tempest-ProjectMemberTests-1966135882 None] Acquiring lock "cinder-quobyte-64f8ce4a-b2a7-4255-b491-a36fc6ff74c1" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:12:38 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-aee627b3-2cf6-4643-baa6-0b55db51c041 tempest-ProjectMemberTests-1966135882 None] Lock "cinder-quobyte-64f8ce4a-b2a7-4255-b491-a36fc6ff74c1" acquired by "delete_volume" :: waited 0.016s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:12:38 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8f413aa-2843-4f43-89ed-d59e21e990e8]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:12:38 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-aee627b3-2cf6-4643-baa6-0b55db51c041 tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-64f8ce4a-b2a7-4255-b491-a36fc6ff74c1 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:38 devstack sudo[105909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-64f8ce4a-b2a7-4255-b491-a36fc6ff74c1 Sep 17 22:12:38 devstack sudo[105909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:38 devstack sudo[105909]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:38 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-aee627b3-2cf6-4643-baa6-0b55db51c041 tempest-ProjectMemberTests-1966135882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-64f8ce4a-b2a7-4255-b491-a36fc6ff74c1" returned: 0 in 0.372s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:38 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-aee627b3-2cf6-4643-baa6-0b55db51c041 tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-64f8ce4a-b2a7-4255-b491-a36fc6ff74c1 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:38 devstack sudo[105914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-64f8ce4a-b2a7-4255-b491-a36fc6ff74c1 Sep 17 22:12:38 devstack sudo[105914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:38 devstack sudo[105914]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:38 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-aee627b3-2cf6-4643-baa6-0b55db51c041 tempest-ProjectMemberTests-1966135882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-64f8ce4a-b2a7-4255-b491-a36fc6ff74c1" returned: 0 in 0.251s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:38 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-aee627b3-2cf6-4643-baa6-0b55db51c041 tempest-ProjectMemberTests-1966135882 None] Lock "cinder-quobyte-64f8ce4a-b2a7-4255-b491-a36fc6ff74c1" released by "delete_volume" :: held 0.695s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:12:38 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-aee627b3-2cf6-4643-baa6-0b55db51c041 tempest-ProjectMemberTests-1966135882 None] Created reservations ['94c9407d-afcc-473e-bfa9-133da3013165', '412a2a7b-08fb-4ff1-9be5-63e505b0bfd8', '487946af-5085-47d5-a173-ee7c9e98934b', '48f394d4-07fd-4139-9337-e3aff46111a1'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:12:38 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-aee627b3-2cf6-4643-baa6-0b55db51c041 tempest-ProjectMemberTests-1966135882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:12:38 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-aee627b3-2cf6-4643-baa6-0b55db51c041 tempest-ProjectMemberTests-1966135882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:12:38 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-aee627b3-2cf6-4643-baa6-0b55db51c041 tempest-ProjectMemberTests-1966135882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:12:38 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-aee627b3-2cf6-4643-baa6-0b55db51c041 tempest-ProjectMemberTests-1966135882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:12:38 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-aee627b3-2cf6-4643-baa6-0b55db51c041 tempest-ProjectMemberTests-1966135882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:12:38 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-aee627b3-2cf6-4643-baa6-0b55db51c041 tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:38 devstack sudo[105917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:12:38 devstack sudo[105917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:39 devstack sudo[105917]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:39 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-aee627b3-2cf6-4643-baa6-0b55db51c041 tempest-ProjectMemberTests-1966135882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.257s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:39 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-aee627b3-2cf6-4643-baa6-0b55db51c041 tempest-ProjectMemberTests-1966135882 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:12:39 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-aee627b3-2cf6-4643-baa6-0b55db51c041 tempest-ProjectMemberTests-1966135882 None] Deleted volume successfully. Sep 17 22:12:39 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-aee627b3-2cf6-4643-baa6-0b55db51c041 tempest-ProjectMemberTests-1966135882 None] Lock "cinder-64f8ce4a-b2a7-4255-b491-a36fc6ff74c1-delete_volume" released by "delete_volume" :: held 1.161s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:12:39 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-38476eae-c153-4054-8a64-e941f97f5690 tempest-ProjectMemberTests-1966135882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 22:12:39 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-38476eae-c153-4054-8a64-e941f97f5690 tempest-ProjectMemberTests-1966135882 None] Flow 'volume_create_manager' (56e4bccb-8e48-4297-9049-0b6c398097a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:12:39 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-38476eae-c153-4054-8a64-e941f97f5690 tempest-ProjectMemberTests-1966135882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00b3e2c6-96a5-45d8-9102-bdfaa5bddd7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:12:39 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-38476eae-c153-4054-8a64-e941f97f5690 tempest-ProjectMemberTests-1966135882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00b3e2c6-96a5-45d8-9102-bdfaa5bddd7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:12:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-136228814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cecc943-6f77-4a9c-a8be-835d96dc5353,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f277f501a340474ca5d0daea12e88955',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:12:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:12:40Z,use_quota=True,user_id='e584775bfb3c440aa7aac369d15efa55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:12:39 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-38476eae-c153-4054-8a64-e941f97f5690 tempest-ProjectMemberTests-1966135882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c945585-8347-4d7c-9104-a42d1ca3b020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:12:39 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-38476eae-c153-4054-8a64-e941f97f5690 tempest-ProjectMemberTests-1966135882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c945585-8347-4d7c-9104-a42d1ca3b020) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:12:39 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-38476eae-c153-4054-8a64-e941f97f5690 tempest-ProjectMemberTests-1966135882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aced8c3b-03ed-400e-8232-1adf1304714d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:12:39 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-38476eae-c153-4054-8a64-e941f97f5690 tempest-ProjectMemberTests-1966135882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aced8c3b-03ed-400e-8232-1adf1304714d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0cecc943-6f77-4a9c-a8be-835d96dc5353', 'volume_name': 'volume-0cecc943-6f77-4a9c-a8be-835d96dc5353', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:12:39 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-38476eae-c153-4054-8a64-e941f97f5690 tempest-ProjectMemberTests-1966135882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ece0806-467b-4427-b539-c06f6c8e90c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:12:39 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-38476eae-c153-4054-8a64-e941f97f5690 tempest-ProjectMemberTests-1966135882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ece0806-467b-4427-b539-c06f6c8e90c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:12:39 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-38476eae-c153-4054-8a64-e941f97f5690 tempest-ProjectMemberTests-1966135882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7f3c5f4-8249-4844-a729-23c0edc07b6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:12:39 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-38476eae-c153-4054-8a64-e941f97f5690 tempest-ProjectMemberTests-1966135882 None] Volume 0cecc943-6f77-4a9c-a8be-835d96dc5353: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0cecc943-6f77-4a9c-a8be-835d96dc5353', 'volume_size': 1} Sep 17 22:12:39 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-38476eae-c153-4054-8a64-e941f97f5690 tempest-ProjectMemberTests-1966135882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:12:39 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-38476eae-c153-4054-8a64-e941f97f5690 tempest-ProjectMemberTests-1966135882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:12:39 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-38476eae-c153-4054-8a64-e941f97f5690 tempest-ProjectMemberTests-1966135882 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:12:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-136228814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cecc943-6f77-4a9c-a8be-835d96dc5353,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f277f501a340474ca5d0daea12e88955',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:12:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:12:40Z,use_quota=True,user_id='e584775bfb3c440aa7aac369d15efa55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 22:12:39 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-38476eae-c153-4054-8a64-e941f97f5690 tempest-ProjectMemberTests-1966135882 None] Creating volume 0cecc943-6f77-4a9c-a8be-835d96dc5353 {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 22:12:39 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-38476eae-c153-4054-8a64-e941f97f5690 tempest-ProjectMemberTests-1966135882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:12:39 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-38476eae-c153-4054-8a64-e941f97f5690 tempest-ProjectMemberTests-1966135882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:12:39 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-38476eae-c153-4054-8a64-e941f97f5690 tempest-ProjectMemberTests-1966135882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:12:39 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-38476eae-c153-4054-8a64-e941f97f5690 tempest-ProjectMemberTests-1966135882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:12:39 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-38476eae-c153-4054-8a64-e941f97f5690 tempest-ProjectMemberTests-1966135882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:12:39 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-38476eae-c153-4054-8a64-e941f97f5690 tempest-ProjectMemberTests-1966135882 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 22:12:39 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-38476eae-c153-4054-8a64-e941f97f5690 tempest-ProjectMemberTests-1966135882 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 22:12:39 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-38476eae-c153-4054-8a64-e941f97f5690 tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0cecc943-6f77-4a9c-a8be-835d96dc5353 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:39 devstack sudo[105921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0cecc943-6f77-4a9c-a8be-835d96dc5353 1073741824 Sep 17 22:12:39 devstack sudo[105921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:40 devstack sudo[105921]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:40 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-38476eae-c153-4054-8a64-e941f97f5690 tempest-ProjectMemberTests-1966135882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0cecc943-6f77-4a9c-a8be-835d96dc5353 1073741824" returned: 0 in 0.467s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:40 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-38476eae-c153-4054-8a64-e941f97f5690 tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0cecc943-6f77-4a9c-a8be-835d96dc5353 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:40 devstack sudo[105927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0cecc943-6f77-4a9c-a8be-835d96dc5353 Sep 17 22:12:40 devstack sudo[105927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:40 devstack sudo[105927]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:40 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-38476eae-c153-4054-8a64-e941f97f5690 tempest-ProjectMemberTests-1966135882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0cecc943-6f77-4a9c-a8be-835d96dc5353" returned: 0 in 0.254s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:40 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-38476eae-c153-4054-8a64-e941f97f5690 tempest-ProjectMemberTests-1966135882 None] <== create_volume: return (773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 22:12:40 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-38476eae-c153-4054-8a64-e941f97f5690 tempest-ProjectMemberTests-1966135882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.776s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:12:40 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-38476eae-c153-4054-8a64-e941f97f5690 tempest-ProjectMemberTests-1966135882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7f3c5f4-8249-4844-a729-23c0edc07b6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0cecc943-6f77-4a9c-a8be-835d96dc5353', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:12:40 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-38476eae-c153-4054-8a64-e941f97f5690 tempest-ProjectMemberTests-1966135882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe5414fb-d59d-4294-91e0-3fe3d2b61c1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:12:40 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-38476eae-c153-4054-8a64-e941f97f5690 tempest-ProjectMemberTests-1966135882 None] Volume volume-0cecc943-6f77-4a9c-a8be-835d96dc5353 (0cecc943-6f77-4a9c-a8be-835d96dc5353): created successfully Sep 17 22:12:40 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-38476eae-c153-4054-8a64-e941f97f5690 tempest-ProjectMemberTests-1966135882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe5414fb-d59d-4294-91e0-3fe3d2b61c1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:12:40 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-38476eae-c153-4054-8a64-e941f97f5690 tempest-ProjectMemberTests-1966135882 None] Flow 'volume_create_manager' (56e4bccb-8e48-4297-9049-0b6c398097a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:12:40 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-38476eae-c153-4054-8a64-e941f97f5690 tempest-ProjectMemberTests-1966135882 None] Created volume successfully. Sep 17 22:12:41 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-5e096606-a6ec-4669-a8f1-1976e7e1897e tempest-ProjectMemberTests-1966135882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:12:41 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-5e096606-a6ec-4669-a8f1-1976e7e1897e tempest-ProjectMemberTests-1966135882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:12:41 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-5e096606-a6ec-4669-a8f1-1976e7e1897e tempest-ProjectMemberTests-1966135882 None] Creating offline snapshot c858029d-6c1d-4805-aaf4-d20aa7c18a18 of volume 0cecc943-6f77-4a9c-a8be-835d96dc5353 {{(pid=85458) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 22:12:41 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dcc6322-6adf-430d-9939-aa96cdd33c24]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:12:41 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-5e096606-a6ec-4669-a8f1-1976e7e1897e tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0cecc943-6f77-4a9c-a8be-835d96dc5353 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:42 devstack sudo[105930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0cecc943-6f77-4a9c-a8be-835d96dc5353 Sep 17 22:12:42 devstack sudo[105930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:42 devstack sudo[105930]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:42 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-5e096606-a6ec-4669-a8f1-1976e7e1897e tempest-ProjectMemberTests-1966135882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0cecc943-6f77-4a9c-a8be-835d96dc5353" returned: 0 in 0.392s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:42 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-5e096606-a6ec-4669-a8f1-1976e7e1897e tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0cecc943-6f77-4a9c-a8be-835d96dc5353,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0cecc943-6f77-4a9c-a8be-835d96dc5353.c858029d-6c1d-4805-aaf4-d20aa7c18a18 1G {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:42 devstack sudo[105935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0cecc943-6f77-4a9c-a8be-835d96dc5353,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0cecc943-6f77-4a9c-a8be-835d96dc5353.c858029d-6c1d-4805-aaf4-d20aa7c18a18 1G Sep 17 22:12:42 devstack sudo[105935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:42 devstack sudo[105935]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:42 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-5e096606-a6ec-4669-a8f1-1976e7e1897e tempest-ProjectMemberTests-1966135882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0cecc943-6f77-4a9c-a8be-835d96dc5353,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0cecc943-6f77-4a9c-a8be-835d96dc5353.c858029d-6c1d-4805-aaf4-d20aa7c18a18 1G" returned: 0 in 0.423s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:42 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-5e096606-a6ec-4669-a8f1-1976e7e1897e tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0cecc943-6f77-4a9c-a8be-835d96dc5353 -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0cecc943-6f77-4a9c-a8be-835d96dc5353.c858029d-6c1d-4805-aaf4-d20aa7c18a18 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:42 devstack sudo[105940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0cecc943-6f77-4a9c-a8be-835d96dc5353 -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0cecc943-6f77-4a9c-a8be-835d96dc5353.c858029d-6c1d-4805-aaf4-d20aa7c18a18 Sep 17 22:12:42 devstack sudo[105940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:43 devstack sudo[105940]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:43 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-5e096606-a6ec-4669-a8f1-1976e7e1897e tempest-ProjectMemberTests-1966135882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0cecc943-6f77-4a9c-a8be-835d96dc5353 -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0cecc943-6f77-4a9c-a8be-835d96dc5353.c858029d-6c1d-4805-aaf4-d20aa7c18a18" returned: 0 in 0.308s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:43 devstack cinder-volume[85458]: WARNING cinder.volume.drivers.remotefs [None req-5e096606-a6ec-4669-a8f1-1976e7e1897e tempest-ProjectMemberTests-1966135882 None] /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0cecc943-6f77-4a9c-a8be-835d96dc5353.c858029d-6c1d-4805-aaf4-d20aa7c18a18 is being set with open permissions: ugo+rw Sep 17 22:12:43 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-5e096606-a6ec-4669-a8f1-1976e7e1897e tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0cecc943-6f77-4a9c-a8be-835d96dc5353.c858029d-6c1d-4805-aaf4-d20aa7c18a18 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:43 devstack sudo[105945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0cecc943-6f77-4a9c-a8be-835d96dc5353.c858029d-6c1d-4805-aaf4-d20aa7c18a18 Sep 17 22:12:43 devstack sudo[105945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:43 devstack sudo[105945]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:43 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-5e096606-a6ec-4669-a8f1-1976e7e1897e tempest-ProjectMemberTests-1966135882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0cecc943-6f77-4a9c-a8be-835d96dc5353.c858029d-6c1d-4805-aaf4-d20aa7c18a18" returned: 0 in 0.259s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:43 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-5e096606-a6ec-4669-a8f1-1976e7e1897e tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0cecc943-6f77-4a9c-a8be-835d96dc5353.info {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:43 devstack sudo[105948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0cecc943-6f77-4a9c-a8be-835d96dc5353.info Sep 17 22:12:43 devstack sudo[105948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:43 devstack sudo[105948]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:43 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-5e096606-a6ec-4669-a8f1-1976e7e1897e tempest-ProjectMemberTests-1966135882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0cecc943-6f77-4a9c-a8be-835d96dc5353.info" returned: 0 in 0.260s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:43 devstack cinder-volume[85458]: WARNING cinder.volume.drivers.remotefs [None req-5e096606-a6ec-4669-a8f1-1976e7e1897e tempest-ProjectMemberTests-1966135882 None] /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0cecc943-6f77-4a9c-a8be-835d96dc5353.info is being set with open permissions: ugo+rw Sep 17 22:12:43 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-5e096606-a6ec-4669-a8f1-1976e7e1897e tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0cecc943-6f77-4a9c-a8be-835d96dc5353.info {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:43 devstack sudo[105951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0cecc943-6f77-4a9c-a8be-835d96dc5353.info Sep 17 22:12:43 devstack sudo[105951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:43 devstack sudo[105951]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:43 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-5e096606-a6ec-4669-a8f1-1976e7e1897e tempest-ProjectMemberTests-1966135882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0cecc943-6f77-4a9c-a8be-835d96dc5353.info" returned: 0 in 0.286s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:43 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-5e096606-a6ec-4669-a8f1-1976e7e1897e tempest-ProjectMemberTests-1966135882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.028s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:12:43 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-5e096606-a6ec-4669-a8f1-1976e7e1897e tempest-ProjectMemberTests-1966135882 None] Create snapshot completed successfully Sep 17 22:12:45 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-98caf692-ffff-470f-bc37-88c506f7baf0 tempest-ProjectMemberTests-1966135882 None] Acquiring lock "cinder-c858029d-6c1d-4805-aaf4-d20aa7c18a18-delete_snapshot" by "delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:12:45 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-98caf692-ffff-470f-bc37-88c506f7baf0 tempest-ProjectMemberTests-1966135882 None] Lock "cinder-c858029d-6c1d-4805-aaf4-d20aa7c18a18-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:12:45 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-98caf692-ffff-470f-bc37-88c506f7baf0 tempest-ProjectMemberTests-1966135882 None] Acquiring lock "cinder-quobyte-0cecc943-6f77-4a9c-a8be-835d96dc5353" by "delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:12:45 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-98caf692-ffff-470f-bc37-88c506f7baf0 tempest-ProjectMemberTests-1966135882 None] Lock "cinder-quobyte-0cecc943-6f77-4a9c-a8be-835d96dc5353" acquired by "delete_snapshot" :: waited 0.017s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:12:45 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-98caf692-ffff-470f-bc37-88c506f7baf0 tempest-ProjectMemberTests-1966135882 None] Acquiring lock "cinder-quobyte-c858029d-6c1d-4805-aaf4-d20aa7c18a18" by "_delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:12:45 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-98caf692-ffff-470f-bc37-88c506f7baf0 tempest-ProjectMemberTests-1966135882 None] Lock "cinder-quobyte-c858029d-6c1d-4805-aaf4-d20aa7c18a18" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:12:45 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-98caf692-ffff-470f-bc37-88c506f7baf0 tempest-ProjectMemberTests-1966135882 None] Deleting offline snapshot c858029d-6c1d-4805-aaf4-d20aa7c18a18 of volume 0cecc943-6f77-4a9c-a8be-835d96dc5353 {{(pid=85458) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 22:12:45 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-98caf692-ffff-470f-bc37-88c506f7baf0 tempest-ProjectMemberTests-1966135882 None] snapshot_file for this snap is: volume-0cecc943-6f77-4a9c-a8be-835d96dc5353.c858029d-6c1d-4805-aaf4-d20aa7c18a18 {{(pid=85458) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 22:12:45 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4f93f4c-05b8-4512-a0e5-cf9776e569c4]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:12:45 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-98caf692-ffff-470f-bc37-88c506f7baf0 tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0cecc943-6f77-4a9c-a8be-835d96dc5353.c858029d-6c1d-4805-aaf4-d20aa7c18a18 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:45 devstack sudo[105954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0cecc943-6f77-4a9c-a8be-835d96dc5353.c858029d-6c1d-4805-aaf4-d20aa7c18a18 Sep 17 22:12:45 devstack sudo[105954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:45 devstack sudo[105954]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:45 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-98caf692-ffff-470f-bc37-88c506f7baf0 tempest-ProjectMemberTests-1966135882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0cecc943-6f77-4a9c-a8be-835d96dc5353.c858029d-6c1d-4805-aaf4-d20aa7c18a18" returned: 0 in 0.383s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:45 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-98caf692-ffff-470f-bc37-88c506f7baf0 tempest-ProjectMemberTests-1966135882 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0cecc943-6f77-4a9c-a8be-835d96dc5353(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85458) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 22:12:45 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[5be2259d-b543-4e09-9f4f-f97d80977b8f]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:12:45 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-98caf692-ffff-470f-bc37-88c506f7baf0 tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0cecc943-6f77-4a9c-a8be-835d96dc5353 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:45 devstack sudo[105959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0cecc943-6f77-4a9c-a8be-835d96dc5353 Sep 17 22:12:45 devstack sudo[105959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:46 devstack sudo[105959]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:46 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-98caf692-ffff-470f-bc37-88c506f7baf0 tempest-ProjectMemberTests-1966135882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0cecc943-6f77-4a9c-a8be-835d96dc5353" returned: 0 in 0.399s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:46 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-98caf692-ffff-470f-bc37-88c506f7baf0 tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0cecc943-6f77-4a9c-a8be-835d96dc5353.c858029d-6c1d-4805-aaf4-d20aa7c18a18 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:46 devstack sudo[105964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0cecc943-6f77-4a9c-a8be-835d96dc5353.c858029d-6c1d-4805-aaf4-d20aa7c18a18 Sep 17 22:12:46 devstack sudo[105964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:46 devstack sudo[105964]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:46 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-98caf692-ffff-470f-bc37-88c506f7baf0 tempest-ProjectMemberTests-1966135882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0cecc943-6f77-4a9c-a8be-835d96dc5353.c858029d-6c1d-4805-aaf4-d20aa7c18a18" returned: 0 in 0.375s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:46 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-98caf692-ffff-470f-bc37-88c506f7baf0 tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0cecc943-6f77-4a9c-a8be-835d96dc5353.c858029d-6c1d-4805-aaf4-d20aa7c18a18 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:46 devstack sudo[105969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0cecc943-6f77-4a9c-a8be-835d96dc5353.c858029d-6c1d-4805-aaf4-d20aa7c18a18 Sep 17 22:12:46 devstack sudo[105969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:46 devstack sudo[105969]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:46 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-98caf692-ffff-470f-bc37-88c506f7baf0 tempest-ProjectMemberTests-1966135882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0cecc943-6f77-4a9c-a8be-835d96dc5353.c858029d-6c1d-4805-aaf4-d20aa7c18a18" returned: 0 in 0.250s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:46 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-98caf692-ffff-470f-bc37-88c506f7baf0 tempest-ProjectMemberTests-1966135882 None] Lock "cinder-quobyte-c858029d-6c1d-4805-aaf4-d20aa7c18a18" released by "_delete_snapshot" :: held 1.528s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:12:46 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-98caf692-ffff-470f-bc37-88c506f7baf0 tempest-ProjectMemberTests-1966135882 None] Lock "cinder-quobyte-0cecc943-6f77-4a9c-a8be-835d96dc5353" released by "delete_snapshot" :: held 1.571s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:12:46 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-98caf692-ffff-470f-bc37-88c506f7baf0 tempest-ProjectMemberTests-1966135882 None] Created reservations ['1c1e2d87-b403-4d05-97d0-d9e2c09dfdce', '6cf73eb1-0aef-416d-9b3f-e5029d84ebec', 'bdfd5cac-4c8f-42d0-b42a-3a4133470de0', '28c34dc0-306f-4f4c-a23c-e86f831acbe8'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:12:46 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-98caf692-ffff-470f-bc37-88c506f7baf0 tempest-ProjectMemberTests-1966135882 None] Delete snapshot completed successfully. Sep 17 22:12:46 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-98caf692-ffff-470f-bc37-88c506f7baf0 tempest-ProjectMemberTests-1966135882 None] Lock "cinder-c858029d-6c1d-4805-aaf4-d20aa7c18a18-delete_snapshot" released by "delete_snapshot" :: held 1.719s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:12:47 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-1c9d56ee-9ea3-4b55-9ae1-d1aa8f6779b8 tempest-ProjectMemberTests-1966135882 None] Acquiring lock "cinder-0cecc943-6f77-4a9c-a8be-835d96dc5353-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:12:47 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-1c9d56ee-9ea3-4b55-9ae1-d1aa8f6779b8 tempest-ProjectMemberTests-1966135882 None] Lock "cinder-0cecc943-6f77-4a9c-a8be-835d96dc5353-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:12:47 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-1c9d56ee-9ea3-4b55-9ae1-d1aa8f6779b8 tempest-ProjectMemberTests-1966135882 None] Acquiring lock "cinder-quobyte-0cecc943-6f77-4a9c-a8be-835d96dc5353" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:12:47 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-1c9d56ee-9ea3-4b55-9ae1-d1aa8f6779b8 tempest-ProjectMemberTests-1966135882 None] Lock "cinder-quobyte-0cecc943-6f77-4a9c-a8be-835d96dc5353" acquired by "delete_volume" :: waited 0.015s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:12:47 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[b961491d-caca-44a0-a88a-7c7053c79d04]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:12:47 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-1c9d56ee-9ea3-4b55-9ae1-d1aa8f6779b8 tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0cecc943-6f77-4a9c-a8be-835d96dc5353 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:47 devstack sudo[105972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0cecc943-6f77-4a9c-a8be-835d96dc5353 Sep 17 22:12:47 devstack sudo[105972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:47 devstack sudo[105972]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:47 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-1c9d56ee-9ea3-4b55-9ae1-d1aa8f6779b8 tempest-ProjectMemberTests-1966135882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0cecc943-6f77-4a9c-a8be-835d96dc5353" returned: 0 in 0.502s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:47 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-1c9d56ee-9ea3-4b55-9ae1-d1aa8f6779b8 tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0cecc943-6f77-4a9c-a8be-835d96dc5353 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:48 devstack sudo[105977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0cecc943-6f77-4a9c-a8be-835d96dc5353 Sep 17 22:12:48 devstack sudo[105977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:48 devstack sudo[105977]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:48 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-1c9d56ee-9ea3-4b55-9ae1-d1aa8f6779b8 tempest-ProjectMemberTests-1966135882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-0cecc943-6f77-4a9c-a8be-835d96dc5353" returned: 0 in 0.260s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:48 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-1c9d56ee-9ea3-4b55-9ae1-d1aa8f6779b8 tempest-ProjectMemberTests-1966135882 None] Lock "cinder-quobyte-0cecc943-6f77-4a9c-a8be-835d96dc5353" released by "delete_volume" :: held 0.859s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:12:48 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-1c9d56ee-9ea3-4b55-9ae1-d1aa8f6779b8 tempest-ProjectMemberTests-1966135882 None] Created reservations ['730d54cc-5e62-4572-95b6-37bd1627413b', '65959647-57a8-4f0b-8266-59497f8d0180', '5e5f155e-758e-446d-90cf-258c9436b53b', 'c25f7c2e-b176-47a4-836c-f440a334fd2d'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:12:48 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-1c9d56ee-9ea3-4b55-9ae1-d1aa8f6779b8 tempest-ProjectMemberTests-1966135882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:12:48 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-1c9d56ee-9ea3-4b55-9ae1-d1aa8f6779b8 tempest-ProjectMemberTests-1966135882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:12:48 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-1c9d56ee-9ea3-4b55-9ae1-d1aa8f6779b8 tempest-ProjectMemberTests-1966135882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:12:48 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-1c9d56ee-9ea3-4b55-9ae1-d1aa8f6779b8 tempest-ProjectMemberTests-1966135882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:12:48 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-1c9d56ee-9ea3-4b55-9ae1-d1aa8f6779b8 tempest-ProjectMemberTests-1966135882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:12:48 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-1c9d56ee-9ea3-4b55-9ae1-d1aa8f6779b8 tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:48 devstack sudo[105980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:12:48 devstack sudo[105980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:48 devstack sudo[105980]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:48 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-1c9d56ee-9ea3-4b55-9ae1-d1aa8f6779b8 tempest-ProjectMemberTests-1966135882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.293s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:48 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-1c9d56ee-9ea3-4b55-9ae1-d1aa8f6779b8 tempest-ProjectMemberTests-1966135882 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:12:48 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-1c9d56ee-9ea3-4b55-9ae1-d1aa8f6779b8 tempest-ProjectMemberTests-1966135882 None] Deleted volume successfully. Sep 17 22:12:48 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-1c9d56ee-9ea3-4b55-9ae1-d1aa8f6779b8 tempest-ProjectMemberTests-1966135882 None] Lock "cinder-0cecc943-6f77-4a9c-a8be-835d96dc5353-delete_volume" released by "delete_volume" :: held 1.370s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:12:48 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-81761758-8184-469e-b9c1-e7af7f533341 tempest-ProjectMemberTests-1966135882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 22:12:49 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-81761758-8184-469e-b9c1-e7af7f533341 tempest-ProjectMemberTests-1966135882 None] Flow 'volume_create_manager' (8d1c7bc9-3663-4245-aa38-93e9b889b2fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:12:49 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-81761758-8184-469e-b9c1-e7af7f533341 tempest-ProjectMemberTests-1966135882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d27c3ca8-121f-46a4-8024-689785ae4a1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:12:49 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-81761758-8184-469e-b9c1-e7af7f533341 tempest-ProjectMemberTests-1966135882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d27c3ca8-121f-46a4-8024-689785ae4a1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:12:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1045937895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8283f851-bd67-4480-ba10-747b44c7182b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f277f501a340474ca5d0daea12e88955',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:12:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:12:49Z,use_quota=True,user_id='e584775bfb3c440aa7aac369d15efa55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:12:49 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-81761758-8184-469e-b9c1-e7af7f533341 tempest-ProjectMemberTests-1966135882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4f2a417-35d8-4b87-a7b7-3cb0bcd538b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:12:49 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-81761758-8184-469e-b9c1-e7af7f533341 tempest-ProjectMemberTests-1966135882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4f2a417-35d8-4b87-a7b7-3cb0bcd538b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:12:49 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-81761758-8184-469e-b9c1-e7af7f533341 tempest-ProjectMemberTests-1966135882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2d1ca4d-fd63-495a-9334-ef90516c6a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:12:49 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-81761758-8184-469e-b9c1-e7af7f533341 tempest-ProjectMemberTests-1966135882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2d1ca4d-fd63-495a-9334-ef90516c6a6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8283f851-bd67-4480-ba10-747b44c7182b', 'volume_name': 'volume-8283f851-bd67-4480-ba10-747b44c7182b', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:12:49 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-81761758-8184-469e-b9c1-e7af7f533341 tempest-ProjectMemberTests-1966135882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c9d1d00-b07b-48d4-ad7a-3963bb1963f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:12:49 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-81761758-8184-469e-b9c1-e7af7f533341 tempest-ProjectMemberTests-1966135882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c9d1d00-b07b-48d4-ad7a-3963bb1963f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:12:49 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-81761758-8184-469e-b9c1-e7af7f533341 tempest-ProjectMemberTests-1966135882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16619961-9a62-4d90-a8d9-735c131f2731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:12:49 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-81761758-8184-469e-b9c1-e7af7f533341 tempest-ProjectMemberTests-1966135882 None] Volume 8283f851-bd67-4480-ba10-747b44c7182b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8283f851-bd67-4480-ba10-747b44c7182b', 'volume_size': 1} Sep 17 22:12:49 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-81761758-8184-469e-b9c1-e7af7f533341 tempest-ProjectMemberTests-1966135882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:12:49 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-81761758-8184-469e-b9c1-e7af7f533341 tempest-ProjectMemberTests-1966135882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:12:49 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-81761758-8184-469e-b9c1-e7af7f533341 tempest-ProjectMemberTests-1966135882 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:12:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1045937895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8283f851-bd67-4480-ba10-747b44c7182b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f277f501a340474ca5d0daea12e88955',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:12:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:12:49Z,use_quota=True,user_id='e584775bfb3c440aa7aac369d15efa55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 22:12:49 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-81761758-8184-469e-b9c1-e7af7f533341 tempest-ProjectMemberTests-1966135882 None] Creating volume 8283f851-bd67-4480-ba10-747b44c7182b {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 22:12:49 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-81761758-8184-469e-b9c1-e7af7f533341 tempest-ProjectMemberTests-1966135882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:12:49 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-81761758-8184-469e-b9c1-e7af7f533341 tempest-ProjectMemberTests-1966135882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:12:49 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-81761758-8184-469e-b9c1-e7af7f533341 tempest-ProjectMemberTests-1966135882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:12:49 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-81761758-8184-469e-b9c1-e7af7f533341 tempest-ProjectMemberTests-1966135882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:12:49 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-81761758-8184-469e-b9c1-e7af7f533341 tempest-ProjectMemberTests-1966135882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:12:49 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-81761758-8184-469e-b9c1-e7af7f533341 tempest-ProjectMemberTests-1966135882 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 22:12:49 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-81761758-8184-469e-b9c1-e7af7f533341 tempest-ProjectMemberTests-1966135882 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 22:12:49 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-81761758-8184-469e-b9c1-e7af7f533341 tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8283f851-bd67-4480-ba10-747b44c7182b 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:49 devstack sudo[105983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8283f851-bd67-4480-ba10-747b44c7182b 1073741824 Sep 17 22:12:49 devstack sudo[105983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:49 devstack sudo[105983]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:49 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-81761758-8184-469e-b9c1-e7af7f533341 tempest-ProjectMemberTests-1966135882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8283f851-bd67-4480-ba10-747b44c7182b 1073741824" returned: 0 in 0.468s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:49 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-81761758-8184-469e-b9c1-e7af7f533341 tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8283f851-bd67-4480-ba10-747b44c7182b {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:49 devstack sudo[105989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8283f851-bd67-4480-ba10-747b44c7182b Sep 17 22:12:49 devstack sudo[105989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:49 devstack sudo[105989]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:49 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-81761758-8184-469e-b9c1-e7af7f533341 tempest-ProjectMemberTests-1966135882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8283f851-bd67-4480-ba10-747b44c7182b" returned: 0 in 0.289s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:49 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-81761758-8184-469e-b9c1-e7af7f533341 tempest-ProjectMemberTests-1966135882 None] <== create_volume: return (809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 22:12:49 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-81761758-8184-469e-b9c1-e7af7f533341 tempest-ProjectMemberTests-1966135882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.812s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:12:49 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-81761758-8184-469e-b9c1-e7af7f533341 tempest-ProjectMemberTests-1966135882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16619961-9a62-4d90-a8d9-735c131f2731) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8283f851-bd67-4480-ba10-747b44c7182b', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:12:49 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-81761758-8184-469e-b9c1-e7af7f533341 tempest-ProjectMemberTests-1966135882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (503ef44f-2e2c-471f-bda9-3e5a90d9d745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:12:49 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-81761758-8184-469e-b9c1-e7af7f533341 tempest-ProjectMemberTests-1966135882 None] Volume volume-8283f851-bd67-4480-ba10-747b44c7182b (8283f851-bd67-4480-ba10-747b44c7182b): created successfully Sep 17 22:12:49 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-81761758-8184-469e-b9c1-e7af7f533341 tempest-ProjectMemberTests-1966135882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (503ef44f-2e2c-471f-bda9-3e5a90d9d745) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:12:49 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-81761758-8184-469e-b9c1-e7af7f533341 tempest-ProjectMemberTests-1966135882 None] Flow 'volume_create_manager' (8d1c7bc9-3663-4245-aa38-93e9b889b2fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:12:49 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-81761758-8184-469e-b9c1-e7af7f533341 tempest-ProjectMemberTests-1966135882 None] Created volume successfully. Sep 17 22:12:51 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-2bf2c302-b432-418e-bba6-63921542fd67 tempest-ProjectMemberTests-1966135882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:12:51 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-2bf2c302-b432-418e-bba6-63921542fd67 tempest-ProjectMemberTests-1966135882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:12:51 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-2bf2c302-b432-418e-bba6-63921542fd67 tempest-ProjectMemberTests-1966135882 None] Creating offline snapshot e51a1bb8-2b10-43f4-8d04-759789122aba of volume 8283f851-bd67-4480-ba10-747b44c7182b {{(pid=85458) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 22:12:51 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ac8a58b-dae6-484e-b030-b8038e579b8a]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:12:51 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-2bf2c302-b432-418e-bba6-63921542fd67 tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8283f851-bd67-4480-ba10-747b44c7182b {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:51 devstack sudo[105993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8283f851-bd67-4480-ba10-747b44c7182b Sep 17 22:12:51 devstack sudo[105993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:51 devstack sudo[105993]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:51 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-2bf2c302-b432-418e-bba6-63921542fd67 tempest-ProjectMemberTests-1966135882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8283f851-bd67-4480-ba10-747b44c7182b" returned: 0 in 0.436s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:51 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-2bf2c302-b432-418e-bba6-63921542fd67 tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8283f851-bd67-4480-ba10-747b44c7182b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8283f851-bd67-4480-ba10-747b44c7182b.e51a1bb8-2b10-43f4-8d04-759789122aba 1G {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:51 devstack sudo[105999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8283f851-bd67-4480-ba10-747b44c7182b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8283f851-bd67-4480-ba10-747b44c7182b.e51a1bb8-2b10-43f4-8d04-759789122aba 1G Sep 17 22:12:51 devstack sudo[105999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:52 devstack sudo[105999]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:52 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-2bf2c302-b432-418e-bba6-63921542fd67 tempest-ProjectMemberTests-1966135882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8283f851-bd67-4480-ba10-747b44c7182b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8283f851-bd67-4480-ba10-747b44c7182b.e51a1bb8-2b10-43f4-8d04-759789122aba 1G" returned: 0 in 0.535s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:52 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-2bf2c302-b432-418e-bba6-63921542fd67 tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8283f851-bd67-4480-ba10-747b44c7182b -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8283f851-bd67-4480-ba10-747b44c7182b.e51a1bb8-2b10-43f4-8d04-759789122aba {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:52 devstack sudo[106006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8283f851-bd67-4480-ba10-747b44c7182b -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8283f851-bd67-4480-ba10-747b44c7182b.e51a1bb8-2b10-43f4-8d04-759789122aba Sep 17 22:12:52 devstack sudo[106006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:52 devstack sudo[106006]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:52 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-2bf2c302-b432-418e-bba6-63921542fd67 tempest-ProjectMemberTests-1966135882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8283f851-bd67-4480-ba10-747b44c7182b -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8283f851-bd67-4480-ba10-747b44c7182b.e51a1bb8-2b10-43f4-8d04-759789122aba" returned: 0 in 0.364s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:52 devstack cinder-volume[85458]: WARNING cinder.volume.drivers.remotefs [None req-2bf2c302-b432-418e-bba6-63921542fd67 tempest-ProjectMemberTests-1966135882 None] /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8283f851-bd67-4480-ba10-747b44c7182b.e51a1bb8-2b10-43f4-8d04-759789122aba is being set with open permissions: ugo+rw Sep 17 22:12:52 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-2bf2c302-b432-418e-bba6-63921542fd67 tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8283f851-bd67-4480-ba10-747b44c7182b.e51a1bb8-2b10-43f4-8d04-759789122aba {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:52 devstack sudo[106012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8283f851-bd67-4480-ba10-747b44c7182b.e51a1bb8-2b10-43f4-8d04-759789122aba Sep 17 22:12:52 devstack sudo[106012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:52 devstack sudo[106012]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:52 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-2bf2c302-b432-418e-bba6-63921542fd67 tempest-ProjectMemberTests-1966135882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8283f851-bd67-4480-ba10-747b44c7182b.e51a1bb8-2b10-43f4-8d04-759789122aba" returned: 0 in 0.253s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:52 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-2bf2c302-b432-418e-bba6-63921542fd67 tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8283f851-bd67-4480-ba10-747b44c7182b.info {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:52 devstack sudo[106015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8283f851-bd67-4480-ba10-747b44c7182b.info Sep 17 22:12:52 devstack sudo[106015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:53 devstack sudo[106015]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:53 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-2bf2c302-b432-418e-bba6-63921542fd67 tempest-ProjectMemberTests-1966135882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8283f851-bd67-4480-ba10-747b44c7182b.info" returned: 0 in 0.271s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:53 devstack cinder-volume[85458]: WARNING cinder.volume.drivers.remotefs [None req-2bf2c302-b432-418e-bba6-63921542fd67 tempest-ProjectMemberTests-1966135882 None] /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8283f851-bd67-4480-ba10-747b44c7182b.info is being set with open permissions: ugo+rw Sep 17 22:12:53 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-2bf2c302-b432-418e-bba6-63921542fd67 tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8283f851-bd67-4480-ba10-747b44c7182b.info {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:53 devstack sudo[106018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8283f851-bd67-4480-ba10-747b44c7182b.info Sep 17 22:12:53 devstack sudo[106018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:53 devstack sudo[106018]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:53 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-2bf2c302-b432-418e-bba6-63921542fd67 tempest-ProjectMemberTests-1966135882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8283f851-bd67-4480-ba10-747b44c7182b.info" returned: 0 in 0.322s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:53 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-2bf2c302-b432-418e-bba6-63921542fd67 tempest-ProjectMemberTests-1966135882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.285s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:12:53 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-2bf2c302-b432-418e-bba6-63921542fd67 tempest-ProjectMemberTests-1966135882 None] Create snapshot completed successfully Sep 17 22:12:54 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-25fad267-a104-4ee2-80a4-a90f6bbdba6d tempest-ProjectMemberTests-1966135882 None] Acquiring lock "cinder-e51a1bb8-2b10-43f4-8d04-759789122aba-delete_snapshot" by "delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:12:54 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-25fad267-a104-4ee2-80a4-a90f6bbdba6d tempest-ProjectMemberTests-1966135882 None] Lock "cinder-e51a1bb8-2b10-43f4-8d04-759789122aba-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:12:54 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-25fad267-a104-4ee2-80a4-a90f6bbdba6d tempest-ProjectMemberTests-1966135882 None] Acquiring lock "cinder-quobyte-8283f851-bd67-4480-ba10-747b44c7182b" by "delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:12:54 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-25fad267-a104-4ee2-80a4-a90f6bbdba6d tempest-ProjectMemberTests-1966135882 None] Lock "cinder-quobyte-8283f851-bd67-4480-ba10-747b44c7182b" acquired by "delete_snapshot" :: waited 0.019s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:12:54 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-25fad267-a104-4ee2-80a4-a90f6bbdba6d tempest-ProjectMemberTests-1966135882 None] Acquiring lock "cinder-quobyte-e51a1bb8-2b10-43f4-8d04-759789122aba" by "_delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:12:54 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-25fad267-a104-4ee2-80a4-a90f6bbdba6d tempest-ProjectMemberTests-1966135882 None] Lock "cinder-quobyte-e51a1bb8-2b10-43f4-8d04-759789122aba" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:12:54 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-25fad267-a104-4ee2-80a4-a90f6bbdba6d tempest-ProjectMemberTests-1966135882 None] Deleting offline snapshot e51a1bb8-2b10-43f4-8d04-759789122aba of volume 8283f851-bd67-4480-ba10-747b44c7182b {{(pid=85458) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 22:12:54 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-25fad267-a104-4ee2-80a4-a90f6bbdba6d tempest-ProjectMemberTests-1966135882 None] snapshot_file for this snap is: volume-8283f851-bd67-4480-ba10-747b44c7182b.e51a1bb8-2b10-43f4-8d04-759789122aba {{(pid=85458) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 22:12:54 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[88890ff0-d650-4485-8c2d-94965c2d5c06]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:12:54 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-25fad267-a104-4ee2-80a4-a90f6bbdba6d tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8283f851-bd67-4480-ba10-747b44c7182b.e51a1bb8-2b10-43f4-8d04-759789122aba {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:54 devstack sudo[106021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8283f851-bd67-4480-ba10-747b44c7182b.e51a1bb8-2b10-43f4-8d04-759789122aba Sep 17 22:12:54 devstack sudo[106021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:55 devstack sudo[106021]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:55 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-25fad267-a104-4ee2-80a4-a90f6bbdba6d tempest-ProjectMemberTests-1966135882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8283f851-bd67-4480-ba10-747b44c7182b.e51a1bb8-2b10-43f4-8d04-759789122aba" returned: 0 in 0.413s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:55 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-25fad267-a104-4ee2-80a4-a90f6bbdba6d tempest-ProjectMemberTests-1966135882 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8283f851-bd67-4480-ba10-747b44c7182b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85458) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 22:12:55 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[c11e1f8e-838a-40f6-a8ae-567354b804c2]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:12:55 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-25fad267-a104-4ee2-80a4-a90f6bbdba6d tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8283f851-bd67-4480-ba10-747b44c7182b {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:55 devstack sudo[106026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8283f851-bd67-4480-ba10-747b44c7182b Sep 17 22:12:55 devstack sudo[106026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:55 devstack sudo[106026]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:55 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-25fad267-a104-4ee2-80a4-a90f6bbdba6d tempest-ProjectMemberTests-1966135882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8283f851-bd67-4480-ba10-747b44c7182b" returned: 0 in 0.399s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:55 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-25fad267-a104-4ee2-80a4-a90f6bbdba6d tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8283f851-bd67-4480-ba10-747b44c7182b.e51a1bb8-2b10-43f4-8d04-759789122aba {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:55 devstack sudo[106031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8283f851-bd67-4480-ba10-747b44c7182b.e51a1bb8-2b10-43f4-8d04-759789122aba Sep 17 22:12:55 devstack sudo[106031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:55 devstack sudo[106031]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:55 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-25fad267-a104-4ee2-80a4-a90f6bbdba6d tempest-ProjectMemberTests-1966135882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8283f851-bd67-4480-ba10-747b44c7182b.e51a1bb8-2b10-43f4-8d04-759789122aba" returned: 0 in 0.375s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:55 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-25fad267-a104-4ee2-80a4-a90f6bbdba6d tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8283f851-bd67-4480-ba10-747b44c7182b.e51a1bb8-2b10-43f4-8d04-759789122aba {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:55 devstack sudo[106036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8283f851-bd67-4480-ba10-747b44c7182b.e51a1bb8-2b10-43f4-8d04-759789122aba Sep 17 22:12:55 devstack sudo[106036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:56 devstack sudo[106036]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:56 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-25fad267-a104-4ee2-80a4-a90f6bbdba6d tempest-ProjectMemberTests-1966135882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8283f851-bd67-4480-ba10-747b44c7182b.e51a1bb8-2b10-43f4-8d04-759789122aba" returned: 0 in 0.258s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:56 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-25fad267-a104-4ee2-80a4-a90f6bbdba6d tempest-ProjectMemberTests-1966135882 None] Lock "cinder-quobyte-e51a1bb8-2b10-43f4-8d04-759789122aba" released by "_delete_snapshot" :: held 1.556s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:12:56 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-25fad267-a104-4ee2-80a4-a90f6bbdba6d tempest-ProjectMemberTests-1966135882 None] Lock "cinder-quobyte-8283f851-bd67-4480-ba10-747b44c7182b" released by "delete_snapshot" :: held 1.579s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:12:56 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-25fad267-a104-4ee2-80a4-a90f6bbdba6d tempest-ProjectMemberTests-1966135882 None] Created reservations ['3e9e074b-af48-444d-8264-b62713eb0078', '5d2e47ea-80e5-496a-a5f2-6aac176546cf', '1e9611ff-9981-4230-8ce0-863c0b025ebb', '6bb2780e-2d6e-48aa-841c-00f305fdc251'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:12:56 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-25fad267-a104-4ee2-80a4-a90f6bbdba6d tempest-ProjectMemberTests-1966135882 None] Delete snapshot completed successfully. Sep 17 22:12:56 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-25fad267-a104-4ee2-80a4-a90f6bbdba6d tempest-ProjectMemberTests-1966135882 None] Lock "cinder-e51a1bb8-2b10-43f4-8d04-759789122aba-delete_snapshot" released by "delete_snapshot" :: held 1.755s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:12:56 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-913fab1c-70d6-4224-9e38-b30118741e2a tempest-ProjectMemberTests-1966135882 None] Acquiring lock "cinder-8283f851-bd67-4480-ba10-747b44c7182b-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:12:56 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-913fab1c-70d6-4224-9e38-b30118741e2a tempest-ProjectMemberTests-1966135882 None] Lock "cinder-8283f851-bd67-4480-ba10-747b44c7182b-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:12:56 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-913fab1c-70d6-4224-9e38-b30118741e2a tempest-ProjectMemberTests-1966135882 None] Acquiring lock "cinder-quobyte-8283f851-bd67-4480-ba10-747b44c7182b" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:12:56 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-913fab1c-70d6-4224-9e38-b30118741e2a tempest-ProjectMemberTests-1966135882 None] Lock "cinder-quobyte-8283f851-bd67-4480-ba10-747b44c7182b" acquired by "delete_volume" :: waited 0.022s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:12:56 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cc6ef5c-b3cb-425b-9abc-8666d622f129]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:12:56 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-913fab1c-70d6-4224-9e38-b30118741e2a tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8283f851-bd67-4480-ba10-747b44c7182b {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:56 devstack sudo[106040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8283f851-bd67-4480-ba10-747b44c7182b Sep 17 22:12:56 devstack sudo[106040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:57 devstack sudo[106040]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:57 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-913fab1c-70d6-4224-9e38-b30118741e2a tempest-ProjectMemberTests-1966135882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8283f851-bd67-4480-ba10-747b44c7182b" returned: 0 in 0.373s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:57 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-913fab1c-70d6-4224-9e38-b30118741e2a tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8283f851-bd67-4480-ba10-747b44c7182b {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:57 devstack sudo[106045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8283f851-bd67-4480-ba10-747b44c7182b Sep 17 22:12:57 devstack sudo[106045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:57 devstack sudo[106045]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:57 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-913fab1c-70d6-4224-9e38-b30118741e2a tempest-ProjectMemberTests-1966135882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-8283f851-bd67-4480-ba10-747b44c7182b" returned: 0 in 0.304s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:57 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-913fab1c-70d6-4224-9e38-b30118741e2a tempest-ProjectMemberTests-1966135882 None] Lock "cinder-quobyte-8283f851-bd67-4480-ba10-747b44c7182b" released by "delete_volume" :: held 0.756s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:12:57 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-913fab1c-70d6-4224-9e38-b30118741e2a tempest-ProjectMemberTests-1966135882 None] Created reservations ['8afd137f-8778-49d9-a5a8-a9ef6c0a38ae', 'a9c212a2-50d2-42d0-bea3-732d85ae016b', '4181fc8c-eb58-4aaa-b8d7-6e19c1a77e05', '658ece66-9594-4765-a908-aef26c4d0ca7'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:12:57 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-913fab1c-70d6-4224-9e38-b30118741e2a tempest-ProjectMemberTests-1966135882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:12:57 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-913fab1c-70d6-4224-9e38-b30118741e2a tempest-ProjectMemberTests-1966135882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:12:57 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-913fab1c-70d6-4224-9e38-b30118741e2a tempest-ProjectMemberTests-1966135882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:12:57 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-913fab1c-70d6-4224-9e38-b30118741e2a tempest-ProjectMemberTests-1966135882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:12:57 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-913fab1c-70d6-4224-9e38-b30118741e2a tempest-ProjectMemberTests-1966135882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:12:57 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-913fab1c-70d6-4224-9e38-b30118741e2a tempest-ProjectMemberTests-1966135882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:12:57 devstack sudo[106048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:12:57 devstack sudo[106048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:12:57 devstack sudo[106048]: pam_unix(sudo:session): session closed for user root Sep 17 22:12:57 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-913fab1c-70d6-4224-9e38-b30118741e2a tempest-ProjectMemberTests-1966135882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.290s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:12:57 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-913fab1c-70d6-4224-9e38-b30118741e2a tempest-ProjectMemberTests-1966135882 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:12:57 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-913fab1c-70d6-4224-9e38-b30118741e2a tempest-ProjectMemberTests-1966135882 None] Deleted volume successfully. Sep 17 22:12:57 devstack cinder-volume[85458]: DEBUG dbcounter [-] [85458] Writing DB stats cinder:UPDATE=214,cinder:SELECT=181,cinder:INSERT=55,cinder:DELETE=21 {{(pid=85458) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 22:12:58 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-913fab1c-70d6-4224-9e38-b30118741e2a tempest-ProjectMemberTests-1966135882 None] Lock "cinder-8283f851-bd67-4480-ba10-747b44c7182b-delete_volume" released by "delete_volume" :: held 1.283s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:13:05 devstack cinder-volume[85458]: DEBUG dbcounter [-] [85458] Writing DB stats cinder:SELECT=157,cinder:INSERT=72,cinder:UPDATE=225,cinder:DELETE=15 {{(pid=85458) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 22:13:05 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f75d379-a8ad-41c5-8843-d28073e6178b tempest-SnapshotDependencyTests-1201330148 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 22:13:05 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-7f75d379-a8ad-41c5-8843-d28073e6178b tempest-SnapshotDependencyTests-1201330148 None] Flow 'volume_create_manager' (1ce644fb-46fa-498b-b3b2-eb671bb01a2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:13:05 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-7f75d379-a8ad-41c5-8843-d28073e6178b tempest-SnapshotDependencyTests-1201330148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9341306f-77bd-4df4-b764-6c9e7a67b18e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:13:05 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-7f75d379-a8ad-41c5-8843-d28073e6178b tempest-SnapshotDependencyTests-1201330148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9341306f-77bd-4df4-b764-6c9e7a67b18e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:13:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-527498505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4f03e01-3c2e-410c-b3e8-64ffe04c53c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ea4984cfb0d4fdf834cc976bbd65e76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:13:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:13:06Z,use_quota=True,user_id='d10ce406e4084b949c1dc71e99812580',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:13:05 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-7f75d379-a8ad-41c5-8843-d28073e6178b tempest-SnapshotDependencyTests-1201330148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d53763de-f253-402e-9ea4-e92e3997984e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:13:05 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-7f75d379-a8ad-41c5-8843-d28073e6178b tempest-SnapshotDependencyTests-1201330148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d53763de-f253-402e-9ea4-e92e3997984e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:13:05 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-7f75d379-a8ad-41c5-8843-d28073e6178b tempest-SnapshotDependencyTests-1201330148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60de8f5c-1c7c-4d2c-9ac6-e988765deb21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:13:05 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-7f75d379-a8ad-41c5-8843-d28073e6178b tempest-SnapshotDependencyTests-1201330148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60de8f5c-1c7c-4d2c-9ac6-e988765deb21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4f03e01-3c2e-410c-b3e8-64ffe04c53c3', 'volume_name': 'volume-a4f03e01-3c2e-410c-b3e8-64ffe04c53c3', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:13:06 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-7f75d379-a8ad-41c5-8843-d28073e6178b tempest-SnapshotDependencyTests-1201330148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9e4fb85-c591-4864-9765-42b0c9add7b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:13:06 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-7f75d379-a8ad-41c5-8843-d28073e6178b tempest-SnapshotDependencyTests-1201330148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9e4fb85-c591-4864-9765-42b0c9add7b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:13:06 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-7f75d379-a8ad-41c5-8843-d28073e6178b tempest-SnapshotDependencyTests-1201330148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (160e0dbb-bee3-446f-825d-39517b2f1c7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:13:06 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-7f75d379-a8ad-41c5-8843-d28073e6178b tempest-SnapshotDependencyTests-1201330148 None] Volume a4f03e01-3c2e-410c-b3e8-64ffe04c53c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4f03e01-3c2e-410c-b3e8-64ffe04c53c3', 'volume_size': 1} Sep 17 22:13:06 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-7f75d379-a8ad-41c5-8843-d28073e6178b tempest-SnapshotDependencyTests-1201330148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:13:06 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-7f75d379-a8ad-41c5-8843-d28073e6178b tempest-SnapshotDependencyTests-1201330148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:13:06 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-7f75d379-a8ad-41c5-8843-d28073e6178b tempest-SnapshotDependencyTests-1201330148 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:13:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-527498505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4f03e01-3c2e-410c-b3e8-64ffe04c53c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ea4984cfb0d4fdf834cc976bbd65e76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:13:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:13:06Z,use_quota=True,user_id='d10ce406e4084b949c1dc71e99812580',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 22:13:06 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-7f75d379-a8ad-41c5-8843-d28073e6178b tempest-SnapshotDependencyTests-1201330148 None] Creating volume a4f03e01-3c2e-410c-b3e8-64ffe04c53c3 {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 22:13:06 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-7f75d379-a8ad-41c5-8843-d28073e6178b tempest-SnapshotDependencyTests-1201330148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:13:06 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-7f75d379-a8ad-41c5-8843-d28073e6178b tempest-SnapshotDependencyTests-1201330148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:13:06 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-7f75d379-a8ad-41c5-8843-d28073e6178b tempest-SnapshotDependencyTests-1201330148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:13:06 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-7f75d379-a8ad-41c5-8843-d28073e6178b tempest-SnapshotDependencyTests-1201330148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:13:06 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-7f75d379-a8ad-41c5-8843-d28073e6178b tempest-SnapshotDependencyTests-1201330148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:13:06 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-7f75d379-a8ad-41c5-8843-d28073e6178b tempest-SnapshotDependencyTests-1201330148 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 22:13:06 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-7f75d379-a8ad-41c5-8843-d28073e6178b tempest-SnapshotDependencyTests-1201330148 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 22:13:06 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-7f75d379-a8ad-41c5-8843-d28073e6178b tempest-SnapshotDependencyTests-1201330148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a4f03e01-3c2e-410c-b3e8-64ffe04c53c3 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:13:06 devstack sudo[106052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a4f03e01-3c2e-410c-b3e8-64ffe04c53c3 1073741824 Sep 17 22:13:06 devstack sudo[106052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:13:06 devstack sudo[106052]: pam_unix(sudo:session): session closed for user root Sep 17 22:13:06 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-7f75d379-a8ad-41c5-8843-d28073e6178b tempest-SnapshotDependencyTests-1201330148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a4f03e01-3c2e-410c-b3e8-64ffe04c53c3 1073741824" returned: 0 in 0.482s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:13:06 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-8511d62c-da1b-42e5-adc8-5a0e889bf37d tempest-ProjectReaderTests-715093400 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 22:13:06 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-8511d62c-da1b-42e5-adc8-5a0e889bf37d tempest-ProjectReaderTests-715093400 None] Flow 'volume_create_manager' (3956a677-350c-4fe6-ab32-4ee428f29e78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:13:06 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-8511d62c-da1b-42e5-adc8-5a0e889bf37d tempest-ProjectReaderTests-715093400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff447144-d4d0-4795-b1d1-dc1abc46b412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:13:06 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-8511d62c-da1b-42e5-adc8-5a0e889bf37d tempest-ProjectReaderTests-715093400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff447144-d4d0-4795-b1d1-dc1abc46b412) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:13:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2068215719',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2e73238-937c-477c-a6d7-ffe1c9e215a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6fda5fd4130411ea7bffaf64a96892a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:13:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:13:06Z,use_quota=True,user_id='08c6cc94cbb241aa8ca94ca73202a6c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:13:06 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-8511d62c-da1b-42e5-adc8-5a0e889bf37d tempest-ProjectReaderTests-715093400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cb6d5b3-28b7-43a7-b885-ceaea38324c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:13:06 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-8511d62c-da1b-42e5-adc8-5a0e889bf37d tempest-ProjectReaderTests-715093400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cb6d5b3-28b7-43a7-b885-ceaea38324c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:13:06 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-8511d62c-da1b-42e5-adc8-5a0e889bf37d tempest-ProjectReaderTests-715093400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71869261-746e-4cdf-8ff8-6a3d027b93d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:13:06 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-8511d62c-da1b-42e5-adc8-5a0e889bf37d tempest-ProjectReaderTests-715093400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71869261-746e-4cdf-8ff8-6a3d027b93d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2e73238-937c-477c-a6d7-ffe1c9e215a7', 'volume_name': 'volume-e2e73238-937c-477c-a6d7-ffe1c9e215a7', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:13:06 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-8511d62c-da1b-42e5-adc8-5a0e889bf37d tempest-ProjectReaderTests-715093400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (faa6c659-a356-4789-b176-88a150e3a508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:13:06 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-8511d62c-da1b-42e5-adc8-5a0e889bf37d tempest-ProjectReaderTests-715093400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (faa6c659-a356-4789-b176-88a150e3a508) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:13:06 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-8511d62c-da1b-42e5-adc8-5a0e889bf37d tempest-ProjectReaderTests-715093400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b2e312a-6a50-4382-b119-a10d9ca25822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:13:06 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-8511d62c-da1b-42e5-adc8-5a0e889bf37d tempest-ProjectReaderTests-715093400 None] Volume e2e73238-937c-477c-a6d7-ffe1c9e215a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2e73238-937c-477c-a6d7-ffe1c9e215a7', 'volume_size': 1} Sep 17 22:13:06 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-8511d62c-da1b-42e5-adc8-5a0e889bf37d tempest-ProjectReaderTests-715093400 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:13:06 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-7f75d379-a8ad-41c5-8843-d28073e6178b tempest-SnapshotDependencyTests-1201330148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a4f03e01-3c2e-410c-b3e8-64ffe04c53c3 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:13:06 devstack sudo[106058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a4f03e01-3c2e-410c-b3e8-64ffe04c53c3 Sep 17 22:13:06 devstack sudo[106058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:13:06 devstack sudo[106058]: pam_unix(sudo:session): session closed for user root Sep 17 22:13:06 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-7f75d379-a8ad-41c5-8843-d28073e6178b tempest-SnapshotDependencyTests-1201330148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a4f03e01-3c2e-410c-b3e8-64ffe04c53c3" returned: 0 in 0.251s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:13:06 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-7f75d379-a8ad-41c5-8843-d28073e6178b tempest-SnapshotDependencyTests-1201330148 None] <== create_volume: return (850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 22:13:06 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-7f75d379-a8ad-41c5-8843-d28073e6178b tempest-SnapshotDependencyTests-1201330148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.852s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:13:06 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-8511d62c-da1b-42e5-adc8-5a0e889bf37d tempest-ProjectReaderTests-715093400 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.265s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:13:06 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-8511d62c-da1b-42e5-adc8-5a0e889bf37d tempest-ProjectReaderTests-715093400 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:13:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2068215719',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2e73238-937c-477c-a6d7-ffe1c9e215a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6fda5fd4130411ea7bffaf64a96892a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:13:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:13:06Z,use_quota=True,user_id='08c6cc94cbb241aa8ca94ca73202a6c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 22:13:06 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-8511d62c-da1b-42e5-adc8-5a0e889bf37d tempest-ProjectReaderTests-715093400 None] Creating volume e2e73238-937c-477c-a6d7-ffe1c9e215a7 {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 22:13:06 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-8511d62c-da1b-42e5-adc8-5a0e889bf37d tempest-ProjectReaderTests-715093400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:13:06 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-8511d62c-da1b-42e5-adc8-5a0e889bf37d tempest-ProjectReaderTests-715093400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:13:06 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-8511d62c-da1b-42e5-adc8-5a0e889bf37d tempest-ProjectReaderTests-715093400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:13:06 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-8511d62c-da1b-42e5-adc8-5a0e889bf37d tempest-ProjectReaderTests-715093400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:13:06 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-8511d62c-da1b-42e5-adc8-5a0e889bf37d tempest-ProjectReaderTests-715093400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:13:06 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-8511d62c-da1b-42e5-adc8-5a0e889bf37d tempest-ProjectReaderTests-715093400 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 22:13:06 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-8511d62c-da1b-42e5-adc8-5a0e889bf37d tempest-ProjectReaderTests-715093400 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 22:13:06 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-8511d62c-da1b-42e5-adc8-5a0e889bf37d tempest-ProjectReaderTests-715093400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e2e73238-937c-477c-a6d7-ffe1c9e215a7 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:13:06 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-7f75d379-a8ad-41c5-8843-d28073e6178b tempest-SnapshotDependencyTests-1201330148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (160e0dbb-bee3-446f-825d-39517b2f1c7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4f03e01-3c2e-410c-b3e8-64ffe04c53c3', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:13:06 devstack sudo[106061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e2e73238-937c-477c-a6d7-ffe1c9e215a7 1073741824 Sep 17 22:13:06 devstack sudo[106061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:13:06 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-7f75d379-a8ad-41c5-8843-d28073e6178b tempest-SnapshotDependencyTests-1201330148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6870b874-adda-4946-9ee3-d30cae3c8c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:13:06 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-7f75d379-a8ad-41c5-8843-d28073e6178b tempest-SnapshotDependencyTests-1201330148 None] Volume volume-a4f03e01-3c2e-410c-b3e8-64ffe04c53c3 (a4f03e01-3c2e-410c-b3e8-64ffe04c53c3): created successfully Sep 17 22:13:06 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-7f75d379-a8ad-41c5-8843-d28073e6178b tempest-SnapshotDependencyTests-1201330148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6870b874-adda-4946-9ee3-d30cae3c8c82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:13:06 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-7f75d379-a8ad-41c5-8843-d28073e6178b tempest-SnapshotDependencyTests-1201330148 None] Flow 'volume_create_manager' (1ce644fb-46fa-498b-b3b2-eb671bb01a2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:13:06 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-7f75d379-a8ad-41c5-8843-d28073e6178b tempest-SnapshotDependencyTests-1201330148 None] Created volume successfully. Sep 17 22:13:07 devstack sudo[106061]: pam_unix(sudo:session): session closed for user root Sep 17 22:13:07 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-8511d62c-da1b-42e5-adc8-5a0e889bf37d tempest-ProjectReaderTests-715093400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e2e73238-937c-477c-a6d7-ffe1c9e215a7 1073741824" returned: 0 in 0.408s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:13:07 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-8511d62c-da1b-42e5-adc8-5a0e889bf37d tempest-ProjectReaderTests-715093400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e2e73238-937c-477c-a6d7-ffe1c9e215a7 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:13:07 devstack sudo[106066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e2e73238-937c-477c-a6d7-ffe1c9e215a7 Sep 17 22:13:07 devstack sudo[106066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:13:07 devstack sudo[106066]: pam_unix(sudo:session): session closed for user root Sep 17 22:13:07 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-8511d62c-da1b-42e5-adc8-5a0e889bf37d tempest-ProjectReaderTests-715093400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e2e73238-937c-477c-a6d7-ffe1c9e215a7" returned: 0 in 0.252s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:13:07 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-8511d62c-da1b-42e5-adc8-5a0e889bf37d tempest-ProjectReaderTests-715093400 None] <== create_volume: return (698ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 22:13:07 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-8511d62c-da1b-42e5-adc8-5a0e889bf37d tempest-ProjectReaderTests-715093400 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.700s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:13:07 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-8511d62c-da1b-42e5-adc8-5a0e889bf37d tempest-ProjectReaderTests-715093400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b2e312a-6a50-4382-b119-a10d9ca25822) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2e73238-937c-477c-a6d7-ffe1c9e215a7', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:13:07 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-8511d62c-da1b-42e5-adc8-5a0e889bf37d tempest-ProjectReaderTests-715093400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4458048a-3b78-4edc-b891-81da96a99c66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:13:07 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-8511d62c-da1b-42e5-adc8-5a0e889bf37d tempest-ProjectReaderTests-715093400 None] Volume volume-e2e73238-937c-477c-a6d7-ffe1c9e215a7 (e2e73238-937c-477c-a6d7-ffe1c9e215a7): created successfully Sep 17 22:13:07 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-8511d62c-da1b-42e5-adc8-5a0e889bf37d tempest-ProjectReaderTests-715093400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4458048a-3b78-4edc-b891-81da96a99c66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:13:07 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-8511d62c-da1b-42e5-adc8-5a0e889bf37d tempest-ProjectReaderTests-715093400 None] Flow 'volume_create_manager' (3956a677-350c-4fe6-ab32-4ee428f29e78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:13:07 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-8511d62c-da1b-42e5-adc8-5a0e889bf37d tempest-ProjectReaderTests-715093400 None] Created volume successfully. Sep 17 22:13:08 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-d9c17b17-ef9b-4ea5-9219-5666e6a08fdc tempest-SnapshotDependencyTests-1201330148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:13:08 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-d9c17b17-ef9b-4ea5-9219-5666e6a08fdc tempest-SnapshotDependencyTests-1201330148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:13:08 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-d9c17b17-ef9b-4ea5-9219-5666e6a08fdc tempest-SnapshotDependencyTests-1201330148 None] Creating offline snapshot b2838d90-eda0-40a2-aa9e-f8ca6817b604 of volume a4f03e01-3c2e-410c-b3e8-64ffe04c53c3 {{(pid=85458) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 22:13:08 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[efca2d5e-1b8c-47fb-9b71-ea3280461587]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:13:08 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-d9c17b17-ef9b-4ea5-9219-5666e6a08fdc tempest-SnapshotDependencyTests-1201330148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a4f03e01-3c2e-410c-b3e8-64ffe04c53c3 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:13:08 devstack sudo[106069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a4f03e01-3c2e-410c-b3e8-64ffe04c53c3 Sep 17 22:13:08 devstack sudo[106069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:13:08 devstack sudo[106069]: pam_unix(sudo:session): session closed for user root Sep 17 22:13:08 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-d9c17b17-ef9b-4ea5-9219-5666e6a08fdc tempest-SnapshotDependencyTests-1201330148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a4f03e01-3c2e-410c-b3e8-64ffe04c53c3" returned: 0 in 0.378s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:13:08 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-d9c17b17-ef9b-4ea5-9219-5666e6a08fdc tempest-SnapshotDependencyTests-1201330148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a4f03e01-3c2e-410c-b3e8-64ffe04c53c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a4f03e01-3c2e-410c-b3e8-64ffe04c53c3.b2838d90-eda0-40a2-aa9e-f8ca6817b604 1G {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:13:08 devstack sudo[106074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a4f03e01-3c2e-410c-b3e8-64ffe04c53c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a4f03e01-3c2e-410c-b3e8-64ffe04c53c3.b2838d90-eda0-40a2-aa9e-f8ca6817b604 1G Sep 17 22:13:08 devstack sudo[106074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:13:08 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-5e3f6df7-a100-40ce-83ca-a4f081d74f41 tempest-ProjectReaderTests-715093400 None] Acquiring lock "cinder-e2e73238-937c-477c-a6d7-ffe1c9e215a7-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:13:08 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-5e3f6df7-a100-40ce-83ca-a4f081d74f41 tempest-ProjectReaderTests-715093400 None] Lock "cinder-e2e73238-937c-477c-a6d7-ffe1c9e215a7-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:13:08 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-5e3f6df7-a100-40ce-83ca-a4f081d74f41 tempest-ProjectReaderTests-715093400 None] Acquiring lock "cinder-quobyte-e2e73238-937c-477c-a6d7-ffe1c9e215a7" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:13:08 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-5e3f6df7-a100-40ce-83ca-a4f081d74f41 tempest-ProjectReaderTests-715093400 None] Lock "cinder-quobyte-e2e73238-937c-477c-a6d7-ffe1c9e215a7" acquired by "delete_volume" :: waited 0.015s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:13:08 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7952f6a-1f28-4638-8ea8-0674b347a814]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:13:08 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-5e3f6df7-a100-40ce-83ca-a4f081d74f41 tempest-ProjectReaderTests-715093400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e2e73238-937c-477c-a6d7-ffe1c9e215a7 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:13:08 devstack sudo[106079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e2e73238-937c-477c-a6d7-ffe1c9e215a7 Sep 17 22:13:08 devstack sudo[106079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:13:09 devstack sudo[106074]: pam_unix(sudo:session): session closed for user root Sep 17 22:13:09 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-d9c17b17-ef9b-4ea5-9219-5666e6a08fdc tempest-SnapshotDependencyTests-1201330148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a4f03e01-3c2e-410c-b3e8-64ffe04c53c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a4f03e01-3c2e-410c-b3e8-64ffe04c53c3.b2838d90-eda0-40a2-aa9e-f8ca6817b604 1G" returned: 0 in 0.414s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:13:09 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-d9c17b17-ef9b-4ea5-9219-5666e6a08fdc tempest-SnapshotDependencyTests-1201330148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4f03e01-3c2e-410c-b3e8-64ffe04c53c3 -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a4f03e01-3c2e-410c-b3e8-64ffe04c53c3.b2838d90-eda0-40a2-aa9e-f8ca6817b604 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:13:09 devstack sudo[106081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4f03e01-3c2e-410c-b3e8-64ffe04c53c3 -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a4f03e01-3c2e-410c-b3e8-64ffe04c53c3.b2838d90-eda0-40a2-aa9e-f8ca6817b604 Sep 17 22:13:09 devstack sudo[106081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:13:09 devstack sudo[106079]: pam_unix(sudo:session): session closed for user root Sep 17 22:13:09 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-5e3f6df7-a100-40ce-83ca-a4f081d74f41 tempest-ProjectReaderTests-715093400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e2e73238-937c-477c-a6d7-ffe1c9e215a7" returned: 0 in 0.374s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:13:09 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-5e3f6df7-a100-40ce-83ca-a4f081d74f41 tempest-ProjectReaderTests-715093400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e2e73238-937c-477c-a6d7-ffe1c9e215a7 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:13:09 devstack sudo[106088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e2e73238-937c-477c-a6d7-ffe1c9e215a7 Sep 17 22:13:09 devstack sudo[106088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:13:09 devstack sudo[106081]: pam_unix(sudo:session): session closed for user root Sep 17 22:13:09 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-d9c17b17-ef9b-4ea5-9219-5666e6a08fdc tempest-SnapshotDependencyTests-1201330148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4f03e01-3c2e-410c-b3e8-64ffe04c53c3 -F qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a4f03e01-3c2e-410c-b3e8-64ffe04c53c3.b2838d90-eda0-40a2-aa9e-f8ca6817b604" returned: 0 in 0.290s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:13:09 devstack cinder-volume[85458]: WARNING cinder.volume.drivers.remotefs [None req-d9c17b17-ef9b-4ea5-9219-5666e6a08fdc tempest-SnapshotDependencyTests-1201330148 None] /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a4f03e01-3c2e-410c-b3e8-64ffe04c53c3.b2838d90-eda0-40a2-aa9e-f8ca6817b604 is being set with open permissions: ugo+rw Sep 17 22:13:09 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-d9c17b17-ef9b-4ea5-9219-5666e6a08fdc tempest-SnapshotDependencyTests-1201330148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a4f03e01-3c2e-410c-b3e8-64ffe04c53c3.b2838d90-eda0-40a2-aa9e-f8ca6817b604 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:13:09 devstack sudo[106092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a4f03e01-3c2e-410c-b3e8-64ffe04c53c3.b2838d90-eda0-40a2-aa9e-f8ca6817b604 Sep 17 22:13:09 devstack sudo[106092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:13:09 devstack sudo[106088]: pam_unix(sudo:session): session closed for user root Sep 17 22:13:09 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-5e3f6df7-a100-40ce-83ca-a4f081d74f41 tempest-ProjectReaderTests-715093400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-e2e73238-937c-477c-a6d7-ffe1c9e215a7" returned: 0 in 0.259s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:13:09 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-5e3f6df7-a100-40ce-83ca-a4f081d74f41 tempest-ProjectReaderTests-715093400 None] Lock "cinder-quobyte-e2e73238-937c-477c-a6d7-ffe1c9e215a7" released by "delete_volume" :: held 0.672s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:13:09 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-5e3f6df7-a100-40ce-83ca-a4f081d74f41 tempest-ProjectReaderTests-715093400 None] Created reservations ['109328ff-3dba-4234-8591-055703739ac6', '65e09026-16e6-4b91-99e7-2c4c68ec66d9', '6cca1824-661a-4cbc-9f3e-0e2a7993cc4f', '20bb5ee2-1a94-44ac-8026-d4ff16bac532'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:13:09 devstack sudo[106092]: pam_unix(sudo:session): session closed for user root Sep 17 22:13:09 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-d9c17b17-ef9b-4ea5-9219-5666e6a08fdc tempest-SnapshotDependencyTests-1201330148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a4f03e01-3c2e-410c-b3e8-64ffe04c53c3.b2838d90-eda0-40a2-aa9e-f8ca6817b604" returned: 0 in 0.255s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:13:09 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-d9c17b17-ef9b-4ea5-9219-5666e6a08fdc tempest-SnapshotDependencyTests-1201330148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a4f03e01-3c2e-410c-b3e8-64ffe04c53c3.info {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:13:09 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-5e3f6df7-a100-40ce-83ca-a4f081d74f41 tempest-ProjectReaderTests-715093400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:13:09 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-5e3f6df7-a100-40ce-83ca-a4f081d74f41 tempest-ProjectReaderTests-715093400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:13:09 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-5e3f6df7-a100-40ce-83ca-a4f081d74f41 tempest-ProjectReaderTests-715093400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:13:09 devstack sudo[106096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a4f03e01-3c2e-410c-b3e8-64ffe04c53c3.info Sep 17 22:13:09 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-5e3f6df7-a100-40ce-83ca-a4f081d74f41 tempest-ProjectReaderTests-715093400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:13:09 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-5e3f6df7-a100-40ce-83ca-a4f081d74f41 tempest-ProjectReaderTests-715093400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:13:09 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-5e3f6df7-a100-40ce-83ca-a4f081d74f41 tempest-ProjectReaderTests-715093400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:13:09 devstack sudo[106096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:13:09 devstack sudo[106098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:13:09 devstack sudo[106098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:13:09 devstack sudo[106096]: pam_unix(sudo:session): session closed for user root Sep 17 22:13:09 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-d9c17b17-ef9b-4ea5-9219-5666e6a08fdc tempest-SnapshotDependencyTests-1201330148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a4f03e01-3c2e-410c-b3e8-64ffe04c53c3.info" returned: 0 in 0.270s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:13:09 devstack cinder-volume[85458]: WARNING cinder.volume.drivers.remotefs [None req-d9c17b17-ef9b-4ea5-9219-5666e6a08fdc tempest-SnapshotDependencyTests-1201330148 None] /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a4f03e01-3c2e-410c-b3e8-64ffe04c53c3.info is being set with open permissions: ugo+rw Sep 17 22:13:09 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-d9c17b17-ef9b-4ea5-9219-5666e6a08fdc tempest-SnapshotDependencyTests-1201330148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a4f03e01-3c2e-410c-b3e8-64ffe04c53c3.info {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:13:09 devstack sudo[106098]: pam_unix(sudo:session): session closed for user root Sep 17 22:13:09 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-5e3f6df7-a100-40ce-83ca-a4f081d74f41 tempest-ProjectReaderTests-715093400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.264s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:13:09 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-5e3f6df7-a100-40ce-83ca-a4f081d74f41 tempest-ProjectReaderTests-715093400 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:13:09 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-5e3f6df7-a100-40ce-83ca-a4f081d74f41 tempest-ProjectReaderTests-715093400 None] Deleted volume successfully. Sep 17 22:13:09 devstack sudo[106103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a4f03e01-3c2e-410c-b3e8-64ffe04c53c3.info Sep 17 22:13:09 devstack sudo[106103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:13:09 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-5e3f6df7-a100-40ce-83ca-a4f081d74f41 tempest-ProjectReaderTests-715093400 None] Lock "cinder-e2e73238-937c-477c-a6d7-ffe1c9e215a7-delete_volume" released by "delete_volume" :: held 1.161s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:13:10 devstack sudo[106103]: pam_unix(sudo:session): session closed for user root Sep 17 22:13:10 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-d9c17b17-ef9b-4ea5-9219-5666e6a08fdc tempest-SnapshotDependencyTests-1201330148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a4f03e01-3c2e-410c-b3e8-64ffe04c53c3.info" returned: 0 in 0.260s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:13:10 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-d9c17b17-ef9b-4ea5-9219-5666e6a08fdc tempest-SnapshotDependencyTests-1201330148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.969s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:13:10 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-d9c17b17-ef9b-4ea5-9219-5666e6a08fdc tempest-SnapshotDependencyTests-1201330148 None] Create snapshot completed successfully Sep 17 22:13:10 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8ccf2ab-48e8-4820-982a-c4c40600aaa8 tempest-ProjectReaderTests-715093400 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 22:13:10 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-f8ccf2ab-48e8-4820-982a-c4c40600aaa8 tempest-ProjectReaderTests-715093400 None] Flow 'volume_create_manager' (4a762252-cfa7-4e58-89df-cba1385c7a6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:13:10 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-f8ccf2ab-48e8-4820-982a-c4c40600aaa8 tempest-ProjectReaderTests-715093400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e4f64af-aa40-4a4f-a605-e80505450071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:13:10 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-f8ccf2ab-48e8-4820-982a-c4c40600aaa8 tempest-ProjectReaderTests-715093400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e4f64af-aa40-4a4f-a605-e80505450071) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:13:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1850124202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c06fa3d-a179-42fe-a61e-b8c735c570d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6fda5fd4130411ea7bffaf64a96892a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:13:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:13:10Z,use_quota=True,user_id='08c6cc94cbb241aa8ca94ca73202a6c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:13:10 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-f8ccf2ab-48e8-4820-982a-c4c40600aaa8 tempest-ProjectReaderTests-715093400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e39e960-3d8b-457e-afd9-2de491d7c289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:13:10 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-f8ccf2ab-48e8-4820-982a-c4c40600aaa8 tempest-ProjectReaderTests-715093400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e39e960-3d8b-457e-afd9-2de491d7c289) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:13:10 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-f8ccf2ab-48e8-4820-982a-c4c40600aaa8 tempest-ProjectReaderTests-715093400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a62ecc6f-b2fa-4b54-858d-04032a8fd864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:13:10 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-f8ccf2ab-48e8-4820-982a-c4c40600aaa8 tempest-ProjectReaderTests-715093400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a62ecc6f-b2fa-4b54-858d-04032a8fd864) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c06fa3d-a179-42fe-a61e-b8c735c570d1', 'volume_name': 'volume-7c06fa3d-a179-42fe-a61e-b8c735c570d1', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:13:10 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-f8ccf2ab-48e8-4820-982a-c4c40600aaa8 tempest-ProjectReaderTests-715093400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb50ba92-f388-48bc-a5db-6111e68bf890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:13:10 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-f8ccf2ab-48e8-4820-982a-c4c40600aaa8 tempest-ProjectReaderTests-715093400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb50ba92-f388-48bc-a5db-6111e68bf890) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:13:10 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-f8ccf2ab-48e8-4820-982a-c4c40600aaa8 tempest-ProjectReaderTests-715093400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e5abcda-3439-4006-96c0-2d3146a5fb39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:13:10 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-f8ccf2ab-48e8-4820-982a-c4c40600aaa8 tempest-ProjectReaderTests-715093400 None] Volume 7c06fa3d-a179-42fe-a61e-b8c735c570d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c06fa3d-a179-42fe-a61e-b8c735c570d1', 'volume_size': 1} Sep 17 22:13:10 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-f8ccf2ab-48e8-4820-982a-c4c40600aaa8 tempest-ProjectReaderTests-715093400 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:13:10 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-f8ccf2ab-48e8-4820-982a-c4c40600aaa8 tempest-ProjectReaderTests-715093400 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:13:10 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-f8ccf2ab-48e8-4820-982a-c4c40600aaa8 tempest-ProjectReaderTests-715093400 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:13:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1850124202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c06fa3d-a179-42fe-a61e-b8c735c570d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6fda5fd4130411ea7bffaf64a96892a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:13:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:13:10Z,use_quota=True,user_id='08c6cc94cbb241aa8ca94ca73202a6c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 22:13:10 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-f8ccf2ab-48e8-4820-982a-c4c40600aaa8 tempest-ProjectReaderTests-715093400 None] Creating volume 7c06fa3d-a179-42fe-a61e-b8c735c570d1 {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 22:13:10 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-f8ccf2ab-48e8-4820-982a-c4c40600aaa8 tempest-ProjectReaderTests-715093400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:13:10 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-f8ccf2ab-48e8-4820-982a-c4c40600aaa8 tempest-ProjectReaderTests-715093400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:13:10 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-f8ccf2ab-48e8-4820-982a-c4c40600aaa8 tempest-ProjectReaderTests-715093400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:13:10 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-f8ccf2ab-48e8-4820-982a-c4c40600aaa8 tempest-ProjectReaderTests-715093400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:13:10 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-f8ccf2ab-48e8-4820-982a-c4c40600aaa8 tempest-ProjectReaderTests-715093400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:13:10 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-f8ccf2ab-48e8-4820-982a-c4c40600aaa8 tempest-ProjectReaderTests-715093400 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 22:13:10 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-f8ccf2ab-48e8-4820-982a-c4c40600aaa8 tempest-ProjectReaderTests-715093400 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 22:13:10 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-f8ccf2ab-48e8-4820-982a-c4c40600aaa8 tempest-ProjectReaderTests-715093400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7c06fa3d-a179-42fe-a61e-b8c735c570d1 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:13:10 devstack sudo[106106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7c06fa3d-a179-42fe-a61e-b8c735c570d1 1073741824 Sep 17 22:13:10 devstack sudo[106106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:13:10 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-e278c999-76e1-4b93-bec7-31c76d75363c tempest-SnapshotDependencyTests-1201330148 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 22:13:10 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e278c999-76e1-4b93-bec7-31c76d75363c tempest-SnapshotDependencyTests-1201330148 None] Flow 'volume_create_manager' (f920bb3f-6511-4bbf-9dbf-c0ea408aee18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:13:10 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e278c999-76e1-4b93-bec7-31c76d75363c tempest-SnapshotDependencyTests-1201330148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07d058ca-3030-4d76-a95e-28318fade54e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:13:10 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e278c999-76e1-4b93-bec7-31c76d75363c tempest-SnapshotDependencyTests-1201330148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07d058ca-3030-4d76-a95e-28318fade54e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:13:11Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=031ab592-5f96-4746-95a3-729c8b630b58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ea4984cfb0d4fdf834cc976bbd65e76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:13:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b2838d90-eda0-40a2-aa9e-f8ca6817b604,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:13:11Z,use_quota=True,user_id='d10ce406e4084b949c1dc71e99812580',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:13:10 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e278c999-76e1-4b93-bec7-31c76d75363c tempest-SnapshotDependencyTests-1201330148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46eec007-599d-4718-8847-e85cdd70419b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:13:10 devstack sudo[106106]: pam_unix(sudo:session): session closed for user root Sep 17 22:13:10 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e278c999-76e1-4b93-bec7-31c76d75363c tempest-SnapshotDependencyTests-1201330148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46eec007-599d-4718-8847-e85cdd70419b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:13:10 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e278c999-76e1-4b93-bec7-31c76d75363c tempest-SnapshotDependencyTests-1201330148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ae44d79-7eab-4c36-b83f-9b7d604f6c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:13:10 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e278c999-76e1-4b93-bec7-31c76d75363c tempest-SnapshotDependencyTests-1201330148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ae44d79-7eab-4c36-b83f-9b7d604f6c12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '031ab592-5f96-4746-95a3-729c8b630b58', 'volume_name': 'volume-031ab592-5f96-4746-95a3-729c8b630b58', 'volume_size': 1, 'snapshot_id': 'b2838d90-eda0-40a2-aa9e-f8ca6817b604'}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:13:10 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e278c999-76e1-4b93-bec7-31c76d75363c tempest-SnapshotDependencyTests-1201330148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ab96435-b60a-4fa2-811a-4cb63f5ef2c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:13:10 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e278c999-76e1-4b93-bec7-31c76d75363c tempest-SnapshotDependencyTests-1201330148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ab96435-b60a-4fa2-811a-4cb63f5ef2c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:13:10 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e278c999-76e1-4b93-bec7-31c76d75363c tempest-SnapshotDependencyTests-1201330148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e111eebc-5611-413c-beef-8051857dfc11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:13:10 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-e278c999-76e1-4b93-bec7-31c76d75363c tempest-SnapshotDependencyTests-1201330148 None] Volume 031ab592-5f96-4746-95a3-729c8b630b58: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-031ab592-5f96-4746-95a3-729c8b630b58', 'volume_size': 1, 'snapshot_id': 'b2838d90-eda0-40a2-aa9e-f8ca6817b604'} Sep 17 22:13:10 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-f8ccf2ab-48e8-4820-982a-c4c40600aaa8 tempest-ProjectReaderTests-715093400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7c06fa3d-a179-42fe-a61e-b8c735c570d1 1073741824" returned: 0 in 0.514s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:13:10 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e278c999-76e1-4b93-bec7-31c76d75363c tempest-SnapshotDependencyTests-1201330148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:13:11 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-f8ccf2ab-48e8-4820-982a-c4c40600aaa8 tempest-ProjectReaderTests-715093400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7c06fa3d-a179-42fe-a61e-b8c735c570d1 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:13:11 devstack sudo[106112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7c06fa3d-a179-42fe-a61e-b8c735c570d1 Sep 17 22:13:11 devstack sudo[106112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:13:11 devstack sudo[106112]: pam_unix(sudo:session): session closed for user root Sep 17 22:13:11 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-f8ccf2ab-48e8-4820-982a-c4c40600aaa8 tempest-ProjectReaderTests-715093400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7c06fa3d-a179-42fe-a61e-b8c735c570d1" returned: 0 in 0.244s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:13:11 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-f8ccf2ab-48e8-4820-982a-c4c40600aaa8 tempest-ProjectReaderTests-715093400 None] <== create_volume: return (800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 22:13:11 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-f8ccf2ab-48e8-4820-982a-c4c40600aaa8 tempest-ProjectReaderTests-715093400 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.802s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:13:11 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e278c999-76e1-4b93-bec7-31c76d75363c tempest-SnapshotDependencyTests-1201330148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.272s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:13:11 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-e278c999-76e1-4b93-bec7-31c76d75363c tempest-SnapshotDependencyTests-1201330148 None] Acquiring lock "cinder-quobyte-b2838d90-eda0-40a2-aa9e-f8ca6817b604-031ab592-5f96-4746-95a3-729c8b630b58" by "_create_volume_from_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:13:11 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-f8ccf2ab-48e8-4820-982a-c4c40600aaa8 tempest-ProjectReaderTests-715093400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e5abcda-3439-4006-96c0-2d3146a5fb39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c06fa3d-a179-42fe-a61e-b8c735c570d1', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:13:11 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-f8ccf2ab-48e8-4820-982a-c4c40600aaa8 tempest-ProjectReaderTests-715093400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71924d72-a6a2-4d2a-b5a2-ea1b65940beb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:13:11 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-e278c999-76e1-4b93-bec7-31c76d75363c tempest-SnapshotDependencyTests-1201330148 None] Lock "cinder-quobyte-b2838d90-eda0-40a2-aa9e-f8ca6817b604-031ab592-5f96-4746-95a3-729c8b630b58" acquired by "_create_volume_from_snapshot" :: waited 0.029s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:13:11 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-e278c999-76e1-4b93-bec7-31c76d75363c tempest-SnapshotDependencyTests-1201330148 None] Creating volume 031ab592-5f96-4746-95a3-729c8b630b58 from snapshot b2838d90-eda0-40a2-aa9e-f8ca6817b604 {{(pid=85458) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 17 22:13:11 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e278c999-76e1-4b93-bec7-31c76d75363c tempest-SnapshotDependencyTests-1201330148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:13:11 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e278c999-76e1-4b93-bec7-31c76d75363c tempest-SnapshotDependencyTests-1201330148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:13:11 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-e278c999-76e1-4b93-bec7-31c76d75363c tempest-SnapshotDependencyTests-1201330148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:13:11 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-e278c999-76e1-4b93-bec7-31c76d75363c tempest-SnapshotDependencyTests-1201330148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:13:11 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e278c999-76e1-4b93-bec7-31c76d75363c tempest-SnapshotDependencyTests-1201330148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:13:11 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-e278c999-76e1-4b93-bec7-31c76d75363c tempest-SnapshotDependencyTests-1201330148 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 22:13:11 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-e278c999-76e1-4b93-bec7-31c76d75363c tempest-SnapshotDependencyTests-1201330148 None] Acquiring lock "cinder-quobyte-031ab592-5f96-4746-95a3-729c8b630b58" by "_copy_volume_from_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:13:11 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-e278c999-76e1-4b93-bec7-31c76d75363c tempest-SnapshotDependencyTests-1201330148 None] Lock "cinder-quobyte-031ab592-5f96-4746-95a3-729c8b630b58" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:13:11 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-e278c999-76e1-4b93-bec7-31c76d75363c tempest-SnapshotDependencyTests-1201330148 None] snapshot: b2838d90-eda0-40a2-aa9e-f8ca6817b604, volume: 031ab592-5f96-4746-95a3-729c8b630b58, {{(pid=85458) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 17 22:13:11 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-f8ccf2ab-48e8-4820-982a-c4c40600aaa8 tempest-ProjectReaderTests-715093400 None] Volume volume-7c06fa3d-a179-42fe-a61e-b8c735c570d1 (7c06fa3d-a179-42fe-a61e-b8c735c570d1): created successfully Sep 17 22:13:11 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-f8ccf2ab-48e8-4820-982a-c4c40600aaa8 tempest-ProjectReaderTests-715093400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71924d72-a6a2-4d2a-b5a2-ea1b65940beb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:13:11 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-f8ccf2ab-48e8-4820-982a-c4c40600aaa8 tempest-ProjectReaderTests-715093400 None] Flow 'volume_create_manager' (4a762252-cfa7-4e58-89df-cba1385c7a6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:13:11 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-f8ccf2ab-48e8-4820-982a-c4c40600aaa8 tempest-ProjectReaderTests-715093400 None] Created volume successfully. Sep 17 22:13:11 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e278c999-76e1-4b93-bec7-31c76d75363c tempest-SnapshotDependencyTests-1201330148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:13:11 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e278c999-76e1-4b93-bec7-31c76d75363c tempest-SnapshotDependencyTests-1201330148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:13:11 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-e278c999-76e1-4b93-bec7-31c76d75363c tempest-SnapshotDependencyTests-1201330148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:13:11 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-e278c999-76e1-4b93-bec7-31c76d75363c tempest-SnapshotDependencyTests-1201330148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:13:11 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e278c999-76e1-4b93-bec7-31c76d75363c tempest-SnapshotDependencyTests-1201330148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:13:11 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cd61e54-4e81-40f8-9888-fdcbe711ecfe]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:13:11 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e278c999-76e1-4b93-bec7-31c76d75363c tempest-SnapshotDependencyTests-1201330148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a4f03e01-3c2e-410c-b3e8-64ffe04c53c3.b2838d90-eda0-40a2-aa9e-f8ca6817b604 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:13:11 devstack sudo[106115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a4f03e01-3c2e-410c-b3e8-64ffe04c53c3.b2838d90-eda0-40a2-aa9e-f8ca6817b604 Sep 17 22:13:11 devstack sudo[106115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:13:11 devstack sudo[106115]: pam_unix(sudo:session): session closed for user root Sep 17 22:13:11 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e278c999-76e1-4b93-bec7-31c76d75363c tempest-SnapshotDependencyTests-1201330148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a4f03e01-3c2e-410c-b3e8-64ffe04c53c3.b2838d90-eda0-40a2-aa9e-f8ca6817b604" returned: 0 in 0.351s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:13:11 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-e278c999-76e1-4b93-bec7-31c76d75363c tempest-SnapshotDependencyTests-1201330148 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a4f03e01-3c2e-410c-b3e8-64ffe04c53c3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85458) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 22:13:11 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[be554aae-ce8f-45d6-8f29-45fd8c75ed92]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:13:11 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e278c999-76e1-4b93-bec7-31c76d75363c tempest-SnapshotDependencyTests-1201330148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a4f03e01-3c2e-410c-b3e8-64ffe04c53c3 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:13:11 devstack sudo[106120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a4f03e01-3c2e-410c-b3e8-64ffe04c53c3 Sep 17 22:13:11 devstack sudo[106120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:13:12 devstack sudo[106120]: pam_unix(sudo:session): session closed for user root Sep 17 22:13:12 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e278c999-76e1-4b93-bec7-31c76d75363c tempest-SnapshotDependencyTests-1201330148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a4f03e01-3c2e-410c-b3e8-64ffe04c53c3" returned: 0 in 0.347s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:13:12 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-e278c999-76e1-4b93-bec7-31c76d75363c tempest-SnapshotDependencyTests-1201330148 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a4f03e01-3c2e-410c-b3e8-64ffe04c53c3 {{(pid=85458) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 17 22:13:12 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-e278c999-76e1-4b93-bec7-31c76d75363c tempest-SnapshotDependencyTests-1201330148 None] Creating direct copy from snapshot {{(pid=85458) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 17 22:13:12 devstack cinder-volume[85458]: DEBUG cinder.utils [None req-e278c999-76e1-4b93-bec7-31c76d75363c tempest-SnapshotDependencyTests-1201330148 None] Path /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031ab592-5f96-4746-95a3-729c8b630b58 not found in is_blk_device check {{(pid=85458) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 17 22:13:12 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e278c999-76e1-4b93-bec7-31c76d75363c tempest-SnapshotDependencyTests-1201330148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a4f03e01-3c2e-410c-b3e8-64ffe04c53c3 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031ab592-5f96-4746-95a3-729c8b630b58 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:13:12 devstack sudo[106125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a4f03e01-3c2e-410c-b3e8-64ffe04c53c3 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031ab592-5f96-4746-95a3-729c8b630b58 Sep 17 22:13:12 devstack sudo[106125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:13:12 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-3ac1ee9e-61c9-4343-9fd2-4fb386db32c6 tempest-ProjectReaderTests-715093400 None] Acquiring lock "cinder-7c06fa3d-a179-42fe-a61e-b8c735c570d1-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:13:12 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-3ac1ee9e-61c9-4343-9fd2-4fb386db32c6 tempest-ProjectReaderTests-715093400 None] Lock "cinder-7c06fa3d-a179-42fe-a61e-b8c735c570d1-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:13:12 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-3ac1ee9e-61c9-4343-9fd2-4fb386db32c6 tempest-ProjectReaderTests-715093400 None] Acquiring lock "cinder-quobyte-7c06fa3d-a179-42fe-a61e-b8c735c570d1" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:13:12 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-3ac1ee9e-61c9-4343-9fd2-4fb386db32c6 tempest-ProjectReaderTests-715093400 None] Lock "cinder-quobyte-7c06fa3d-a179-42fe-a61e-b8c735c570d1" acquired by "delete_volume" :: waited 0.031s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:13:12 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[498b38a9-42f5-4eae-af42-cd22aa6f1b25]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:13:12 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-3ac1ee9e-61c9-4343-9fd2-4fb386db32c6 tempest-ProjectReaderTests-715093400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7c06fa3d-a179-42fe-a61e-b8c735c570d1 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:13:12 devstack sudo[106137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7c06fa3d-a179-42fe-a61e-b8c735c570d1 Sep 17 22:13:12 devstack sudo[106137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:13:13 devstack sudo[106137]: pam_unix(sudo:session): session closed for user root Sep 17 22:13:13 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-3ac1ee9e-61c9-4343-9fd2-4fb386db32c6 tempest-ProjectReaderTests-715093400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7c06fa3d-a179-42fe-a61e-b8c735c570d1" returned: 0 in 0.736s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:13:13 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-3ac1ee9e-61c9-4343-9fd2-4fb386db32c6 tempest-ProjectReaderTests-715093400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7c06fa3d-a179-42fe-a61e-b8c735c570d1 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:13:13 devstack sudo[106144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7c06fa3d-a179-42fe-a61e-b8c735c570d1 Sep 17 22:13:13 devstack sudo[106144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:13:13 devstack sudo[106144]: pam_unix(sudo:session): session closed for user root Sep 17 22:13:13 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-3ac1ee9e-61c9-4343-9fd2-4fb386db32c6 tempest-ProjectReaderTests-715093400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-7c06fa3d-a179-42fe-a61e-b8c735c570d1" returned: 0 in 0.357s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:13:13 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-3ac1ee9e-61c9-4343-9fd2-4fb386db32c6 tempest-ProjectReaderTests-715093400 None] Lock "cinder-quobyte-7c06fa3d-a179-42fe-a61e-b8c735c570d1" released by "delete_volume" :: held 1.177s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:13:13 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-3ac1ee9e-61c9-4343-9fd2-4fb386db32c6 tempest-ProjectReaderTests-715093400 None] Created reservations ['457df8a6-45a2-455c-ba62-e4c4c254bb83', '43bbcaf5-93bc-4d9c-bcc1-92f35df325db', 'dba30f13-be5b-488e-a3b9-aac84392b5f9', '21ec282d-a884-485b-897e-03786d0677ba'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:13:14 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-3ac1ee9e-61c9-4343-9fd2-4fb386db32c6 tempest-ProjectReaderTests-715093400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:13:14 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-3ac1ee9e-61c9-4343-9fd2-4fb386db32c6 tempest-ProjectReaderTests-715093400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:13:14 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-3ac1ee9e-61c9-4343-9fd2-4fb386db32c6 tempest-ProjectReaderTests-715093400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:13:14 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-3ac1ee9e-61c9-4343-9fd2-4fb386db32c6 tempest-ProjectReaderTests-715093400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:13:14 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-3ac1ee9e-61c9-4343-9fd2-4fb386db32c6 tempest-ProjectReaderTests-715093400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:13:14 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-3ac1ee9e-61c9-4343-9fd2-4fb386db32c6 tempest-ProjectReaderTests-715093400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:13:14 devstack sudo[106147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:13:14 devstack sudo[106147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:13:14 devstack sudo[106147]: pam_unix(sudo:session): session closed for user root Sep 17 22:13:14 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-3ac1ee9e-61c9-4343-9fd2-4fb386db32c6 tempest-ProjectReaderTests-715093400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.277s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:13:14 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-3ac1ee9e-61c9-4343-9fd2-4fb386db32c6 tempest-ProjectReaderTests-715093400 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:13:14 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-3ac1ee9e-61c9-4343-9fd2-4fb386db32c6 tempest-ProjectReaderTests-715093400 None] Deleted volume successfully. Sep 17 22:13:14 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-3ac1ee9e-61c9-4343-9fd2-4fb386db32c6 tempest-ProjectReaderTests-715093400 None] Lock "cinder-7c06fa3d-a179-42fe-a61e-b8c735c570d1-delete_volume" released by "delete_volume" :: held 1.816s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:13:15 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-10003f3a-d1fc-4c4d-871c-88fc89e10fa3 tempest-ProjectReaderTests-715093400 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 22:13:15 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-10003f3a-d1fc-4c4d-871c-88fc89e10fa3 tempest-ProjectReaderTests-715093400 None] Flow 'volume_create_manager' (d06bc82c-4dd1-4e1d-87fc-88d4d21b3344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:13:15 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-10003f3a-d1fc-4c4d-871c-88fc89e10fa3 tempest-ProjectReaderTests-715093400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6ae2637-ea84-4b55-afb8-aefdcbd0a768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:13:15 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-10003f3a-d1fc-4c4d-871c-88fc89e10fa3 tempest-ProjectReaderTests-715093400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6ae2637-ea84-4b55-afb8-aefdcbd0a768) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:13:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1952149756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eea22a7c-fc55-49f8-8b15-5aa5cf46251c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6fda5fd4130411ea7bffaf64a96892a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:13:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:13:16Z,use_quota=True,user_id='08c6cc94cbb241aa8ca94ca73202a6c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:13:15 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-10003f3a-d1fc-4c4d-871c-88fc89e10fa3 tempest-ProjectReaderTests-715093400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14f4c3df-7a4a-47e5-b5a5-67f1fd4bee3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:13:15 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-10003f3a-d1fc-4c4d-871c-88fc89e10fa3 tempest-ProjectReaderTests-715093400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14f4c3df-7a4a-47e5-b5a5-67f1fd4bee3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:13:15 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-10003f3a-d1fc-4c4d-871c-88fc89e10fa3 tempest-ProjectReaderTests-715093400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e4a3af0-a7b5-448c-8308-3a82b09209a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:13:15 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-10003f3a-d1fc-4c4d-871c-88fc89e10fa3 tempest-ProjectReaderTests-715093400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e4a3af0-a7b5-448c-8308-3a82b09209a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eea22a7c-fc55-49f8-8b15-5aa5cf46251c', 'volume_name': 'volume-eea22a7c-fc55-49f8-8b15-5aa5cf46251c', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:13:15 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-10003f3a-d1fc-4c4d-871c-88fc89e10fa3 tempest-ProjectReaderTests-715093400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fce3bdb0-45b6-4f5b-9386-e0a580ddac62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:13:15 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-10003f3a-d1fc-4c4d-871c-88fc89e10fa3 tempest-ProjectReaderTests-715093400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fce3bdb0-45b6-4f5b-9386-e0a580ddac62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:13:15 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-10003f3a-d1fc-4c4d-871c-88fc89e10fa3 tempest-ProjectReaderTests-715093400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (437c146c-f709-4de2-a968-194e1e52ca40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:13:15 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-10003f3a-d1fc-4c4d-871c-88fc89e10fa3 tempest-ProjectReaderTests-715093400 None] Volume eea22a7c-fc55-49f8-8b15-5aa5cf46251c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eea22a7c-fc55-49f8-8b15-5aa5cf46251c', 'volume_size': 1} Sep 17 22:13:15 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-10003f3a-d1fc-4c4d-871c-88fc89e10fa3 tempest-ProjectReaderTests-715093400 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:13:18 devstack sudo[106125]: pam_unix(sudo:session): session closed for user root Sep 17 22:13:18 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e278c999-76e1-4b93-bec7-31c76d75363c tempest-SnapshotDependencyTests-1201330148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a4f03e01-3c2e-410c-b3e8-64ffe04c53c3 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031ab592-5f96-4746-95a3-729c8b630b58" returned: 0 in 6.253s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:13:18 devstack cinder-volume[85458]: DEBUG cinder.image.image_utils [None req-e278c999-76e1-4b93-bec7-31c76d75363c tempest-SnapshotDependencyTests-1201330148 None] Image conversion details: src /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a4f03e01-3c2e-410c-b3e8-64ffe04c53c3, size 1024.00 MB, duration 6.25 sec, destination /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031ab592-5f96-4746-95a3-729c8b630b58 {{(pid=85458) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 17 22:13:18 devstack cinder-volume[85458]: INFO cinder.image.image_utils [None req-e278c999-76e1-4b93-bec7-31c76d75363c tempest-SnapshotDependencyTests-1201330148 None] Converted 1024.00 MB image at 163.73 MB/s Sep 17 22:13:18 devstack cinder-volume[85458]: WARNING cinder.volume.drivers.remotefs [None req-e278c999-76e1-4b93-bec7-31c76d75363c tempest-SnapshotDependencyTests-1201330148 None] /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031ab592-5f96-4746-95a3-729c8b630b58 is being set with open permissions: ugo+rw Sep 17 22:13:18 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e278c999-76e1-4b93-bec7-31c76d75363c tempest-SnapshotDependencyTests-1201330148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031ab592-5f96-4746-95a3-729c8b630b58 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:13:18 devstack sudo[106151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031ab592-5f96-4746-95a3-729c8b630b58 Sep 17 22:13:18 devstack sudo[106151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:13:18 devstack sudo[106151]: pam_unix(sudo:session): session closed for user root Sep 17 22:13:18 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e278c999-76e1-4b93-bec7-31c76d75363c tempest-SnapshotDependencyTests-1201330148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031ab592-5f96-4746-95a3-729c8b630b58" returned: 0 in 0.234s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:13:18 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-e278c999-76e1-4b93-bec7-31c76d75363c tempest-SnapshotDependencyTests-1201330148 None] Lock "cinder-quobyte-031ab592-5f96-4746-95a3-729c8b630b58" released by "_copy_volume_from_snapshot" :: held 7.319s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:13:18 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-e278c999-76e1-4b93-bec7-31c76d75363c tempest-SnapshotDependencyTests-1201330148 None] Lock "cinder-quobyte-b2838d90-eda0-40a2-aa9e-f8ca6817b604-031ab592-5f96-4746-95a3-729c8b630b58" released by "_create_volume_from_snapshot" :: held 7.384s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:13:18 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e278c999-76e1-4b93-bec7-31c76d75363c tempest-SnapshotDependencyTests-1201330148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.414s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:13:18 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-10003f3a-d1fc-4c4d-871c-88fc89e10fa3 tempest-ProjectReaderTests-715093400 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.808s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:13:18 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-10003f3a-d1fc-4c4d-871c-88fc89e10fa3 tempest-ProjectReaderTests-715093400 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:13:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1952149756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eea22a7c-fc55-49f8-8b15-5aa5cf46251c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6fda5fd4130411ea7bffaf64a96892a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:13:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:13:16Z,use_quota=True,user_id='08c6cc94cbb241aa8ca94ca73202a6c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 22:13:18 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-10003f3a-d1fc-4c4d-871c-88fc89e10fa3 tempest-ProjectReaderTests-715093400 None] Creating volume eea22a7c-fc55-49f8-8b15-5aa5cf46251c {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 22:13:18 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-10003f3a-d1fc-4c4d-871c-88fc89e10fa3 tempest-ProjectReaderTests-715093400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:13:18 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-10003f3a-d1fc-4c4d-871c-88fc89e10fa3 tempest-ProjectReaderTests-715093400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:13:18 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-10003f3a-d1fc-4c4d-871c-88fc89e10fa3 tempest-ProjectReaderTests-715093400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:13:18 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-10003f3a-d1fc-4c4d-871c-88fc89e10fa3 tempest-ProjectReaderTests-715093400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:13:18 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-10003f3a-d1fc-4c4d-871c-88fc89e10fa3 tempest-ProjectReaderTests-715093400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:13:18 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-10003f3a-d1fc-4c4d-871c-88fc89e10fa3 tempest-ProjectReaderTests-715093400 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 22:13:18 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-10003f3a-d1fc-4c4d-871c-88fc89e10fa3 tempest-ProjectReaderTests-715093400 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 22:13:18 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-10003f3a-d1fc-4c4d-871c-88fc89e10fa3 tempest-ProjectReaderTests-715093400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-eea22a7c-fc55-49f8-8b15-5aa5cf46251c 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:13:18 devstack sudo[106154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-eea22a7c-fc55-49f8-8b15-5aa5cf46251c 1073741824 Sep 17 22:13:18 devstack sudo[106154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:13:18 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e278c999-76e1-4b93-bec7-31c76d75363c tempest-SnapshotDependencyTests-1201330148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e111eebc-5611-413c-beef-8051857dfc11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-031ab592-5f96-4746-95a3-729c8b630b58', 'volume_size': 1, 'snapshot_id': 'b2838d90-eda0-40a2-aa9e-f8ca6817b604'}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:13:18 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e278c999-76e1-4b93-bec7-31c76d75363c tempest-SnapshotDependencyTests-1201330148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7aba26af-a7cd-4898-bb99-c9fe95a71766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:13:18 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-e278c999-76e1-4b93-bec7-31c76d75363c tempest-SnapshotDependencyTests-1201330148 None] Volume volume-031ab592-5f96-4746-95a3-729c8b630b58 (031ab592-5f96-4746-95a3-729c8b630b58): created successfully Sep 17 22:13:18 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e278c999-76e1-4b93-bec7-31c76d75363c tempest-SnapshotDependencyTests-1201330148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7aba26af-a7cd-4898-bb99-c9fe95a71766) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:13:18 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e278c999-76e1-4b93-bec7-31c76d75363c tempest-SnapshotDependencyTests-1201330148 None] Flow 'volume_create_manager' (f920bb3f-6511-4bbf-9dbf-c0ea408aee18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:13:18 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-e278c999-76e1-4b93-bec7-31c76d75363c tempest-SnapshotDependencyTests-1201330148 None] Created volume successfully. Sep 17 22:13:19 devstack sudo[106154]: pam_unix(sudo:session): session closed for user root Sep 17 22:13:19 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-10003f3a-d1fc-4c4d-871c-88fc89e10fa3 tempest-ProjectReaderTests-715093400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-eea22a7c-fc55-49f8-8b15-5aa5cf46251c 1073741824" returned: 0 in 0.404s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:13:19 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-10003f3a-d1fc-4c4d-871c-88fc89e10fa3 tempest-ProjectReaderTests-715093400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-eea22a7c-fc55-49f8-8b15-5aa5cf46251c {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:13:19 devstack sudo[106160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-eea22a7c-fc55-49f8-8b15-5aa5cf46251c Sep 17 22:13:19 devstack sudo[106160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:13:19 devstack sudo[106160]: pam_unix(sudo:session): session closed for user root Sep 17 22:13:19 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-10003f3a-d1fc-4c4d-871c-88fc89e10fa3 tempest-ProjectReaderTests-715093400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-eea22a7c-fc55-49f8-8b15-5aa5cf46251c" returned: 0 in 0.236s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:13:19 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-10003f3a-d1fc-4c4d-871c-88fc89e10fa3 tempest-ProjectReaderTests-715093400 None] <== create_volume: return (680ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 22:13:19 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-10003f3a-d1fc-4c4d-871c-88fc89e10fa3 tempest-ProjectReaderTests-715093400 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.683s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:13:19 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-10003f3a-d1fc-4c4d-871c-88fc89e10fa3 tempest-ProjectReaderTests-715093400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (437c146c-f709-4de2-a968-194e1e52ca40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eea22a7c-fc55-49f8-8b15-5aa5cf46251c', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:13:19 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-10003f3a-d1fc-4c4d-871c-88fc89e10fa3 tempest-ProjectReaderTests-715093400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8b1b49c-b64b-442b-8fab-fab1fe446aaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:13:19 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-10003f3a-d1fc-4c4d-871c-88fc89e10fa3 tempest-ProjectReaderTests-715093400 None] Volume volume-eea22a7c-fc55-49f8-8b15-5aa5cf46251c (eea22a7c-fc55-49f8-8b15-5aa5cf46251c): created successfully Sep 17 22:13:19 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-10003f3a-d1fc-4c4d-871c-88fc89e10fa3 tempest-ProjectReaderTests-715093400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8b1b49c-b64b-442b-8fab-fab1fe446aaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:13:19 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-10003f3a-d1fc-4c4d-871c-88fc89e10fa3 tempest-ProjectReaderTests-715093400 None] Flow 'volume_create_manager' (d06bc82c-4dd1-4e1d-87fc-88d4d21b3344) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:13:19 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-10003f3a-d1fc-4c4d-871c-88fc89e10fa3 tempest-ProjectReaderTests-715093400 None] Created volume successfully. Sep 17 22:13:19 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-50b8cb6f-b1ec-4f43-8e23-989f80e52e49 tempest-SnapshotDependencyTests-1201330148 None] Acquiring lock "cinder-b2838d90-eda0-40a2-aa9e-f8ca6817b604-delete_snapshot" by "delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:13:19 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-50b8cb6f-b1ec-4f43-8e23-989f80e52e49 tempest-SnapshotDependencyTests-1201330148 None] Lock "cinder-b2838d90-eda0-40a2-aa9e-f8ca6817b604-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:13:19 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-50b8cb6f-b1ec-4f43-8e23-989f80e52e49 tempest-SnapshotDependencyTests-1201330148 None] Acquiring lock "cinder-quobyte-a4f03e01-3c2e-410c-b3e8-64ffe04c53c3" by "delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:13:19 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-50b8cb6f-b1ec-4f43-8e23-989f80e52e49 tempest-SnapshotDependencyTests-1201330148 None] Lock "cinder-quobyte-a4f03e01-3c2e-410c-b3e8-64ffe04c53c3" acquired by "delete_snapshot" :: waited 0.014s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:13:19 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-50b8cb6f-b1ec-4f43-8e23-989f80e52e49 tempest-SnapshotDependencyTests-1201330148 None] Acquiring lock "cinder-quobyte-b2838d90-eda0-40a2-aa9e-f8ca6817b604" by "_delete_snapshot" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:13:19 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-50b8cb6f-b1ec-4f43-8e23-989f80e52e49 tempest-SnapshotDependencyTests-1201330148 None] Lock "cinder-quobyte-b2838d90-eda0-40a2-aa9e-f8ca6817b604" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:13:19 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-50b8cb6f-b1ec-4f43-8e23-989f80e52e49 tempest-SnapshotDependencyTests-1201330148 None] Deleting offline snapshot b2838d90-eda0-40a2-aa9e-f8ca6817b604 of volume a4f03e01-3c2e-410c-b3e8-64ffe04c53c3 {{(pid=85458) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 22:13:19 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-50b8cb6f-b1ec-4f43-8e23-989f80e52e49 tempest-SnapshotDependencyTests-1201330148 None] snapshot_file for this snap is: volume-a4f03e01-3c2e-410c-b3e8-64ffe04c53c3.b2838d90-eda0-40a2-aa9e-f8ca6817b604 {{(pid=85458) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 22:13:19 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d24f4b7-6adf-4d5c-9edc-b198b11a78e7]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:13:19 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-50b8cb6f-b1ec-4f43-8e23-989f80e52e49 tempest-SnapshotDependencyTests-1201330148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a4f03e01-3c2e-410c-b3e8-64ffe04c53c3.b2838d90-eda0-40a2-aa9e-f8ca6817b604 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:13:19 devstack sudo[106164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a4f03e01-3c2e-410c-b3e8-64ffe04c53c3.b2838d90-eda0-40a2-aa9e-f8ca6817b604 Sep 17 22:13:19 devstack sudo[106164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:13:20 devstack sudo[106164]: pam_unix(sudo:session): session closed for user root Sep 17 22:13:20 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-50b8cb6f-b1ec-4f43-8e23-989f80e52e49 tempest-SnapshotDependencyTests-1201330148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a4f03e01-3c2e-410c-b3e8-64ffe04c53c3.b2838d90-eda0-40a2-aa9e-f8ca6817b604" returned: 0 in 0.365s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:13:20 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-50b8cb6f-b1ec-4f43-8e23-989f80e52e49 tempest-SnapshotDependencyTests-1201330148 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a4f03e01-3c2e-410c-b3e8-64ffe04c53c3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85458) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 22:13:20 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-18270a81-4852-4984-a3db-2b1020cc1f3d tempest-ProjectReaderTests-715093400 None] Acquiring lock "cinder-eea22a7c-fc55-49f8-8b15-5aa5cf46251c-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:13:20 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff77011b-a7eb-491e-8aad-c372d2b1eccb]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:13:20 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-50b8cb6f-b1ec-4f43-8e23-989f80e52e49 tempest-SnapshotDependencyTests-1201330148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a4f03e01-3c2e-410c-b3e8-64ffe04c53c3 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:13:20 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-18270a81-4852-4984-a3db-2b1020cc1f3d tempest-ProjectReaderTests-715093400 None] Lock "cinder-eea22a7c-fc55-49f8-8b15-5aa5cf46251c-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:13:20 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-18270a81-4852-4984-a3db-2b1020cc1f3d tempest-ProjectReaderTests-715093400 None] Acquiring lock "cinder-quobyte-eea22a7c-fc55-49f8-8b15-5aa5cf46251c" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:13:20 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-18270a81-4852-4984-a3db-2b1020cc1f3d tempest-ProjectReaderTests-715093400 None] Lock "cinder-quobyte-eea22a7c-fc55-49f8-8b15-5aa5cf46251c" acquired by "delete_volume" :: waited 0.018s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:13:20 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[650fb27e-920b-4f47-b114-e152024c09d0]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:13:20 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-18270a81-4852-4984-a3db-2b1020cc1f3d tempest-ProjectReaderTests-715093400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-eea22a7c-fc55-49f8-8b15-5aa5cf46251c {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:13:20 devstack sudo[106169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a4f03e01-3c2e-410c-b3e8-64ffe04c53c3 Sep 17 22:13:20 devstack sudo[106169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:13:20 devstack sudo[106170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-eea22a7c-fc55-49f8-8b15-5aa5cf46251c Sep 17 22:13:20 devstack sudo[106170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:13:20 devstack sudo[106170]: pam_unix(sudo:session): session closed for user root Sep 17 22:13:20 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-18270a81-4852-4984-a3db-2b1020cc1f3d tempest-ProjectReaderTests-715093400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-eea22a7c-fc55-49f8-8b15-5aa5cf46251c" returned: 0 in 0.361s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:13:20 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-18270a81-4852-4984-a3db-2b1020cc1f3d tempest-ProjectReaderTests-715093400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-eea22a7c-fc55-49f8-8b15-5aa5cf46251c {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:13:20 devstack sudo[106178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-eea22a7c-fc55-49f8-8b15-5aa5cf46251c Sep 17 22:13:20 devstack sudo[106178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:13:20 devstack sudo[106169]: pam_unix(sudo:session): session closed for user root Sep 17 22:13:20 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-50b8cb6f-b1ec-4f43-8e23-989f80e52e49 tempest-SnapshotDependencyTests-1201330148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a4f03e01-3c2e-410c-b3e8-64ffe04c53c3" returned: 0 in 0.546s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:13:20 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-50b8cb6f-b1ec-4f43-8e23-989f80e52e49 tempest-SnapshotDependencyTests-1201330148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a4f03e01-3c2e-410c-b3e8-64ffe04c53c3.b2838d90-eda0-40a2-aa9e-f8ca6817b604 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:13:20 devstack sudo[106181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a4f03e01-3c2e-410c-b3e8-64ffe04c53c3.b2838d90-eda0-40a2-aa9e-f8ca6817b604 Sep 17 22:13:20 devstack sudo[106181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:13:20 devstack sudo[106178]: pam_unix(sudo:session): session closed for user root Sep 17 22:13:20 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-18270a81-4852-4984-a3db-2b1020cc1f3d tempest-ProjectReaderTests-715093400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-eea22a7c-fc55-49f8-8b15-5aa5cf46251c" returned: 0 in 0.253s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:13:20 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-18270a81-4852-4984-a3db-2b1020cc1f3d tempest-ProjectReaderTests-715093400 None] Lock "cinder-quobyte-eea22a7c-fc55-49f8-8b15-5aa5cf46251c" released by "delete_volume" :: held 0.654s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:13:20 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-18270a81-4852-4984-a3db-2b1020cc1f3d tempest-ProjectReaderTests-715093400 None] Created reservations ['67cff394-a2b6-43a6-9293-f977d44479a9', '58c4503d-de95-4f9c-b8c9-f5590480a393', '648679ee-4375-43a5-a8a8-2f9cfe26396a', 'c0cd0799-ccc3-46fb-8b85-2ea0685bbb9c'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:13:20 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-18270a81-4852-4984-a3db-2b1020cc1f3d tempest-ProjectReaderTests-715093400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:13:20 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-18270a81-4852-4984-a3db-2b1020cc1f3d tempest-ProjectReaderTests-715093400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:13:20 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-18270a81-4852-4984-a3db-2b1020cc1f3d tempest-ProjectReaderTests-715093400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:13:20 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-18270a81-4852-4984-a3db-2b1020cc1f3d tempest-ProjectReaderTests-715093400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:13:20 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-18270a81-4852-4984-a3db-2b1020cc1f3d tempest-ProjectReaderTests-715093400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:13:20 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-18270a81-4852-4984-a3db-2b1020cc1f3d tempest-ProjectReaderTests-715093400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:13:20 devstack sudo[106187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:13:20 devstack sudo[106187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:13:20 devstack sudo[106181]: pam_unix(sudo:session): session closed for user root Sep 17 22:13:20 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-50b8cb6f-b1ec-4f43-8e23-989f80e52e49 tempest-SnapshotDependencyTests-1201330148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a4f03e01-3c2e-410c-b3e8-64ffe04c53c3.b2838d90-eda0-40a2-aa9e-f8ca6817b604" returned: 0 in 0.337s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:13:20 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-50b8cb6f-b1ec-4f43-8e23-989f80e52e49 tempest-SnapshotDependencyTests-1201330148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a4f03e01-3c2e-410c-b3e8-64ffe04c53c3.b2838d90-eda0-40a2-aa9e-f8ca6817b604 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:13:20 devstack sudo[106189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a4f03e01-3c2e-410c-b3e8-64ffe04c53c3.b2838d90-eda0-40a2-aa9e-f8ca6817b604 Sep 17 22:13:20 devstack sudo[106189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:13:21 devstack sudo[106187]: pam_unix(sudo:session): session closed for user root Sep 17 22:13:21 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-18270a81-4852-4984-a3db-2b1020cc1f3d tempest-ProjectReaderTests-715093400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.255s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:13:21 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-18270a81-4852-4984-a3db-2b1020cc1f3d tempest-ProjectReaderTests-715093400 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:13:21 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-18270a81-4852-4984-a3db-2b1020cc1f3d tempest-ProjectReaderTests-715093400 None] Deleted volume successfully. Sep 17 22:13:21 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-18270a81-4852-4984-a3db-2b1020cc1f3d tempest-ProjectReaderTests-715093400 None] Lock "cinder-eea22a7c-fc55-49f8-8b15-5aa5cf46251c-delete_volume" released by "delete_volume" :: held 1.110s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:13:21 devstack sudo[106189]: pam_unix(sudo:session): session closed for user root Sep 17 22:13:21 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-50b8cb6f-b1ec-4f43-8e23-989f80e52e49 tempest-SnapshotDependencyTests-1201330148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a4f03e01-3c2e-410c-b3e8-64ffe04c53c3.b2838d90-eda0-40a2-aa9e-f8ca6817b604" returned: 0 in 0.272s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:13:21 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-50b8cb6f-b1ec-4f43-8e23-989f80e52e49 tempest-SnapshotDependencyTests-1201330148 None] Lock "cinder-quobyte-b2838d90-eda0-40a2-aa9e-f8ca6817b604" released by "_delete_snapshot" :: held 1.629s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:13:21 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-50b8cb6f-b1ec-4f43-8e23-989f80e52e49 tempest-SnapshotDependencyTests-1201330148 None] Lock "cinder-quobyte-a4f03e01-3c2e-410c-b3e8-64ffe04c53c3" released by "delete_snapshot" :: held 1.649s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:13:21 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-50b8cb6f-b1ec-4f43-8e23-989f80e52e49 tempest-SnapshotDependencyTests-1201330148 None] Created reservations ['a9df9d15-e5e2-4698-bc23-b1fdd9158fb4', '4d112fc4-4557-45a3-a70e-e2db4105f6d0', 'be9fb38f-34f1-49b7-8c87-74abc7563642', 'cb7b513a-c03e-4efc-a9a9-6d4caa053dd0'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:13:21 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-50b8cb6f-b1ec-4f43-8e23-989f80e52e49 tempest-SnapshotDependencyTests-1201330148 None] Delete snapshot completed successfully. Sep 17 22:13:21 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-50b8cb6f-b1ec-4f43-8e23-989f80e52e49 tempest-SnapshotDependencyTests-1201330148 None] Lock "cinder-b2838d90-eda0-40a2-aa9e-f8ca6817b604-delete_snapshot" released by "delete_snapshot" :: held 1.784s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:13:21 devstack cinder-volume[85458]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f6c73a0-6c09-45d4-accd-8388d183d7f9 tempest-ProjectReaderTests-715093400 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85458) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 22:13:21 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-1f6c73a0-6c09-45d4-accd-8388d183d7f9 tempest-ProjectReaderTests-715093400 None] Flow 'volume_create_manager' (1bb357f4-7abc-402a-9f18-7e0f96281f40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:13:21 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-1f6c73a0-6c09-45d4-accd-8388d183d7f9 tempest-ProjectReaderTests-715093400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (269e518e-5fd0-4dba-b128-8ccad0c75eef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:13:21 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-1f6c73a0-6c09-45d4-accd-8388d183d7f9 tempest-ProjectReaderTests-715093400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (269e518e-5fd0-4dba-b128-8ccad0c75eef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:13:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-666513207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4655d0ce-f0ce-4f9d-bf34-8179009d71e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6fda5fd4130411ea7bffaf64a96892a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:13:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:13:22Z,use_quota=True,user_id='08c6cc94cbb241aa8ca94ca73202a6c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:13:21 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-1f6c73a0-6c09-45d4-accd-8388d183d7f9 tempest-ProjectReaderTests-715093400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39713029-1f79-409f-9318-fcbcebb86ea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:13:21 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-1f6c73a0-6c09-45d4-accd-8388d183d7f9 tempest-ProjectReaderTests-715093400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39713029-1f79-409f-9318-fcbcebb86ea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:13:21 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-1f6c73a0-6c09-45d4-accd-8388d183d7f9 tempest-ProjectReaderTests-715093400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70f01f7f-9284-49d8-a0fc-43c8e1630859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:13:21 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-1f6c73a0-6c09-45d4-accd-8388d183d7f9 tempest-ProjectReaderTests-715093400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70f01f7f-9284-49d8-a0fc-43c8e1630859) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4655d0ce-f0ce-4f9d-bf34-8179009d71e4', 'volume_name': 'volume-4655d0ce-f0ce-4f9d-bf34-8179009d71e4', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:13:21 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-1f6c73a0-6c09-45d4-accd-8388d183d7f9 tempest-ProjectReaderTests-715093400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4a27fed-93a0-483e-8331-bf34015d9913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:13:21 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-1f6c73a0-6c09-45d4-accd-8388d183d7f9 tempest-ProjectReaderTests-715093400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4a27fed-93a0-483e-8331-bf34015d9913) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:13:21 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-1f6c73a0-6c09-45d4-accd-8388d183d7f9 tempest-ProjectReaderTests-715093400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e86d5dc-5d9d-4c36-99ef-3606c3d3ecc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:13:21 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-1f6c73a0-6c09-45d4-accd-8388d183d7f9 tempest-ProjectReaderTests-715093400 None] Volume 4655d0ce-f0ce-4f9d-bf34-8179009d71e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4655d0ce-f0ce-4f9d-bf34-8179009d71e4', 'volume_size': 1} Sep 17 22:13:21 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-1f6c73a0-6c09-45d4-accd-8388d183d7f9 tempest-ProjectReaderTests-715093400 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:13:21 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-1f6c73a0-6c09-45d4-accd-8388d183d7f9 tempest-ProjectReaderTests-715093400 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:13:21 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-1f6c73a0-6c09-45d4-accd-8388d183d7f9 tempest-ProjectReaderTests-715093400 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T20:13:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-666513207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4655d0ce-f0ce-4f9d-bf34-8179009d71e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6fda5fd4130411ea7bffaf64a96892a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T20:13:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T20:13:22Z,use_quota=True,user_id='08c6cc94cbb241aa8ca94ca73202a6c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a446504d-d879-4d69-88be-3a2ca1e85a6a),volume_type_id=a446504d-d879-4d69-88be-3a2ca1e85a6a)}" {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 22:13:21 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.remotefs [None req-1f6c73a0-6c09-45d4-accd-8388d183d7f9 tempest-ProjectReaderTests-715093400 None] Creating volume 4655d0ce-f0ce-4f9d-bf34-8179009d71e4 {{(pid=85458) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 22:13:21 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-1f6c73a0-6c09-45d4-accd-8388d183d7f9 tempest-ProjectReaderTests-715093400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:13:21 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-1f6c73a0-6c09-45d4-accd-8388d183d7f9 tempest-ProjectReaderTests-715093400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:13:21 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-1f6c73a0-6c09-45d4-accd-8388d183d7f9 tempest-ProjectReaderTests-715093400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:13:21 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-1f6c73a0-6c09-45d4-accd-8388d183d7f9 tempest-ProjectReaderTests-715093400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:13:21 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-1f6c73a0-6c09-45d4-accd-8388d183d7f9 tempest-ProjectReaderTests-715093400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:13:21 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-1f6c73a0-6c09-45d4-accd-8388d183d7f9 tempest-ProjectReaderTests-715093400 None] Selected osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 as target Quobyte volume. {{(pid=85458) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 22:13:21 devstack cinder-volume[85458]: INFO cinder.volume.drivers.remotefs [None req-1f6c73a0-6c09-45d4-accd-8388d183d7f9 tempest-ProjectReaderTests-715093400 None] casted to osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5 Sep 17 22:13:21 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-1f6c73a0-6c09-45d4-accd-8388d183d7f9 tempest-ProjectReaderTests-715093400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-4655d0ce-f0ce-4f9d-bf34-8179009d71e4 1073741824 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:13:21 devstack sudo[106193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-4655d0ce-f0ce-4f9d-bf34-8179009d71e4 1073741824 Sep 17 22:13:21 devstack sudo[106193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:13:21 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-2c6ed00b-2ceb-4800-902f-6bad8f51f02e tempest-SnapshotDependencyTests-1201330148 None] Acquiring lock "cinder-a4f03e01-3c2e-410c-b3e8-64ffe04c53c3-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:13:21 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-2c6ed00b-2ceb-4800-902f-6bad8f51f02e tempest-SnapshotDependencyTests-1201330148 None] Lock "cinder-a4f03e01-3c2e-410c-b3e8-64ffe04c53c3-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:13:21 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-2c6ed00b-2ceb-4800-902f-6bad8f51f02e tempest-SnapshotDependencyTests-1201330148 None] Acquiring lock "cinder-quobyte-a4f03e01-3c2e-410c-b3e8-64ffe04c53c3" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:13:21 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-2c6ed00b-2ceb-4800-902f-6bad8f51f02e tempest-SnapshotDependencyTests-1201330148 None] Lock "cinder-quobyte-a4f03e01-3c2e-410c-b3e8-64ffe04c53c3" acquired by "delete_volume" :: waited 0.016s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:13:21 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[ece9960f-b9a6-4bc5-af31-69c34ab5bb31]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:13:21 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-2c6ed00b-2ceb-4800-902f-6bad8f51f02e tempest-SnapshotDependencyTests-1201330148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a4f03e01-3c2e-410c-b3e8-64ffe04c53c3 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:13:21 devstack sudo[106195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a4f03e01-3c2e-410c-b3e8-64ffe04c53c3 Sep 17 22:13:21 devstack sudo[106195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:13:22 devstack sudo[106193]: pam_unix(sudo:session): session closed for user root Sep 17 22:13:22 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-1f6c73a0-6c09-45d4-accd-8388d183d7f9 tempest-ProjectReaderTests-715093400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-4655d0ce-f0ce-4f9d-bf34-8179009d71e4 1073741824" returned: 0 in 0.448s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:13:22 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-1f6c73a0-6c09-45d4-accd-8388d183d7f9 tempest-ProjectReaderTests-715093400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-4655d0ce-f0ce-4f9d-bf34-8179009d71e4 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:13:22 devstack sudo[106203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-4655d0ce-f0ce-4f9d-bf34-8179009d71e4 Sep 17 22:13:22 devstack sudo[106203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:13:22 devstack sudo[106195]: pam_unix(sudo:session): session closed for user root Sep 17 22:13:22 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-2c6ed00b-2ceb-4800-902f-6bad8f51f02e tempest-SnapshotDependencyTests-1201330148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a4f03e01-3c2e-410c-b3e8-64ffe04c53c3" returned: 0 in 0.401s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:13:22 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-2c6ed00b-2ceb-4800-902f-6bad8f51f02e tempest-SnapshotDependencyTests-1201330148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a4f03e01-3c2e-410c-b3e8-64ffe04c53c3 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:13:22 devstack sudo[106208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a4f03e01-3c2e-410c-b3e8-64ffe04c53c3 Sep 17 22:13:22 devstack sudo[106208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:13:22 devstack sudo[106203]: pam_unix(sudo:session): session closed for user root Sep 17 22:13:22 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-1f6c73a0-6c09-45d4-accd-8388d183d7f9 tempest-ProjectReaderTests-715093400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-4655d0ce-f0ce-4f9d-bf34-8179009d71e4" returned: 0 in 0.262s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:13:22 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-1f6c73a0-6c09-45d4-accd-8388d183d7f9 tempest-ProjectReaderTests-715093400 None] <== create_volume: return (753ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'} {{(pid=85458) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 22:13:22 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-1f6c73a0-6c09-45d4-accd-8388d183d7f9 tempest-ProjectReaderTests-715093400 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.756s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:13:22 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-1f6c73a0-6c09-45d4-accd-8388d183d7f9 tempest-ProjectReaderTests-715093400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e86d5dc-5d9d-4c36-99ef-3606c3d3ecc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4655d0ce-f0ce-4f9d-bf34-8179009d71e4', 'volume_size': 1}' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:13:22 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-1f6c73a0-6c09-45d4-accd-8388d183d7f9 tempest-ProjectReaderTests-715093400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d3cc339-a3a0-49fc-9108-17d8406a0e34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 22:13:22 devstack cinder-volume[85458]: INFO cinder.volume.flows.manager.create_volume [None req-1f6c73a0-6c09-45d4-accd-8388d183d7f9 tempest-ProjectReaderTests-715093400 None] Volume volume-4655d0ce-f0ce-4f9d-bf34-8179009d71e4 (4655d0ce-f0ce-4f9d-bf34-8179009d71e4): created successfully Sep 17 22:13:22 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-1f6c73a0-6c09-45d4-accd-8388d183d7f9 tempest-ProjectReaderTests-715093400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d3cc339-a3a0-49fc-9108-17d8406a0e34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85458) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 22:13:22 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-1f6c73a0-6c09-45d4-accd-8388d183d7f9 tempest-ProjectReaderTests-715093400 None] Flow 'volume_create_manager' (1bb357f4-7abc-402a-9f18-7e0f96281f40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85458) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 22:13:22 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-1f6c73a0-6c09-45d4-accd-8388d183d7f9 tempest-ProjectReaderTests-715093400 None] Created volume successfully. Sep 17 22:13:22 devstack sudo[106208]: pam_unix(sudo:session): session closed for user root Sep 17 22:13:22 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-2c6ed00b-2ceb-4800-902f-6bad8f51f02e tempest-SnapshotDependencyTests-1201330148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-a4f03e01-3c2e-410c-b3e8-64ffe04c53c3" returned: 0 in 0.274s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:13:22 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-2c6ed00b-2ceb-4800-902f-6bad8f51f02e tempest-SnapshotDependencyTests-1201330148 None] Lock "cinder-quobyte-a4f03e01-3c2e-410c-b3e8-64ffe04c53c3" released by "delete_volume" :: held 0.735s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:13:22 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-2c6ed00b-2ceb-4800-902f-6bad8f51f02e tempest-SnapshotDependencyTests-1201330148 None] Created reservations ['fc3df95d-d9cb-4cf8-8ef7-545cfd4fd0db', '1fb66cc9-a9b4-41be-baf1-1d9ee774b1d2', 'f83859ef-8837-4e88-8950-deab09085e5d', '67378c1f-362a-4815-9ae2-b1f75d94449e'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:13:22 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-c216bed4-5cd3-4d3d-9a33-7caa936bed41 tempest-ProjectReaderTests-715093400 None] Acquiring lock "cinder-4655d0ce-f0ce-4f9d-bf34-8179009d71e4-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:13:22 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-2c6ed00b-2ceb-4800-902f-6bad8f51f02e tempest-SnapshotDependencyTests-1201330148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:13:22 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-2c6ed00b-2ceb-4800-902f-6bad8f51f02e tempest-SnapshotDependencyTests-1201330148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:13:22 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-2c6ed00b-2ceb-4800-902f-6bad8f51f02e tempest-SnapshotDependencyTests-1201330148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:13:22 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-2c6ed00b-2ceb-4800-902f-6bad8f51f02e tempest-SnapshotDependencyTests-1201330148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:13:22 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-2c6ed00b-2ceb-4800-902f-6bad8f51f02e tempest-SnapshotDependencyTests-1201330148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:13:22 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-2c6ed00b-2ceb-4800-902f-6bad8f51f02e tempest-SnapshotDependencyTests-1201330148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:13:22 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-c216bed4-5cd3-4d3d-9a33-7caa936bed41 tempest-ProjectReaderTests-715093400 None] Lock "cinder-4655d0ce-f0ce-4f9d-bf34-8179009d71e4-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:13:22 devstack sudo[106212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:13:22 devstack sudo[106212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:13:22 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-c216bed4-5cd3-4d3d-9a33-7caa936bed41 tempest-ProjectReaderTests-715093400 None] Acquiring lock "cinder-quobyte-4655d0ce-f0ce-4f9d-bf34-8179009d71e4" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:13:22 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-c216bed4-5cd3-4d3d-9a33-7caa936bed41 tempest-ProjectReaderTests-715093400 None] Lock "cinder-quobyte-4655d0ce-f0ce-4f9d-bf34-8179009d71e4" acquired by "delete_volume" :: waited 0.013s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:13:22 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2d2c95e-5f28-4464-903b-307818ed38d3]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:13:22 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-c216bed4-5cd3-4d3d-9a33-7caa936bed41 tempest-ProjectReaderTests-715093400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-4655d0ce-f0ce-4f9d-bf34-8179009d71e4 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:13:22 devstack sudo[106214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-4655d0ce-f0ce-4f9d-bf34-8179009d71e4 Sep 17 22:13:22 devstack sudo[106214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:13:22 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-495e695e-71ee-4912-a730-b72a0b25ae21 tempest-SnapshotDependencyTests-1201330148 None] Acquiring lock "cinder-031ab592-5f96-4746-95a3-729c8b630b58-delete_volume" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:13:22 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-495e695e-71ee-4912-a730-b72a0b25ae21 tempest-SnapshotDependencyTests-1201330148 None] Lock "cinder-031ab592-5f96-4746-95a3-729c8b630b58-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:13:22 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-495e695e-71ee-4912-a730-b72a0b25ae21 tempest-SnapshotDependencyTests-1201330148 None] Acquiring lock "cinder-quobyte-031ab592-5f96-4746-95a3-729c8b630b58" by "delete_volume" {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 22:13:22 devstack sudo[106212]: pam_unix(sudo:session): session closed for user root Sep 17 22:13:22 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-2c6ed00b-2ceb-4800-902f-6bad8f51f02e tempest-SnapshotDependencyTests-1201330148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.313s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:13:22 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-2c6ed00b-2ceb-4800-902f-6bad8f51f02e tempest-SnapshotDependencyTests-1201330148 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:13:23 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-495e695e-71ee-4912-a730-b72a0b25ae21 tempest-SnapshotDependencyTests-1201330148 None] Lock "cinder-quobyte-031ab592-5f96-4746-95a3-729c8b630b58" acquired by "delete_volume" :: waited 0.016s {{(pid=85458) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 22:13:23 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-2c6ed00b-2ceb-4800-902f-6bad8f51f02e tempest-SnapshotDependencyTests-1201330148 None] Deleted volume successfully. Sep 17 22:13:23 devstack cinder-volume[85458]: DEBUG oslo.privsep.daemon [-] privsep: reply[694d87bd-8e7c-422a-bda3-5233196b5d6f]: (4, 'qcow2') {{(pid=86668) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 22:13:23 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-495e695e-71ee-4912-a730-b72a0b25ae21 tempest-SnapshotDependencyTests-1201330148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031ab592-5f96-4746-95a3-729c8b630b58 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:13:23 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-2c6ed00b-2ceb-4800-902f-6bad8f51f02e tempest-SnapshotDependencyTests-1201330148 None] Lock "cinder-a4f03e01-3c2e-410c-b3e8-64ffe04c53c3-delete_volume" released by "delete_volume" :: held 1.290s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:13:23 devstack sudo[106217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031ab592-5f96-4746-95a3-729c8b630b58 Sep 17 22:13:23 devstack sudo[106217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:13:23 devstack sudo[106214]: pam_unix(sudo:session): session closed for user root Sep 17 22:13:23 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-c216bed4-5cd3-4d3d-9a33-7caa936bed41 tempest-ProjectReaderTests-715093400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-4655d0ce-f0ce-4f9d-bf34-8179009d71e4" returned: 0 in 0.418s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:13:23 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-c216bed4-5cd3-4d3d-9a33-7caa936bed41 tempest-ProjectReaderTests-715093400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-4655d0ce-f0ce-4f9d-bf34-8179009d71e4 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:13:23 devstack sudo[106222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-4655d0ce-f0ce-4f9d-bf34-8179009d71e4 Sep 17 22:13:23 devstack sudo[106222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:13:23 devstack sudo[106217]: pam_unix(sudo:session): session closed for user root Sep 17 22:13:23 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-495e695e-71ee-4912-a730-b72a0b25ae21 tempest-SnapshotDependencyTests-1201330148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031ab592-5f96-4746-95a3-729c8b630b58" returned: 0 in 0.379s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:13:23 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-495e695e-71ee-4912-a730-b72a0b25ae21 tempest-SnapshotDependencyTests-1201330148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031ab592-5f96-4746-95a3-729c8b630b58 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:13:23 devstack sudo[106228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031ab592-5f96-4746-95a3-729c8b630b58 Sep 17 22:13:23 devstack sudo[106228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:13:23 devstack sudo[106222]: pam_unix(sudo:session): session closed for user root Sep 17 22:13:23 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-c216bed4-5cd3-4d3d-9a33-7caa936bed41 tempest-ProjectReaderTests-715093400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-4655d0ce-f0ce-4f9d-bf34-8179009d71e4" returned: 0 in 0.253s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:13:23 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-c216bed4-5cd3-4d3d-9a33-7caa936bed41 tempest-ProjectReaderTests-715093400 None] Lock "cinder-quobyte-4655d0ce-f0ce-4f9d-bf34-8179009d71e4" released by "delete_volume" :: held 0.718s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:13:23 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-c216bed4-5cd3-4d3d-9a33-7caa936bed41 tempest-ProjectReaderTests-715093400 None] Created reservations ['b2a4955a-2515-4ff8-99f3-2f42e0b85964', 'f2da8f49-3433-435e-afc2-49dad64694c6', 'e94a2e67-8cd6-4515-bb63-f49931adf91e', 'b6f0bb90-3c54-47ac-b984-332607fb783b'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:13:23 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-c216bed4-5cd3-4d3d-9a33-7caa936bed41 tempest-ProjectReaderTests-715093400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:13:23 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-c216bed4-5cd3-4d3d-9a33-7caa936bed41 tempest-ProjectReaderTests-715093400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:13:23 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-c216bed4-5cd3-4d3d-9a33-7caa936bed41 tempest-ProjectReaderTests-715093400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:13:23 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-c216bed4-5cd3-4d3d-9a33-7caa936bed41 tempest-ProjectReaderTests-715093400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:13:23 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-c216bed4-5cd3-4d3d-9a33-7caa936bed41 tempest-ProjectReaderTests-715093400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:13:23 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-c216bed4-5cd3-4d3d-9a33-7caa936bed41 tempest-ProjectReaderTests-715093400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:13:23 devstack sudo[106230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:13:23 devstack sudo[106230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:13:23 devstack sudo[106228]: pam_unix(sudo:session): session closed for user root Sep 17 22:13:23 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-495e695e-71ee-4912-a730-b72a0b25ae21 tempest-SnapshotDependencyTests-1201330148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229/volume-031ab592-5f96-4746-95a3-729c8b630b58" returned: 0 in 0.274s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:13:23 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-495e695e-71ee-4912-a730-b72a0b25ae21 tempest-SnapshotDependencyTests-1201330148 None] Lock "cinder-quobyte-031ab592-5f96-4746-95a3-729c8b630b58" released by "delete_volume" :: held 0.700s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:13:23 devstack cinder-volume[85458]: DEBUG cinder.quota [None req-495e695e-71ee-4912-a730-b72a0b25ae21 tempest-SnapshotDependencyTests-1201330148 None] Created reservations ['7d0a945a-65a0-45e4-9c37-af4be579dacc', '3a9e6b4d-a21f-45ab-8198-41db08b587f2', 'dd34083c-5dcd-4855-b169-923b3a8e8b98', '298bae30-bb38-458f-bea9-44a19d73aa56'] {{(pid=85458) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 22:13:23 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-495e695e-71ee-4912-a730-b72a0b25ae21 tempest-SnapshotDependencyTests-1201330148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:13:23 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-495e695e-71ee-4912-a730-b72a0b25ae21 tempest-SnapshotDependencyTests-1201330148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:13:23 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-495e695e-71ee-4912-a730-b72a0b25ae21 tempest-SnapshotDependencyTests-1201330148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:13:23 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-495e695e-71ee-4912-a730-b72a0b25ae21 tempest-SnapshotDependencyTests-1201330148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:13:23 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-495e695e-71ee-4912-a730-b72a0b25ae21 tempest-SnapshotDependencyTests-1201330148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:13:23 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-495e695e-71ee-4912-a730-b72a0b25ae21 tempest-SnapshotDependencyTests-1201330148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:13:23 devstack sudo[106230]: pam_unix(sudo:session): session closed for user root Sep 17 22:13:23 devstack sudo[106234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:13:23 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-c216bed4-5cd3-4d3d-9a33-7caa936bed41 tempest-ProjectReaderTests-715093400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.267s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:13:23 devstack sudo[106234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:13:23 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-c216bed4-5cd3-4d3d-9a33-7caa936bed41 tempest-ProjectReaderTests-715093400 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:13:23 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-c216bed4-5cd3-4d3d-9a33-7caa936bed41 tempest-ProjectReaderTests-715093400 None] Deleted volume successfully. Sep 17 22:13:23 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-c216bed4-5cd3-4d3d-9a33-7caa936bed41 tempest-ProjectReaderTests-715093400 None] Lock "cinder-4655d0ce-f0ce-4f9d-bf34-8179009d71e4-delete_volume" released by "delete_volume" :: held 1.177s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:13:24 devstack sudo[106234]: pam_unix(sudo:session): session closed for user root Sep 17 22:13:24 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-495e695e-71ee-4912-a730-b72a0b25ae21 tempest-SnapshotDependencyTests-1201330148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.271s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:13:24 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-495e695e-71ee-4912-a730-b72a0b25ae21 tempest-SnapshotDependencyTests-1201330148 None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:13:24 devstack cinder-volume[85458]: INFO cinder.volume.manager [None req-495e695e-71ee-4912-a730-b72a0b25ae21 tempest-SnapshotDependencyTests-1201330148 None] Deleted volume successfully. Sep 17 22:13:24 devstack cinder-volume[85458]: DEBUG cinder.coordination [None req-495e695e-71ee-4912-a730-b72a0b25ae21 tempest-SnapshotDependencyTests-1201330148 None] Lock "cinder-031ab592-5f96-4746-95a3-729c8b630b58-delete_volume" released by "delete_volume" :: held 1.182s {{(pid=85458) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 22:13:27 devstack cinder-volume[85458]: DEBUG oslo_service.periodic_task [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85458) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 22:13:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 22:13:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 22:13:27 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5': None} {{(pid=85458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 22:13:27 devstack cinder-volume[85458]: DEBUG cinder.volume.drivers.quobyte [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9ef474e-69c3-414e-9251-58c3e76182d5'] {{(pid=85458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 22:13:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.lockutils [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 22:13:27 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 22:13:27 devstack sudo[106274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229 Sep 17 22:13:27 devstack sudo[106274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 22:13:28 devstack sudo[106274]: pam_unix(sudo:session): session closed for user root Sep 17 22:13:28 devstack cinder-volume[85458]: DEBUG oslo_concurrency.processutils [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff2be240df021a7e987d67421bd78229" returned: 0 in 0.267s {{(pid=85458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 22:13:28 devstack cinder-volume[85458]: DEBUG cinder.manager [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Notifying Schedulers of capabilities ... {{(pid=85458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 22:13:28 devstack cinder-volume[85458]: DEBUG oslo_service.periodic_task [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] Running periodic task VolumeManager._thread_info {{(pid=85458) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 22:13:28 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] thread count: 28 {{(pid=85458) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 22:13:28 devstack cinder-volume[85458]: DEBUG cinder.volume.manager [None req-e0bad5a8-67ce-486d-802c-6c4e1099dbcb None None] thread info: [<_MainThread(MainThread, started 127546830999680)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85458) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 22:13:33 devstack cinder-volume[85458]: DEBUG dbcounter [-] [85458] Writing DB stats cinder:UPDATE=78,cinder:SELECT=47,cinder:DELETE=7,cinder:INSERT=17 {{(pid=85458) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 22:13:34 devstack cinder-volume[85458]: DEBUG dbcounter [-] [85458] Writing DB stats cinder:UPDATE=68,cinder:SELECT=57,cinder:INSERT=18,cinder:DELETE=6 {{(pid=85458) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}